Jul 10 15:41:41 devstack cinder-volume[76153]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 10 15:41:41 devstack cinder-volume[76153]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 10 15:41:41 devstack cinder-volume[76153]: we strongly recommend against using it for new projects. Jul 10 15:41:41 devstack cinder-volume[76153]: If you are already using Eventlet, we recommend migrating to a different Jul 10 15:41:41 devstack cinder-volume[76153]: framework. For more detail see Jul 10 15:41:41 devstack cinder-volume[76153]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 10 15:41:41 devstack cinder-volume[76153]: import eventlet # noqa Jul 10 15:41:43 devstack cinder-volume[76153]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76153) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 10 15:41:43 devstack cinder-volume[76153]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76153) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 10 15:41:43 devstack cinder-volume[76153]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76153) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 10 15:41:44 devstack cinder-volume[76153]: INFO dbcounter [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] Registered counter for database cinder Jul 10 15:41:44 devstack cinder-volume[76153]: DEBUG oslo_db.sqlalchemy.engines [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76153) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 15:41:45 devstack cinder-volume[76153]: DEBUG dbcounter [-] [76153] Writer thread running {{(pid=76153) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 10 15:41:45 devstack cinder-volume[76153]: INFO cinder.rpc [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 10 15:41:45 devstack cinder-volume[76153]: INFO cinder.rpc [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 10 15:41:45 devstack cinder-volume[76153]: DEBUG oslo_db.sqlalchemy.engines [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76153) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 15:41:45 devstack cinder-volume[76153]: INFO cinder.volume.manager [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] Determined volume DB was empty at startup. Jul 10 15:41:45 devstack cinder-volume[76153]: DEBUG cinder.volume.manager [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76153) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 10 15:41:45 devstack cinder-volume[76153]: INFO cinder.volume.manager [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 10 15:41:45 devstack cinder-volume[76153]: WARNING stevedore.named [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 10 15:41:45 devstack cinder-volume[76153]: WARNING castellan.key_manager [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 10 15:41:45 devstack cinder-volume[76153]: WARNING cinder.keymgr.conf_key_mgr [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 10 15:41:45 devstack cinder-volume[76153]: DEBUG cinder.volume.drivers.lvm [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76153) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jul 10 15:41:45 devstack cinder-volume[76153]: DEBUG oslo_concurrency.processutils [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:41:45 devstack cinder-volume[76153]: DEBUG oslo_concurrency.processutils [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] CMD "cinder-rtstool verify" returned: 0 in 0.411s {{(pid=76153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:41:45 devstack cinder-volume[76153]: DEBUG oslo_db.sqlalchemy.engines [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76153) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 15:41:45 devstack cinder-volume[76153]: INFO cinder.rpc [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 10 15:41:45 devstack cinder-volume[76153]: INFO cinder.rpc [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 10 15:41:45 devstack cinder-volume[76153]: WARNING stevedore.named [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 10 15:41:45 devstack cinder-volume[76153]: WARNING castellan.key_manager [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 10 15:41:45 devstack cinder-volume[76153]: INFO cinder.volume.manager [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_db.sqlalchemy.engines [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76153) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 15:41:46 devstack cinder-volume[76153]: INFO oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] Starting 1 workers Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] Started child 76322 {{(pid=76153) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] Full set of CONF: {{(pid=76153) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] ******************************************************************************** {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] Configuration options gathered from: {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 10 15:41:46 devstack cinder-volume[76322]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] ================================================================================ {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] allow_availability_zone_fallback = False {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] allow_compression_on_image_upload = False {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] allowed_direct_url_schemes = [] {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] api_rate_limit = True {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] auth_strategy = keystone {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] az_cache_duration = 3600 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] backend_availability_zone = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] backend_host = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] backend_name = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] backend_stats_polling_interval = 60 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] backup_api_class = cinder.backup.api.API {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] backup_name_template = backup-%s {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] backup_use_same_host = False {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] backup_use_temp_snapshot = False {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] chap_password = **** {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] chap_username = {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] cinder_internal_tenant_project_id = 293df3badd6f4d8cacd5ee5e7ea8585f {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] cinder_internal_tenant_user_id = afe66ebb36dd4b90bb08571db9126407 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] cloned_volume_same_az = True {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] cluster = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] compression_format = gzip {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] compute_api_class = cinder.compute.nova.API {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] config_dir = [] {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] config_source = [] {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] control_exchange = openstack {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] debug = True {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] default_availability_zone = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] default_group_type = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] default_volume_type = lvmdriver-1 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] disk_geometry = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] driver_client_cert = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] driver_client_cert_key = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] driver_data_namespace = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] driver_ssl_cert_path = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] driver_ssl_cert_verify = False {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] driver_use_ssl = False {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] enable_force_upload = False {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] enable_new_services = True {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] enable_unsupported_driver = False {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] enabled_backends = ['lvmdriver-1'] {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] enforce_multipath_for_image_xfer = False {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] filter_function = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] glance_api_insecure = False {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] glance_api_servers = ['http://192.168.122.81/image'] {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] glance_api_ssl_compression = False {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] glance_ca_certificates_file = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] glance_catalog_info = image:glance:publicURL {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] glance_certfile = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] glance_keyfile = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] glance_num_retries = 3 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] glance_request_timeout = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] goodness_function = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] graceful_shutdown_timeout = 5 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] group_api_class = cinder.group.api.API {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] host = devstack {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] image_compress_on_upload = True {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] image_conversion_address_space_limit = 1 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] image_conversion_cpu_limit = 60 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] image_conversion_disable = False {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] image_upload_use_cinder_backend = False {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] image_upload_use_internal_tenant = False {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] image_volume_cache_enabled = False {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76322]: INFO cinder.volume.manager [None req-7c313ab3-b376-46f8-957f-5f63d30c4289 None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] image_volume_cache_max_count = 0 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] image_volume_cache_max_size_gb = 0 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76322]: DEBUG oslo_concurrency.processutils [None req-7c313ab3-b376-46f8-957f-5f63d30c4289 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76322) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] init_host_max_objects_retrieval = 0 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] instance_format = [instance: %(uuid)s] {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] iscsi_target_flags = {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] iscsi_write_cache = on {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] iser_helper = tgtadm {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] iser_ip_address = 192.168.122.81 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] iser_port = 3260 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] log_color = False {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] log_config_append = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] log_dir = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] log_file = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] log_options = True {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] log_rotate_interval = 1 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] log_rotate_interval_type = days {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] log_rotation_type = none {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] max_age = 0 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] max_logfile_count = 30 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] max_logfile_size_mb = 200 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] max_over_subscription_ratio = 20.0 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] message_reap_interval = 86400 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] message_ttl = 2592000 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] migration_create_volume_timeout_secs = 300 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] monkey_patch = False {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] monkey_patch_modules = [] {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] my_ip = 192.168.122.81 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] no_snapshot_gb_quota = False {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] num_iser_scan_tries = 3 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] num_shell_tries = 3 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] num_volume_device_scan_tries = 3 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] nvmeof_conn_info_version = 1 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] nvmet_ns_id = 10 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] nvmet_port_id = 1 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] osapi_max_limit = 1000 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] osapi_volume_ext_list = [] {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] osapi_volume_listen = 0.0.0.0 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] osapi_volume_listen_port = 8776 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] osapi_volume_use_ssl = False {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] osapi_volume_workers = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] per_volume_size_limit = -1 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] periodic_fuzzy_delay = 60 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] periodic_interval = 60 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] project_id_regex = [0-9a-f\-]+ {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] public_endpoint = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] publish_errors = False {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] quota_backup_gigabytes = 1000 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] quota_backups = 10 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] quota_gigabytes = 1000 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] quota_groups = 10 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] quota_snapshots = 10 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] quota_volumes = 10 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] rate_limit_burst = 0 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76322]: DEBUG oslo_concurrency.processutils [None req-7c313ab3-b376-46f8-957f-5f63d30c4289 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=76322) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] rate_limit_except_level = CRITICAL {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] rate_limit_interval = 0 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76322]: DEBUG oslo_concurrency.processutils [None req-7c313ab3-b376-46f8-957f-5f63d30c4289 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76322) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] reinit_driver_count = 3 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] replication_device = **** {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] report_discard_supported = False {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] report_interval = 120 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] reservation_clean_interval = 86400 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] reservation_expire = 86400 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] reserved_image_namespaces = [] {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] reserved_percentage = 0 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] rpc_response_timeout = 120 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] run_external_periodic_tasks = True {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] scst_target_driver = iscsi {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] scst_target_iqn_name = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] service_down_time = 720 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] shell_completion = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] snapshot_name_template = snapshot-%s {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] snapshot_same_host = True {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] split_loggers = False {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] state_path = /opt/stack/data/cinder {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] storage_availability_zone = nova {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] storage_protocol = iSCSI {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] syslog_log_facility = LOG_USER {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] target_helper = lioadm {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] target_ip_address = 192.168.122.81 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] target_port = 3260 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76322]: DEBUG oslo_concurrency.processutils [None req-7c313ab3-b376-46f8-957f-5f63d30c4289 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76322) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76322]: DEBUG oslo_concurrency.processutils [None req-7c313ab3-b376-46f8-957f-5f63d30c4289 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76322) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] target_protocol = iscsi {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] target_secondary_ip_addresses = [] {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] trace_flags = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] transfer_api_class = cinder.transfer.api.API {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] transport_url = **** {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] until_refresh = 0 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] use_chap_auth = False {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] use_default_quota_class = True {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] use_journal = False {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] use_json = False {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] use_multipath_for_image_xfer = False {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] use_stderr = False {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] use_syslog = False {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] verify_glance_signatures = enabled {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] volume_api_class = cinder.volume.api.API {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] volume_backend_name = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] volume_clear = zero {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] volume_clear_ionice = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] volume_clear_size = 0 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] volume_copy_bps_limit = 0 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] volume_dd_blocksize = 1M {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76322]: DEBUG oslo_concurrency.processutils [None req-7c313ab3-b376-46f8-957f-5f63d30c4289 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76322) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] volume_name_template = volume-%s {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] volume_service_inithost_offload = False {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] volume_usage_audit_period = month {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] zoning_mode = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:41:46 devstack cinder-volume[76322]: DEBUG oslo_concurrency.processutils [None req-7c313ab3-b376-46f8-957f-5f63d30c4289 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76322) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] oslo_concurrency.disable_process_locking = False {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] keystone_authtoken.auth_section = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] keystone_authtoken.auth_type = password {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] keystone_authtoken.auth_version = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] keystone_authtoken.cache = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] keystone_authtoken.certfile = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] keystone_authtoken.delay_auth_decision = False {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] keystone_authtoken.http_connect_timeout = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] keystone_authtoken.include_service_catalog = True {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] keystone_authtoken.insecure = False {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] keystone_authtoken.interface = public {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] keystone_authtoken.keyfile = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] keystone_authtoken.memcache_password = {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] keystone_authtoken.memcache_username = {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] keystone_authtoken.region_name = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] keystone_authtoken.service_token_roles_required = True {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] keystone_authtoken.service_type = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] keystone_authtoken.token_cache_time = 300 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack sudo[76326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 10 15:41:46 devstack sudo[76326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.81/identity {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] cache.backend = dogpile.cache.null {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] cache.backend_argument = **** {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] cache.backend_expiration_time = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] cache.config_prefix = cache.oslo {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] cache.debug_cache_backend = False {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] cache.enable_retry_client = False {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] cache.enable_socket_keepalive = False {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] cache.enabled = False {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] cache.expiration_time = 600 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] cache.hashclient_retry_attempts = 2 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] cache.memcache_dead_retry = 300 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] cache.memcache_pool_maxsize = 10 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] cache.memcache_sasl_enabled = False {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] cache.password = **** {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] cache.proxies = [] {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] cache.redis_db = 0 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] cache.redis_sentinel_service_name = mymaster {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] cache.redis_server = localhost:6379 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] cache.retry_attempts = 2 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] cache.retry_delay = 0.0 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] cache.socket_keepalive_count = 1 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] cache.socket_keepalive_idle = 1 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] cache.socket_keepalive_interval = 1 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] cache.socket_timeout = 1.0 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] cache.tls_allowed_ciphers = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] cache.tls_cafile = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] cache.tls_certfile = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] cache.tls_enabled = False {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] cache.tls_keyfile = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] cache.username = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] coordination.backend_url = **** {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] database.asyncio_connection = **** {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] database.asyncio_slave_connection = **** {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] database.backend = sqlalchemy {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] database.connection = **** {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] database.connection_debug = 0 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] database.connection_parameters = {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] database.connection_recycle_time = 3600 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] database.connection_trace = False {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] database.db_inc_retry_interval = True {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] database.db_max_retries = 20 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] database.db_max_retry_interval = 10 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] database.db_retry_interval = 1 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] database.max_overflow = 50 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] database.max_pool_size = 5 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] database.max_retries = 10 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] database.mysql_wsrep_sync_wait = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] database.pool_timeout = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] database.retry_interval = 10 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] database.slave_connection = **** {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] database.sqlite_synchronous = True {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] database.synchronous_reader = True {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] database.use_db_reconnect = False {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] profiler.connection_string = messaging:// {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] profiler.enabled = False {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] profiler.es_doc_type = notification {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] profiler.es_scroll_size = 10000 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] profiler.es_scroll_time = 2m {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] profiler.filter_error_trace = False {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] profiler.hmac_keys = **** {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] profiler.sentinel_service_name = mymaster {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] profiler.socket_timeout = 0.1 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] profiler.trace_requests = False {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] profiler.trace_sqlalchemy = False {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] profiler_jaeger.process_tags = {} {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] profiler_jaeger.service_name_prefix = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] profiler_otlp.service_name_prefix = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] oslo_policy.enforce_new_defaults = True {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] oslo_policy.enforce_scope = False {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] oslo_policy.policy_default_rule = default {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] oslo_policy.policy_file = policy.yaml {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] oslo_policy.remote_timeout = 60.0 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] privsep_osbrick.group = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] privsep_osbrick.helper_command = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] privsep_osbrick.user = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] cinder_sys_admin.group = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] cinder_sys_admin.helper_command = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] cinder_sys_admin.user = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] service_user.auth_section = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] service_user.auth_type = password {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] service_user.cafile = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] service_user.certfile = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] service_user.collect_timing = False {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] service_user.insecure = False {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] service_user.keyfile = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] service_user.send_service_user_token = True {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] service_user.split_loggers = False {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] service_user.timeout = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] glance.auth_section = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] glance.auth_type = password {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] glance.certfile = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] glance.collect_timing = False {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] glance.insecure = False {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] glance.keyfile = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] glance.region_name = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] glance.split_loggers = False {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] glance.timeout = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] backend_defaults.backend_availability_zone = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] backend_defaults.chap_password = **** {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] backend_defaults.chap_username = {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] backend_defaults.disk_geometry = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] backend_defaults.driver_client_cert = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] backend_defaults.driver_client_cert_key = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] backend_defaults.driver_data_namespace = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] backend_defaults.driver_use_ssl = False {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] backend_defaults.enable_unsupported_driver = False {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] backend_defaults.extra_capabilities = {} {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] backend_defaults.filter_function = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] backend_defaults.goodness_function = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] backend_defaults.iscsi_target_flags = {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] backend_defaults.iscsi_write_cache = on {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] backend_defaults.iser_helper = tgtadm {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] backend_defaults.iser_ip_address = 192.168.122.81 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] backend_defaults.iser_port = 3260 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] backend_defaults.lvm_mirrors = 0 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] backend_defaults.lvm_share_target = False {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] backend_defaults.lvm_type = auto {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] backend_defaults.num_shell_tries = 3 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] backend_defaults.nvmet_port_id = 1 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] backend_defaults.replication_device = **** {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] backend_defaults.report_discard_supported = False {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] backend_defaults.reserved_percentage = 0 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] backend_defaults.scst_target_driver = iscsi {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] backend_defaults.scst_target_iqn_name = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] backend_defaults.storage_protocol = iSCSI {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] backend_defaults.target_helper = tgtadm {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] backend_defaults.target_ip_address = 192.168.122.81 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] backend_defaults.target_port = 3260 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] backend_defaults.target_protocol = iscsi {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] backend_defaults.trace_flags = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] backend_defaults.unique_fqdn_network = True {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] backend_defaults.use_chap_auth = False {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] backend_defaults.volume_backend_name = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] backend_defaults.volume_clear = zero {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] backend_defaults.volume_clear_ionice = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] backend_defaults.volume_clear_size = 0 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] backend_defaults.volume_group = cinder-volumes {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] oslo_reports.file_event_handler = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] oslo_reports.log_dir = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] lvmdriver-1.backend_availability_zone = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] lvmdriver-1.backend_host = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] lvmdriver-1.chap_password = **** {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] lvmdriver-1.chap_username = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] lvmdriver-1.chiscsi_conf = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] lvmdriver-1.disk_geometry = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] lvmdriver-1.driver_client_cert = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] lvmdriver-1.driver_data_namespace = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] lvmdriver-1.driver_use_ssl = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] lvmdriver-1.extra_capabilities = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] lvmdriver-1.filter_function = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] lvmdriver-1.goodness_function = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] lvmdriver-1.iser_helper = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] lvmdriver-1.iser_ip_address = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] lvmdriver-1.iser_port = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] lvmdriver-1.iser_target_prefix = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] lvmdriver-1.lvm_conf_file = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] lvmdriver-1.lvm_mirrors = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] lvmdriver-1.lvm_share_target = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] lvmdriver-1.lvm_type = auto {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] lvmdriver-1.num_shell_tries = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] lvmdriver-1.nvmet_port_id = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] lvmdriver-1.replication_device = **** {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] lvmdriver-1.report_discard_supported = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] lvmdriver-1.reserved_percentage = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] lvmdriver-1.scst_target_driver = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] lvmdriver-1.storage_protocol = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] lvmdriver-1.target_helper = lioadm {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] lvmdriver-1.target_ip_address = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] lvmdriver-1.target_port = 3260 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] lvmdriver-1.target_protocol = iscsi {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] lvmdriver-1.trace_flags = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] lvmdriver-1.use_chap_auth = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] lvmdriver-1.volume_clear = zero {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] lvmdriver-1.volume_clear_size = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] lvmdriver-1.volumes_dir = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] oslo_messaging_rabbit.ssl = False {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] oslo_messaging_rabbit.ssl_version = {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] oslo_messaging_notifications.driver = [] {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] oslo_messaging_notifications.retry = -1 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] oslo_messaging_notifications.transport_url = **** {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] key_manager.fixed_key = **** {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] barbican.barbican_api_version = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] barbican.barbican_endpoint = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] barbican.barbican_endpoint_type = public {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] barbican.barbican_region_name = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] barbican.cafile = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] barbican.certfile = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] barbican.collect_timing = False {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] barbican.insecure = False {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] barbican.keyfile = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] barbican.number_of_retries = 60 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] barbican.retry_delay = 1 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] barbican.send_service_user_token = False {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] barbican.split_loggers = False {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] barbican.timeout = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] barbican.verify_ssl = True {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] barbican.verify_ssl_path = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] barbican_service_user.auth_section = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] barbican_service_user.auth_type = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] barbican_service_user.cafile = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] barbican_service_user.certfile = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] barbican_service_user.collect_timing = False {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] barbican_service_user.insecure = False {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] barbican_service_user.keyfile = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] barbican_service_user.split_loggers = False {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] barbican_service_user.timeout = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] vault.approle_role_id = **** {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] vault.approle_secret_id = **** {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] vault.kv_mountpoint = secret {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] vault.kv_path = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] vault.kv_version = 2 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] vault.namespace = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] vault.root_token_id = **** {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] vault.ssl_ca_crt_file = None {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] vault.timeout = 60.0 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] vault.use_ssl = False {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:41:46 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] ******************************************************************************** {{(pid=76153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 10 15:41:46 devstack sudo[76326]: pam_unix(sudo:session): session closed for user root Jul 10 15:41:46 devstack cinder-volume[76322]: DEBUG oslo_concurrency.processutils [None req-7c313ab3-b376-46f8-957f-5f63d30c4289 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.743s {{(pid=76322) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:41:46 devstack cinder-volume[76322]: DEBUG oslo_concurrency.processutils [None req-7c313ab3-b376-46f8-957f-5f63d30c4289 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76322) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:41:46 devstack sudo[76349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 15:41:46 devstack sudo[76349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:41:47 devstack sudo[76349]: pam_unix(sudo:session): session closed for user root Jul 10 15:41:47 devstack cinder-volume[76322]: DEBUG oslo_concurrency.processutils [None req-7c313ab3-b376-46f8-957f-5f63d30c4289 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.680s {{(pid=76322) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:41:47 devstack cinder-volume[76322]: DEBUG oslo_concurrency.processutils [None req-7c313ab3-b376-46f8-957f-5f63d30c4289 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76322) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 15:41:47 devstack cinder-volume[76322]: INFO cinder.brick.local_dev.lvm [None req-7c313ab3-b376-46f8-957f-5f63d30c4289 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 10 15:41:47 devstack cinder-volume[76322]: DEBUG oslo_concurrency.processutils [None req-7c313ab3-b376-46f8-957f-5f63d30c4289 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76322) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:41:47 devstack cinder-volume[76322]: DEBUG oslo_concurrency.processutils [None req-7c313ab3-b376-46f8-957f-5f63d30c4289 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=76322) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:41:47 devstack cinder-volume[76322]: DEBUG oslo_concurrency.processutils [None req-7c313ab3-b376-46f8-957f-5f63d30c4289 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76322) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:41:47 devstack sudo[76603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 15:41:47 devstack sudo[76603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:41:48 devstack sudo[76603]: pam_unix(sudo:session): session closed for user root Jul 10 15:41:48 devstack cinder-volume[76322]: DEBUG oslo_concurrency.processutils [None req-7c313ab3-b376-46f8-957f-5f63d30c4289 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.653s {{(pid=76322) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:41:48 devstack cinder-volume[76322]: DEBUG cinder.brick.local_dev.lvm [None req-7c313ab3-b376-46f8-957f-5f63d30c4289 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76322) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jul 10 15:41:48 devstack cinder-volume[76322]: DEBUG oslo_concurrency.processutils [None req-7c313ab3-b376-46f8-957f-5f63d30c4289 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76322) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:41:48 devstack sudo[76811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 15:41:48 devstack sudo[76811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:41:49 devstack sudo[76811]: pam_unix(sudo:session): session closed for user root Jul 10 15:41:49 devstack cinder-volume[76322]: DEBUG oslo_concurrency.processutils [None req-7c313ab3-b376-46f8-957f-5f63d30c4289 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.563s {{(pid=76322) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:41:49 devstack cinder-volume[76322]: DEBUG oslo_concurrency.processutils [None req-7c313ab3-b376-46f8-957f-5f63d30c4289 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76322) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:41:49 devstack cinder-volume[76322]: DEBUG oslo_concurrency.processutils [None req-7c313ab3-b376-46f8-957f-5f63d30c4289 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.036s {{(pid=76322) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:41:49 devstack cinder-volume[76322]: DEBUG oslo_concurrency.processutils [None req-7c313ab3-b376-46f8-957f-5f63d30c4289 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76322) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:41:49 devstack sudo[77069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 15:41:49 devstack sudo[77069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:41:50 devstack sudo[77069]: pam_unix(sudo:session): session closed for user root Jul 10 15:41:50 devstack cinder-volume[76322]: DEBUG oslo_concurrency.processutils [None req-7c313ab3-b376-46f8-957f-5f63d30c4289 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.682s {{(pid=76322) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:41:50 devstack cinder-volume[76322]: DEBUG oslo_concurrency.processutils [None req-7c313ab3-b376-46f8-957f-5f63d30c4289 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76322) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:41:50 devstack cinder-volume[76322]: DEBUG oslo_concurrency.processutils [None req-7c313ab3-b376-46f8-957f-5f63d30c4289 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=76322) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:41:50 devstack cinder-volume[76322]: DEBUG oslo_concurrency.processutils [None req-7c313ab3-b376-46f8-957f-5f63d30c4289 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76322) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:41:50 devstack sudo[77106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 10 15:41:50 devstack sudo[77106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:41:51 devstack sudo[77106]: pam_unix(sudo:session): session closed for user root Jul 10 15:41:51 devstack cinder-volume[76322]: DEBUG oslo_concurrency.processutils [None req-7c313ab3-b376-46f8-957f-5f63d30c4289 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.715s {{(pid=76322) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:41:51 devstack cinder-volume[76322]: DEBUG oslo_concurrency.processutils [None req-7c313ab3-b376-46f8-957f-5f63d30c4289 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76322) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:41:51 devstack sudo[77110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 15:41:51 devstack sudo[77110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:41:52 devstack sudo[77110]: pam_unix(sudo:session): session closed for user root Jul 10 15:41:52 devstack cinder-volume[76322]: DEBUG oslo_concurrency.processutils [None req-7c313ab3-b376-46f8-957f-5f63d30c4289 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.826s {{(pid=76322) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:41:52 devstack cinder-volume[76322]: DEBUG oslo_concurrency.processutils [None req-7c313ab3-b376-46f8-957f-5f63d30c4289 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76322) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:41:52 devstack sudo[77122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 15:41:52 devstack sudo[77122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:41:52 devstack sudo[77122]: pam_unix(sudo:session): session closed for user root Jul 10 15:41:52 devstack cinder-volume[76322]: DEBUG oslo_concurrency.processutils [None req-7c313ab3-b376-46f8-957f-5f63d30c4289 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.761s {{(pid=76322) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:41:52 devstack cinder-volume[76322]: DEBUG oslo_concurrency.processutils [None req-7c313ab3-b376-46f8-957f-5f63d30c4289 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76322) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:41:52 devstack sudo[77127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 15:41:52 devstack sudo[77127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:41:53 devstack sudo[77127]: pam_unix(sudo:session): session closed for user root Jul 10 15:41:53 devstack cinder-volume[76322]: DEBUG oslo_concurrency.processutils [None req-7c313ab3-b376-46f8-957f-5f63d30c4289 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.800s {{(pid=76322) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:41:53 devstack cinder-volume[76322]: DEBUG oslo_concurrency.processutils [None req-7c313ab3-b376-46f8-957f-5f63d30c4289 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76322) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:41:53 devstack sudo[77137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 15:41:53 devstack sudo[77137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:41:54 devstack sudo[77137]: pam_unix(sudo:session): session closed for user root Jul 10 15:41:54 devstack cinder-volume[76322]: DEBUG oslo_concurrency.processutils [None req-7c313ab3-b376-46f8-957f-5f63d30c4289 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.669s {{(pid=76322) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:41:54 devstack cinder-volume[76322]: DEBUG oslo_concurrency.processutils [None req-7c313ab3-b376-46f8-957f-5f63d30c4289 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76322) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:41:54 devstack cinder-volume[76322]: DEBUG oslo_concurrency.processutils [None req-7c313ab3-b376-46f8-957f-5f63d30c4289 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=76322) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:41:54 devstack cinder-volume[76322]: DEBUG oslo_concurrency.processutils [None req-7c313ab3-b376-46f8-957f-5f63d30c4289 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76322) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:41:54 devstack sudo[77141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 15:41:54 devstack sudo[77141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:41:55 devstack sudo[77141]: pam_unix(sudo:session): session closed for user root Jul 10 15:41:55 devstack cinder-volume[76322]: DEBUG oslo_concurrency.processutils [None req-7c313ab3-b376-46f8-957f-5f63d30c4289 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.685s {{(pid=76322) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:41:55 devstack cinder-volume[76322]: INFO cinder.volume.drivers.lvm [None req-7c313ab3-b376-46f8-957f-5f63d30c4289 None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 10 15:41:55 devstack cinder-volume[76322]: DEBUG oslo_concurrency.processutils [None req-7c313ab3-b376-46f8-957f-5f63d30c4289 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76322) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:41:55 devstack cinder-volume[76322]: DEBUG oslo_concurrency.processutils [None req-7c313ab3-b376-46f8-957f-5f63d30c4289 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76322) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:41:55 devstack cinder-volume[76322]: DEBUG oslo_concurrency.processutils [None req-7c313ab3-b376-46f8-957f-5f63d30c4289 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76322) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:41:55 devstack sudo[77149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 15:41:55 devstack sudo[77149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:41:55 devstack sudo[77149]: pam_unix(sudo:session): session closed for user root Jul 10 15:41:55 devstack cinder-volume[76322]: DEBUG oslo_concurrency.processutils [None req-7c313ab3-b376-46f8-957f-5f63d30c4289 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.819s {{(pid=76322) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:41:55 devstack cinder-volume[76322]: DEBUG cinder.volume.drivers.lvm [None req-7c313ab3-b376-46f8-957f-5f63d30c4289 None None] Updating volume stats {{(pid=76322) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 10 15:41:55 devstack cinder-volume[76322]: DEBUG oslo_concurrency.processutils [None req-7c313ab3-b376-46f8-957f-5f63d30c4289 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76322) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:41:55 devstack sudo[77267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 15:41:55 devstack sudo[77267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:41:56 devstack cinder-volume[76153]: DEBUG dbcounter [-] [76153] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76153) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 15:41:56 devstack sudo[77267]: pam_unix(sudo:session): session closed for user root Jul 10 15:41:56 devstack cinder-volume[76322]: DEBUG oslo_concurrency.processutils [None req-7c313ab3-b376-46f8-957f-5f63d30c4289 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.638s {{(pid=76322) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:41:56 devstack cinder-volume[76322]: DEBUG oslo_concurrency.processutils [None req-7c313ab3-b376-46f8-957f-5f63d30c4289 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76322) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:41:56 devstack sudo[77408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 15:41:56 devstack sudo[77408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:41:57 devstack sudo[77408]: pam_unix(sudo:session): session closed for user root Jul 10 15:41:57 devstack cinder-volume[76322]: DEBUG oslo_concurrency.processutils [None req-7c313ab3-b376-46f8-957f-5f63d30c4289 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.670s {{(pid=76322) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:41:57 devstack cinder-volume[76322]: DEBUG oslo_concurrency.processutils [None req-7c313ab3-b376-46f8-957f-5f63d30c4289 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76322) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:41:57 devstack sudo[77411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 15:41:57 devstack sudo[77411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:41:57 devstack sudo[77411]: pam_unix(sudo:session): session closed for user root Jul 10 15:41:57 devstack cinder-volume[76322]: DEBUG oslo_concurrency.processutils [None req-7c313ab3-b376-46f8-957f-5f63d30c4289 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.639s {{(pid=76322) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:41:57 devstack cinder-volume[76322]: DEBUG oslo_concurrency.processutils [None req-7c313ab3-b376-46f8-957f-5f63d30c4289 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76322) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:41:57 devstack sudo[77415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 15:41:57 devstack sudo[77415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:41:58 devstack sudo[77415]: pam_unix(sudo:session): session closed for user root Jul 10 15:41:58 devstack cinder-volume[76322]: DEBUG oslo_concurrency.processutils [None req-7c313ab3-b376-46f8-957f-5f63d30c4289 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.650s {{(pid=76322) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:41:58 devstack cinder-volume[76322]: INFO cinder.volume.driver [None req-7c313ab3-b376-46f8-957f-5f63d30c4289 None None] Driver hasn't implemented _init_vendor_properties() Jul 10 15:41:58 devstack cinder-volume[76322]: DEBUG cinder.volume.driver [None req-7c313ab3-b376-46f8-957f-5f63d30c4289 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76322) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 10 15:41:58 devstack cinder-volume[76322]: DEBUG oslo_db.sqlalchemy.engines [None req-7c313ab3-b376-46f8-957f-5f63d30c4289 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76322) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 15:41:58 devstack cinder-volume[76322]: DEBUG dbcounter [-] [76322] Writer thread running {{(pid=76322) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 10 15:41:58 devstack cinder-volume[76322]: DEBUG cinder.db.api [None req-7c313ab3-b376-46f8-957f-5f63d30c4289 None None] Building query based on filter {{(pid=76322) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 10 15:41:58 devstack cinder-volume[76322]: DEBUG cinder.image.image_utils [None req-7c313ab3-b376-46f8-957f-5f63d30c4289 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76322) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 10 15:41:58 devstack cinder-volume[76322]: INFO cinder.keymgr.migration [None req-0ece98e7-9535-4df7-a52d-f8780779b787 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 10 15:41:58 devstack cinder-volume[76322]: DEBUG cinder.volume.drivers.lvm [None req-7c313ab3-b376-46f8-957f-5f63d30c4289 None None] Updating volume stats {{(pid=76322) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 10 15:41:58 devstack cinder-volume[76322]: DEBUG oslo_concurrency.processutils [None req-7c313ab3-b376-46f8-957f-5f63d30c4289 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76322) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:41:58 devstack sudo[77420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 15:41:58 devstack sudo[77420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:41:59 devstack sudo[77420]: pam_unix(sudo:session): session closed for user root Jul 10 15:41:59 devstack cinder-volume[76322]: DEBUG oslo_concurrency.processutils [None req-7c313ab3-b376-46f8-957f-5f63d30c4289 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.635s {{(pid=76322) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:41:59 devstack cinder-volume[76322]: DEBUG oslo_concurrency.processutils [None req-7c313ab3-b376-46f8-957f-5f63d30c4289 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76322) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:41:59 devstack sudo[77426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 15:41:59 devstack sudo[77426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:41:59 devstack sudo[77426]: pam_unix(sudo:session): session closed for user root Jul 10 15:41:59 devstack cinder-volume[76322]: DEBUG oslo_concurrency.processutils [None req-7c313ab3-b376-46f8-957f-5f63d30c4289 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.632s {{(pid=76322) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:41:59 devstack cinder-volume[76322]: DEBUG oslo_concurrency.processutils [None req-7c313ab3-b376-46f8-957f-5f63d30c4289 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76322) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:41:59 devstack sudo[77429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 15:41:59 devstack sudo[77429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:42:00 devstack sudo[77429]: pam_unix(sudo:session): session closed for user root Jul 10 15:42:00 devstack cinder-volume[76322]: DEBUG oslo_concurrency.processutils [None req-7c313ab3-b376-46f8-957f-5f63d30c4289 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.645s {{(pid=76322) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:42:00 devstack cinder-volume[76322]: DEBUG oslo_concurrency.processutils [None req-7c313ab3-b376-46f8-957f-5f63d30c4289 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76322) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:42:00 devstack sudo[77432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 15:42:00 devstack sudo[77432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:42:01 devstack sudo[77432]: pam_unix(sudo:session): session closed for user root Jul 10 15:42:01 devstack cinder-volume[76322]: DEBUG oslo_concurrency.processutils [None req-7c313ab3-b376-46f8-957f-5f63d30c4289 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.713s {{(pid=76322) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:42:01 devstack cinder-volume[76322]: DEBUG cinder.manager [None req-7c313ab3-b376-46f8-957f-5f63d30c4289 None None] Notifying Schedulers of capabilities ... {{(pid=76322) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 15:42:01 devstack cinder-volume[76322]: INFO cinder.volume.manager [None req-7c313ab3-b376-46f8-957f-5f63d30c4289 None None] Driver initialization completed successfully. Jul 10 15:42:01 devstack cinder-volume[76322]: INFO cinder.manager [None req-7c313ab3-b376-46f8-957f-5f63d30c4289 None None] Initiating service 2 cleanup Jul 10 15:42:01 devstack cinder-volume[76322]: INFO cinder.manager [None req-7c313ab3-b376-46f8-957f-5f63d30c4289 None None] Service 2 cleanup completed. Jul 10 15:42:01 devstack cinder-volume[76322]: DEBUG cinder.service [None req-7c313ab3-b376-46f8-957f-5f63d30c4289 None None] Creating RPC server for service cinder-volume {{(pid=76322) start /opt/stack/cinder/cinder/service.py:231}} Jul 10 15:42:01 devstack cinder-volume[76322]: DEBUG cinder.service [None req-7c313ab3-b376-46f8-957f-5f63d30c4289 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76322) start /opt/stack/cinder/cinder/service.py:237}} Jul 10 15:42:01 devstack cinder-volume[76322]: INFO cinder.volume.manager [None req-7c313ab3-b376-46f8-957f-5f63d30c4289 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 10 15:42:01 devstack cinder-volume[76322]: DEBUG cinder.volume.drivers.lvm [None req-7c313ab3-b376-46f8-957f-5f63d30c4289 None None] Updating volume stats {{(pid=76322) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 10 15:42:01 devstack cinder-volume[76322]: DEBUG oslo_concurrency.processutils [None req-7c313ab3-b376-46f8-957f-5f63d30c4289 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76322) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:42:01 devstack sudo[77436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 15:42:01 devstack sudo[77436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:42:02 devstack sudo[77436]: pam_unix(sudo:session): session closed for user root Jul 10 15:42:02 devstack cinder-volume[76322]: DEBUG oslo_concurrency.processutils [None req-7c313ab3-b376-46f8-957f-5f63d30c4289 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.670s {{(pid=76322) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:42:02 devstack cinder-volume[76322]: DEBUG oslo_concurrency.processutils [None req-7c313ab3-b376-46f8-957f-5f63d30c4289 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76322) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:42:02 devstack sudo[77441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 15:42:02 devstack sudo[77441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:42:02 devstack sudo[77441]: pam_unix(sudo:session): session closed for user root Jul 10 15:42:02 devstack cinder-volume[76322]: DEBUG oslo_concurrency.processutils [None req-7c313ab3-b376-46f8-957f-5f63d30c4289 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.650s {{(pid=76322) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:42:02 devstack cinder-volume[76322]: DEBUG oslo_concurrency.processutils [None req-7c313ab3-b376-46f8-957f-5f63d30c4289 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76322) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:42:02 devstack sudo[77447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 15:42:02 devstack sudo[77447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:42:03 devstack sudo[77447]: pam_unix(sudo:session): session closed for user root Jul 10 15:42:03 devstack cinder-volume[76322]: DEBUG oslo_concurrency.processutils [None req-7c313ab3-b376-46f8-957f-5f63d30c4289 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.625s {{(pid=76322) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:42:03 devstack cinder-volume[76322]: DEBUG oslo_concurrency.processutils [None req-7c313ab3-b376-46f8-957f-5f63d30c4289 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76322) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:42:03 devstack sudo[77504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 15:42:03 devstack sudo[77504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:42:04 devstack sudo[77504]: pam_unix(sudo:session): session closed for user root Jul 10 15:42:04 devstack cinder-volume[76322]: DEBUG oslo_concurrency.processutils [None req-7c313ab3-b376-46f8-957f-5f63d30c4289 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.642s {{(pid=76322) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:42:04 devstack cinder-volume[76322]: INFO cinder.volume.manager [None req-7c313ab3-b376-46f8-957f-5f63d30c4289 None None] Driver post RPC initialization completed successfully. Jul 10 15:42:14 devstack cinder-volume[76322]: DEBUG dbcounter [-] [76322] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76322) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 15:42:14 devstack cinder-volume[76322]: DEBUG dbcounter [-] [76322] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=76322) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 15:42:28 devstack cinder-volume[76322]: DEBUG oslo_service.periodic_task [None req-2fd39825-901d-4fa5-b719-07718f7eea49 None None] Running periodic task VolumeManager._thread_info {{(pid=76322) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 15:42:28 devstack cinder-volume[76322]: DEBUG cinder.volume.manager [None req-2fd39825-901d-4fa5-b719-07718f7eea49 None None] thread count: 6 {{(pid=76322) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 15:42:28 devstack cinder-volume[76322]: DEBUG cinder.volume.manager [None req-2fd39825-901d-4fa5-b719-07718f7eea49 None None] thread info: [<_MainThread(MainThread, started 140009128685696)>, , , , , ] {{(pid=76322) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 15:43:28 devstack cinder-volume[76322]: DEBUG oslo_service.periodic_task [None req-2fd39825-901d-4fa5-b719-07718f7eea49 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76322) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 15:43:28 devstack cinder-volume[76322]: DEBUG cinder.volume.drivers.lvm [None req-2fd39825-901d-4fa5-b719-07718f7eea49 None None] Updating volume stats {{(pid=76322) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 10 15:43:28 devstack cinder-volume[76322]: DEBUG oslo_concurrency.processutils [None req-2fd39825-901d-4fa5-b719-07718f7eea49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76322) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:43:28 devstack sudo[79860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 15:43:28 devstack sudo[79860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:43:28 devstack sudo[79860]: pam_unix(sudo:session): session closed for user root Jul 10 15:43:28 devstack cinder-volume[76322]: DEBUG oslo_concurrency.processutils [None req-2fd39825-901d-4fa5-b719-07718f7eea49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.661s {{(pid=76322) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:43:28 devstack cinder-volume[76322]: DEBUG oslo_concurrency.processutils [None req-2fd39825-901d-4fa5-b719-07718f7eea49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76322) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:43:28 devstack sudo[79866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 15:43:28 devstack sudo[79866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:43:29 devstack sudo[79866]: pam_unix(sudo:session): session closed for user root Jul 10 15:43:29 devstack cinder-volume[76322]: DEBUG oslo_concurrency.processutils [None req-2fd39825-901d-4fa5-b719-07718f7eea49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.648s {{(pid=76322) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:43:29 devstack cinder-volume[76322]: DEBUG oslo_concurrency.processutils [None req-2fd39825-901d-4fa5-b719-07718f7eea49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76322) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:43:29 devstack sudo[79869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 15:43:29 devstack sudo[79869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:43:30 devstack sudo[79869]: pam_unix(sudo:session): session closed for user root Jul 10 15:43:30 devstack cinder-volume[76322]: DEBUG oslo_concurrency.processutils [None req-2fd39825-901d-4fa5-b719-07718f7eea49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.651s {{(pid=76322) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:43:30 devstack cinder-volume[76322]: DEBUG oslo_concurrency.processutils [None req-2fd39825-901d-4fa5-b719-07718f7eea49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76322) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:43:30 devstack sudo[79872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 15:43:30 devstack sudo[79872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:43:30 devstack sudo[79872]: pam_unix(sudo:session): session closed for user root Jul 10 15:43:30 devstack cinder-volume[76322]: DEBUG oslo_concurrency.processutils [None req-2fd39825-901d-4fa5-b719-07718f7eea49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.645s {{(pid=76322) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:43:30 devstack cinder-volume[76322]: DEBUG cinder.manager [None req-2fd39825-901d-4fa5-b719-07718f7eea49 None None] Notifying Schedulers of capabilities ... {{(pid=76322) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 15:43:30 devstack cinder-volume[76322]: DEBUG oslo_service.periodic_task [None req-2fd39825-901d-4fa5-b719-07718f7eea49 None None] Running periodic task VolumeManager._thread_info {{(pid=76322) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 15:43:30 devstack cinder-volume[76322]: DEBUG cinder.volume.manager [None req-2fd39825-901d-4fa5-b719-07718f7eea49 None None] thread count: 6 {{(pid=76322) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 15:43:30 devstack cinder-volume[76322]: DEBUG cinder.volume.manager [None req-2fd39825-901d-4fa5-b719-07718f7eea49 None None] thread info: [<_MainThread(MainThread, started 140009128685696)>, , , , , ] {{(pid=76322) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 15:44:14 devstack cinder-volume[76322]: DEBUG dbcounter [-] [76322] Writing DB stats cinder:SELECT=1 {{(pid=76322) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 15:44:14 devstack cinder-volume[76322]: DEBUG dbcounter [-] [76322] Writing DB stats cinder:UPDATE=1 {{(pid=76322) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 15:44:28 devstack cinder-volume[76322]: DEBUG oslo_service.periodic_task [None req-2fd39825-901d-4fa5-b719-07718f7eea49 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76322) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 15:44:28 devstack cinder-volume[76322]: DEBUG cinder.volume.drivers.lvm [None req-2fd39825-901d-4fa5-b719-07718f7eea49 None None] Updating volume stats {{(pid=76322) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 10 15:44:28 devstack cinder-volume[76322]: DEBUG oslo_concurrency.processutils [None req-2fd39825-901d-4fa5-b719-07718f7eea49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76322) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:44:28 devstack sudo[83522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 15:44:28 devstack sudo[83522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:44:28 devstack sudo[83522]: pam_unix(sudo:session): session closed for user root Jul 10 15:44:28 devstack cinder-volume[76322]: DEBUG oslo_concurrency.processutils [None req-2fd39825-901d-4fa5-b719-07718f7eea49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.646s {{(pid=76322) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:44:28 devstack cinder-volume[76322]: DEBUG oslo_concurrency.processutils [None req-2fd39825-901d-4fa5-b719-07718f7eea49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76322) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:44:28 devstack sudo[83583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 15:44:28 devstack sudo[83583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:44:29 devstack sudo[83583]: pam_unix(sudo:session): session closed for user root Jul 10 15:44:29 devstack cinder-volume[76322]: DEBUG oslo_concurrency.processutils [None req-2fd39825-901d-4fa5-b719-07718f7eea49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.649s {{(pid=76322) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:44:29 devstack cinder-volume[76322]: DEBUG oslo_concurrency.processutils [None req-2fd39825-901d-4fa5-b719-07718f7eea49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76322) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:44:29 devstack sudo[83592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 15:44:29 devstack sudo[83592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:44:30 devstack sudo[83592]: pam_unix(sudo:session): session closed for user root Jul 10 15:44:30 devstack cinder-volume[76322]: DEBUG oslo_concurrency.processutils [None req-2fd39825-901d-4fa5-b719-07718f7eea49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.638s {{(pid=76322) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:44:30 devstack cinder-volume[76322]: DEBUG oslo_concurrency.processutils [None req-2fd39825-901d-4fa5-b719-07718f7eea49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76322) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:44:30 devstack sudo[83595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 15:44:30 devstack sudo[83595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:44:30 devstack sudo[83595]: pam_unix(sudo:session): session closed for user root Jul 10 15:44:30 devstack cinder-volume[76322]: DEBUG oslo_concurrency.processutils [None req-2fd39825-901d-4fa5-b719-07718f7eea49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.659s {{(pid=76322) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:44:30 devstack cinder-volume[76322]: DEBUG cinder.manager [None req-2fd39825-901d-4fa5-b719-07718f7eea49 None None] Notifying Schedulers of capabilities ... {{(pid=76322) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 15:44:30 devstack cinder-volume[76322]: DEBUG oslo_service.periodic_task [None req-2fd39825-901d-4fa5-b719-07718f7eea49 None None] Running periodic task VolumeManager._thread_info {{(pid=76322) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 15:44:30 devstack cinder-volume[76322]: DEBUG cinder.volume.manager [None req-2fd39825-901d-4fa5-b719-07718f7eea49 None None] thread count: 6 {{(pid=76322) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 15:44:30 devstack cinder-volume[76322]: DEBUG cinder.volume.manager [None req-2fd39825-901d-4fa5-b719-07718f7eea49 None None] thread info: [<_MainThread(MainThread, started 140009128685696)>, , , , , ] {{(pid=76322) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 15:45:28 devstack cinder-volume[76322]: DEBUG oslo_service.periodic_task [None req-2fd39825-901d-4fa5-b719-07718f7eea49 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76322) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 15:45:28 devstack cinder-volume[76322]: DEBUG cinder.volume.drivers.lvm [None req-2fd39825-901d-4fa5-b719-07718f7eea49 None None] Updating volume stats {{(pid=76322) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 10 15:45:28 devstack cinder-volume[76322]: DEBUG oslo_concurrency.processutils [None req-2fd39825-901d-4fa5-b719-07718f7eea49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76322) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:45:28 devstack sudo[85171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 15:45:28 devstack sudo[85171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:45:28 devstack sudo[85171]: pam_unix(sudo:session): session closed for user root Jul 10 15:45:28 devstack cinder-volume[76322]: DEBUG oslo_concurrency.processutils [None req-2fd39825-901d-4fa5-b719-07718f7eea49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.619s {{(pid=76322) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:45:28 devstack cinder-volume[76322]: DEBUG oslo_concurrency.processutils [None req-2fd39825-901d-4fa5-b719-07718f7eea49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76322) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:45:28 devstack sudo[85193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 15:45:28 devstack sudo[85193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:45:29 devstack sudo[85193]: pam_unix(sudo:session): session closed for user root Jul 10 15:45:29 devstack cinder-volume[76322]: DEBUG oslo_concurrency.processutils [None req-2fd39825-901d-4fa5-b719-07718f7eea49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.616s {{(pid=76322) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:45:29 devstack cinder-volume[76322]: DEBUG oslo_concurrency.processutils [None req-2fd39825-901d-4fa5-b719-07718f7eea49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76322) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:45:29 devstack sudo[85220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 15:45:29 devstack sudo[85220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:45:29 devstack sudo[85220]: pam_unix(sudo:session): session closed for user root Jul 10 15:45:29 devstack cinder-volume[76322]: DEBUG oslo_concurrency.processutils [None req-2fd39825-901d-4fa5-b719-07718f7eea49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.635s {{(pid=76322) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:45:29 devstack cinder-volume[76322]: DEBUG oslo_concurrency.processutils [None req-2fd39825-901d-4fa5-b719-07718f7eea49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76322) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:45:29 devstack sudo[85226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 15:45:29 devstack sudo[85226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:45:30 devstack sudo[85226]: pam_unix(sudo:session): session closed for user root Jul 10 15:45:30 devstack cinder-volume[76322]: DEBUG oslo_concurrency.processutils [None req-2fd39825-901d-4fa5-b719-07718f7eea49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.628s {{(pid=76322) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:45:30 devstack cinder-volume[76322]: DEBUG cinder.manager [None req-2fd39825-901d-4fa5-b719-07718f7eea49 None None] Notifying Schedulers of capabilities ... {{(pid=76322) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 15:45:30 devstack cinder-volume[76322]: DEBUG oslo_service.periodic_task [None req-2fd39825-901d-4fa5-b719-07718f7eea49 None None] Running periodic task VolumeManager._thread_info {{(pid=76322) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 15:45:30 devstack cinder-volume[76322]: DEBUG cinder.volume.manager [None req-2fd39825-901d-4fa5-b719-07718f7eea49 None None] thread count: 6 {{(pid=76322) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 15:45:30 devstack cinder-volume[76322]: DEBUG cinder.volume.manager [None req-2fd39825-901d-4fa5-b719-07718f7eea49 None None] thread info: [<_MainThread(MainThread, started 140009128685696)>, , , , , ] {{(pid=76322) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 15:46:14 devstack cinder-volume[76322]: DEBUG dbcounter [-] [76322] Writing DB stats cinder:SELECT=1 {{(pid=76322) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 15:46:14 devstack cinder-volume[76322]: DEBUG dbcounter [-] [76322] Writing DB stats cinder:UPDATE=1 {{(pid=76322) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 15:46:26 devstack cinder-volume[76153]: INFO oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] Caught SIGTERM, stopping children Jul 10 15:46:26 devstack cinder-volume[76153]: DEBUG oslo_concurrency.lockutils [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] Acquiring lock "singleton_lock" {{(pid=76153) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 10 15:46:26 devstack cinder-volume[76153]: DEBUG oslo_concurrency.lockutils [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] Acquired lock "singleton_lock" {{(pid=76153) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 10 15:46:26 devstack cinder-volume[76153]: DEBUG oslo_concurrency.lockutils [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] Releasing lock "singleton_lock" {{(pid=76153) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 10 15:46:26 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] Stop services. {{(pid=76153) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 10 15:46:26 devstack cinder-volume[76153]: DEBUG oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] Killing children. {{(pid=76153) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 10 15:46:26 devstack cinder-volume[76153]: INFO oslo_service.backend._eventlet.service [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] Waiting on 1 children to exit Jul 10 15:46:28 devstack cinder-volume[76322]: DEBUG oslo_service.periodic_task [None req-2fd39825-901d-4fa5-b719-07718f7eea49 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76322) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 15:46:28 devstack cinder-volume[76322]: DEBUG cinder.volume.drivers.lvm [None req-2fd39825-901d-4fa5-b719-07718f7eea49 None None] Updating volume stats {{(pid=76322) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 10 15:46:28 devstack cinder-volume[76322]: DEBUG oslo_concurrency.processutils [None req-2fd39825-901d-4fa5-b719-07718f7eea49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76322) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:46:28 devstack sudo[86443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 15:46:28 devstack sudo[86443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:46:28 devstack sudo[86443]: pam_unix(sudo:session): session closed for user root Jul 10 15:46:28 devstack cinder-volume[76322]: DEBUG oslo_concurrency.processutils [None req-2fd39825-901d-4fa5-b719-07718f7eea49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.625s {{(pid=76322) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:46:28 devstack cinder-volume[76322]: DEBUG oslo_concurrency.processutils [None req-2fd39825-901d-4fa5-b719-07718f7eea49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76322) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:46:28 devstack sudo[86447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 15:46:28 devstack sudo[86447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:46:29 devstack sudo[86447]: pam_unix(sudo:session): session closed for user root Jul 10 15:46:29 devstack cinder-volume[76322]: DEBUG oslo_concurrency.processutils [None req-2fd39825-901d-4fa5-b719-07718f7eea49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.645s {{(pid=76322) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:46:29 devstack cinder-volume[76322]: DEBUG oslo_concurrency.processutils [None req-2fd39825-901d-4fa5-b719-07718f7eea49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76322) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:46:29 devstack sudo[86451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 15:46:29 devstack sudo[86451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:46:29 devstack sudo[86451]: pam_unix(sudo:session): session closed for user root Jul 10 15:46:29 devstack cinder-volume[76322]: DEBUG oslo_concurrency.processutils [None req-2fd39825-901d-4fa5-b719-07718f7eea49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.630s {{(pid=76322) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:46:29 devstack cinder-volume[76322]: DEBUG oslo_concurrency.processutils [None req-2fd39825-901d-4fa5-b719-07718f7eea49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76322) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:46:30 devstack sudo[86454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 15:46:30 devstack sudo[86454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:46:30 devstack sudo[86454]: pam_unix(sudo:session): session closed for user root Jul 10 15:46:30 devstack cinder-volume[76322]: DEBUG oslo_concurrency.processutils [None req-2fd39825-901d-4fa5-b719-07718f7eea49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.633s {{(pid=76322) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:46:30 devstack cinder-volume[76322]: DEBUG cinder.manager [None req-2fd39825-901d-4fa5-b719-07718f7eea49 None None] Notifying Schedulers of capabilities ... {{(pid=76322) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 15:46:31 devstack cinder-volume[76322]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Jul 10 15:46:32 devstack cinder-volume[86457]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 10 15:46:32 devstack cinder-volume[86457]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 10 15:46:32 devstack cinder-volume[86457]: we strongly recommend against using it for new projects. Jul 10 15:46:32 devstack cinder-volume[86457]: If you are already using Eventlet, we recommend migrating to a different Jul 10 15:46:32 devstack cinder-volume[86457]: framework. For more detail see Jul 10 15:46:32 devstack cinder-volume[86457]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 10 15:46:32 devstack cinder-volume[86457]: import eventlet # noqa Jul 10 15:46:34 devstack cinder-volume[86457]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86457) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 10 15:46:34 devstack cinder-volume[86457]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86457) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 10 15:46:34 devstack cinder-volume[86457]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86457) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 10 15:46:34 devstack cinder-volume[86457]: INFO dbcounter [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] Registered counter for database cinder Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_db.sqlalchemy.engines [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86457) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG dbcounter [-] [86457] Writer thread running {{(pid=86457) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 10 15:46:35 devstack cinder-volume[86457]: INFO cinder.rpc [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 10 15:46:35 devstack cinder-volume[86457]: INFO cinder.rpc [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_db.sqlalchemy.engines [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86457) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 15:46:35 devstack cinder-volume[86457]: INFO cinder.volume.manager [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] Determined volume DB was empty at startup. Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG cinder.volume.manager [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86457) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 10 15:46:35 devstack cinder-volume[86457]: INFO cinder.volume.manager [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 10 15:46:35 devstack cinder-volume[86457]: WARNING stevedore.named [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 10 15:46:35 devstack cinder-volume[86457]: WARNING castellan.key_manager [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 10 15:46:35 devstack cinder-volume[86457]: WARNING cinder.keymgr.conf_key_mgr [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 10 15:46:35 devstack cinder-volume[86457]: INFO cinder.volume.manager [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_db.sqlalchemy.engines [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86457) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 15:46:35 devstack cinder-volume[86457]: INFO oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] Starting 1 workers Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] Started child 86721 {{(pid=86457) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] Full set of CONF: {{(pid=86457) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] ******************************************************************************** {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] Configuration options gathered from: {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 10 15:46:35 devstack cinder-volume[86721]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] ================================================================================ {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] allow_availability_zone_fallback = False {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] allow_compression_on_image_upload = False {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] allowed_direct_url_schemes = [] {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] api_rate_limit = True {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] auth_strategy = keystone {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] backend_availability_zone = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] backend_host = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] backend_name = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] backend_stats_polling_interval = 60 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] backup_api_class = cinder.backup.api.API {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] backup_name_template = backup-%s {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] backup_use_same_host = False {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] backup_use_temp_snapshot = False {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] chap_password = **** {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] chap_username = {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] cinder_internal_tenant_project_id = 293df3badd6f4d8cacd5ee5e7ea8585f {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] cinder_internal_tenant_user_id = afe66ebb36dd4b90bb08571db9126407 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] cluster = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] compression_format = gzip {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] compute_api_class = cinder.compute.nova.API {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] config_dir = [] {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] config_source = [] {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] control_exchange = openstack {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] debug = True {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] default_availability_zone = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] default_group_type = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] default_volume_type = QuobyteHD {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] disk_geometry = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] driver_client_cert = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] driver_client_cert_key = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] driver_data_namespace = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] driver_ssl_cert_path = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] driver_ssl_cert_verify = False {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] driver_use_ssl = False {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] enable_new_services = True {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] enable_unsupported_driver = False {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] enabled_backends = ['QuobyteHD'] {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] enforce_multipath_for_image_xfer = False {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] filter_function = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] glance_api_insecure = False {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] glance_api_servers = ['http://192.168.122.81/image'] {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] glance_api_ssl_compression = False {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] glance_ca_certificates_file = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] glance_catalog_info = image:glance:publicURL {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] glance_certfile = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] glance_keyfile = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] glance_num_retries = 3 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] glance_request_timeout = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] goodness_function = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] graceful_shutdown_timeout = 5 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] group_api_class = cinder.group.api.API {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] host = devstack {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] image_compress_on_upload = True {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] image_conversion_address_space_limit = 1 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] image_conversion_cpu_limit = 60 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] image_conversion_disable = False {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] image_upload_use_cinder_backend = False {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] image_upload_use_internal_tenant = False {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] image_volume_cache_enabled = False {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] image_volume_cache_max_count = 0 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] image_volume_cache_max_size_gb = 0 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] init_host_max_objects_retrieval = 0 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] instance_format = [instance: %(uuid)s] {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] iscsi_target_flags = {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] iscsi_write_cache = on {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] iser_helper = tgtadm {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] iser_ip_address = 192.168.122.81 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] iser_port = 3260 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] log_color = False {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] log_config_append = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] log_dir = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] log_file = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] log_options = True {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] log_rotate_interval = 1 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] log_rotate_interval_type = days {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] log_rotation_type = none {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] max_age = 0 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-cecf80e7-d11f-4a93-8a9a-4ab16ca90365 None None] Starting volume driver QuobyteDriver (1.1.14) Jul 10 15:46:35 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-cecf80e7-d11f-4a93-8a9a-4ab16ca90365 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86721) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] max_logfile_count = 30 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] max_logfile_size_mb = 200 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] max_over_subscription_ratio = 20.0 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] message_reap_interval = 86400 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] message_ttl = 2592000 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] migration_create_volume_timeout_secs = 300 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] monkey_patch = False {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] monkey_patch_modules = [] {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] my_ip = 192.168.122.81 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] no_snapshot_gb_quota = False {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] num_iser_scan_tries = 3 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] num_shell_tries = 3 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] num_volume_device_scan_tries = 3 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] nvmeof_conn_info_version = 1 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] nvmet_ns_id = 10 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] nvmet_port_id = 1 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] osapi_max_limit = 1000 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] osapi_volume_ext_list = [] {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] osapi_volume_listen = 0.0.0.0 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] osapi_volume_listen_port = 8776 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] osapi_volume_use_ssl = False {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] osapi_volume_workers = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] per_volume_size_limit = -1 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] periodic_fuzzy_delay = 60 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] periodic_interval = 60 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] project_id_regex = [0-9a-f\-]+ {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] public_endpoint = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] publish_errors = False {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] quota_backup_gigabytes = 1000 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] quota_backups = 10 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] quota_gigabytes = 1000 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] quota_groups = 10 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] quota_snapshots = 10 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] quota_volumes = 10 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] rate_limit_burst = 0 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] rate_limit_except_level = CRITICAL {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] rate_limit_interval = 0 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] reinit_driver_count = 3 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] replication_device = **** {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] report_discard_supported = False {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] report_interval = 120 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] reservation_clean_interval = 86400 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] reservation_expire = 86400 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] reserved_image_namespaces = [] {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] reserved_percentage = 0 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] rpc_response_timeout = 120 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] run_external_periodic_tasks = True {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] scst_target_driver = iscsi {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] scst_target_iqn_name = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] service_down_time = 720 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] shell_completion = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] snapshot_name_template = snapshot-%s {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] split_loggers = False {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] state_path = /opt/stack/data/cinder {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] storage_availability_zone = nova {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] storage_protocol = iSCSI {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] syslog_log_facility = LOG_USER {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] target_helper = lioadm {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] target_ip_address = 192.168.122.81 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] target_port = 3260 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] target_protocol = iscsi {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] target_secondary_ip_addresses = [] {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] trace_flags = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] transfer_api_class = cinder.transfer.api.API {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] transport_url = **** {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] until_refresh = 0 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] use_chap_auth = False {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] use_default_quota_class = True {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] use_journal = False {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] use_json = False {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] use_multipath_for_image_xfer = False {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] use_stderr = False {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] use_syslog = False {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] verify_glance_signatures = enabled {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] volume_api_class = cinder.volume.api.API {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] volume_backend_name = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] volume_clear = zero {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] volume_clear_ionice = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] volume_clear_size = 0 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] volume_copy_bps_limit = 0 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] volume_dd_blocksize = 1M {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] volume_name_template = volume-%s {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] volume_service_inithost_offload = False {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] volume_usage_audit_period = month {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] zoning_mode = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] oslo_concurrency.disable_process_locking = False {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] keystone_authtoken.auth_section = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] keystone_authtoken.auth_type = password {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] keystone_authtoken.auth_version = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] keystone_authtoken.cache = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] keystone_authtoken.certfile = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] keystone_authtoken.delay_auth_decision = False {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] keystone_authtoken.http_connect_timeout = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] keystone_authtoken.include_service_catalog = True {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] keystone_authtoken.insecure = False {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:35 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] keystone_authtoken.interface = public {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] keystone_authtoken.keyfile = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] keystone_authtoken.memcache_password = {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] keystone_authtoken.memcache_username = {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] keystone_authtoken.region_name = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] keystone_authtoken.service_token_roles_required = True {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] keystone_authtoken.service_type = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] keystone_authtoken.token_cache_time = 300 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.81/identity {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] cache.backend = dogpile.cache.null {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] cache.backend_argument = **** {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] cache.backend_expiration_time = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] cache.config_prefix = cache.oslo {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] cache.debug_cache_backend = False {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] cache.enable_retry_client = False {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] cache.enable_socket_keepalive = False {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] cache.enabled = False {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] cache.expiration_time = 600 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] cache.hashclient_retry_attempts = 2 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] cache.memcache_dead_retry = 300 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-cecf80e7-d11f-4a93-8a9a-4ab16ca90365 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86721) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 10 15:46:36 devstack cinder-volume[86721]: WARNING cinder.volume.drivers.quobyte [None req-cecf80e7-d11f-4a93-8a9a-4ab16ca90365 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 10 15:46:36 devstack cinder-volume[86721]: WARNING cinder.volume.drivers.quobyte [None req-cecf80e7-d11f-4a93-8a9a-4ab16ca90365 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] cache.memcache_pool_maxsize = 10 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] cache.memcache_sasl_enabled = False {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] cache.password = **** {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] cache.proxies = [] {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] cache.redis_db = 0 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] cache.redis_sentinel_service_name = mymaster {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] cache.redis_server = localhost:6379 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] cache.retry_attempts = 2 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] cache.retry_delay = 0.0 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] cache.socket_keepalive_count = 1 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] cache.socket_keepalive_idle = 1 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-cecf80e7-d11f-4a93-8a9a-4ab16ca90365 None None] Running cmd (subprocess): mount.quobyte {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] cache.socket_keepalive_interval = 1 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] cache.socket_timeout = 1.0 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] cache.tls_allowed_ciphers = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] cache.tls_cafile = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] cache.tls_certfile = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] cache.tls_enabled = False {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] cache.tls_keyfile = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] cache.username = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] coordination.backend_url = **** {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] database.asyncio_connection = **** {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] database.asyncio_slave_connection = **** {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] database.backend = sqlalchemy {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] database.connection = **** {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] database.connection_debug = 0 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] database.connection_parameters = {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] database.connection_recycle_time = 3600 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] database.connection_trace = False {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] database.db_inc_retry_interval = True {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] database.db_max_retries = 20 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] database.db_max_retry_interval = 10 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] database.db_retry_interval = 1 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] database.max_overflow = 50 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] database.max_pool_size = 5 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] database.max_retries = 10 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] database.mysql_wsrep_sync_wait = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] database.pool_timeout = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] database.retry_interval = 10 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] database.slave_connection = **** {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] database.sqlite_synchronous = True {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] database.synchronous_reader = True {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] database.use_db_reconnect = False {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] profiler.connection_string = messaging:// {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] profiler.enabled = False {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] profiler.es_doc_type = notification {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] profiler.es_scroll_size = 10000 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] profiler.es_scroll_time = 2m {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] profiler.filter_error_trace = False {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] profiler.hmac_keys = **** {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] profiler.sentinel_service_name = mymaster {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] profiler.socket_timeout = 0.1 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] profiler.trace_requests = False {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] profiler.trace_sqlalchemy = False {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] profiler_jaeger.process_tags = {} {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] profiler_jaeger.service_name_prefix = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] profiler_otlp.service_name_prefix = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] oslo_policy.enforce_new_defaults = True {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] oslo_policy.enforce_scope = False {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] oslo_policy.policy_default_rule = default {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] oslo_policy.policy_file = policy.yaml {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] oslo_policy.remote_timeout = 60.0 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] privsep_osbrick.group = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] privsep_osbrick.helper_command = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] privsep_osbrick.user = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] cinder_sys_admin.group = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] cinder_sys_admin.helper_command = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] cinder_sys_admin.user = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] service_user.auth_section = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] service_user.auth_type = password {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] service_user.cafile = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] service_user.certfile = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] service_user.collect_timing = False {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] service_user.insecure = False {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] service_user.keyfile = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] service_user.send_service_user_token = True {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] service_user.split_loggers = False {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] service_user.timeout = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] glance.auth_section = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] glance.auth_type = password {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] glance.certfile = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] glance.collect_timing = False {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] glance.insecure = False {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] glance.keyfile = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] glance.region_name = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack quobyte-client[86732]: Reading configuration file: /etc/quobyte/client.cfg Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] glance.split_loggers = False {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] glance.timeout = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] backend_defaults.backend_availability_zone = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] backend_defaults.chap_password = **** {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack quobyte-client[86732]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 10 15:46:36 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-cecf80e7-d11f-4a93-8a9a-4ab16ca90365 None None] CMD "mount.quobyte" returned: 1 in 0.079s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:46:36 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-cecf80e7-d11f-4a93-8a9a-4ab16ca90365 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] backend_defaults.chap_username = {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-cecf80e7-d11f-4a93-8a9a-4ab16ca90365 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] backend_defaults.disk_geometry = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] backend_defaults.driver_client_cert = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] backend_defaults.driver_client_cert_key = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] backend_defaults.driver_data_namespace = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-cecf80e7-d11f-4a93-8a9a-4ab16ca90365 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:46:36 devstack cinder-volume[86721]: INFO cinder.volume.drivers.quobyte [None req-cecf80e7-d11f-4a93-8a9a-4ab16ca90365 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 ... Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] backend_defaults.driver_use_ssl = False {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] backend_defaults.enable_unsupported_driver = False {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-cecf80e7-d11f-4a93-8a9a-4ab16ca90365 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd -c /etc/quobyte/client-cinder.cfg {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] backend_defaults.extra_capabilities = {} {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] backend_defaults.filter_function = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] backend_defaults.goodness_function = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] backend_defaults.iscsi_target_flags = {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] backend_defaults.iscsi_write_cache = on {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] backend_defaults.iser_helper = tgtadm {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] backend_defaults.iser_ip_address = 192.168.122.81 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] backend_defaults.iser_port = 3260 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] backend_defaults.nas_host = {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] backend_defaults.nas_login = admin {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] backend_defaults.nas_mount_options = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] backend_defaults.nas_password = **** {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] backend_defaults.nas_private_key = {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] backend_defaults.nas_share_path = {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] backend_defaults.nas_ssh_port = 22 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] backend_defaults.num_shell_tries = 3 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] backend_defaults.nvmet_port_id = 1 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] backend_defaults.quobyte_client_cfg = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] backend_defaults.quobyte_volume_url = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] backend_defaults.replication_device = **** {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] backend_defaults.report_discard_supported = False {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] backend_defaults.reserved_percentage = 0 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] backend_defaults.scst_target_driver = iscsi {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] backend_defaults.scst_target_iqn_name = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] backend_defaults.storage_protocol = iSCSI {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] backend_defaults.target_helper = tgtadm {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] backend_defaults.target_ip_address = 192.168.122.81 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] backend_defaults.target_port = 3260 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] backend_defaults.target_protocol = iscsi {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] backend_defaults.trace_flags = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] backend_defaults.unique_fqdn_network = True {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] backend_defaults.use_chap_auth = False {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] backend_defaults.volume_backend_name = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] backend_defaults.volume_clear = zero {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] backend_defaults.volume_clear_ionice = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] backend_defaults.volume_clear_size = 0 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] oslo_reports.file_event_handler = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] oslo_reports.log_dir = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] QuobyteHD.backend_availability_zone = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] QuobyteHD.backend_host = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] QuobyteHD.chap_password = **** {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] QuobyteHD.chap_username = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] QuobyteHD.chiscsi_conf = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] QuobyteHD.disk_geometry = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] QuobyteHD.driver_client_cert = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] QuobyteHD.driver_client_cert_key = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] QuobyteHD.driver_data_namespace = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] QuobyteHD.driver_use_ssl = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] QuobyteHD.extra_capabilities = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] QuobyteHD.filter_function = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] QuobyteHD.goodness_function = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] QuobyteHD.iscsi_target_flags = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] QuobyteHD.iscsi_write_cache = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] QuobyteHD.iser_helper = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] QuobyteHD.iser_ip_address = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] QuobyteHD.iser_port = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] QuobyteHD.iser_target_prefix = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] QuobyteHD.nas_host = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] QuobyteHD.nas_login = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] QuobyteHD.nas_mount_options = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] QuobyteHD.nas_password = **** {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] QuobyteHD.nas_private_key = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] QuobyteHD.nas_share_path = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] QuobyteHD.nas_ssh_port = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] QuobyteHD.num_shell_tries = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] QuobyteHD.nvmet_ns_id = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] QuobyteHD.nvmet_port_id = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack sudo[86733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd -c /etc/quobyte/client-cinder.cfg Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] QuobyteHD.replication_device = **** {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] QuobyteHD.report_discard_supported = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] QuobyteHD.reserved_percentage = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] QuobyteHD.scst_target_driver = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] QuobyteHD.storage_protocol = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack sudo[86733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] QuobyteHD.target_helper = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] QuobyteHD.target_ip_address = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] QuobyteHD.target_port = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] QuobyteHD.target_prefix = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] QuobyteHD.target_protocol = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] QuobyteHD.trace_flags = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] QuobyteHD.unique_fqdn_network = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] QuobyteHD.use_chap_auth = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] QuobyteHD.volume_clear = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] QuobyteHD.volume_clear_ionice = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] QuobyteHD.volume_clear_size = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] QuobyteHD.volumes_dir = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] oslo_messaging_rabbit.ssl = False {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] oslo_messaging_rabbit.ssl_version = {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] oslo_messaging_notifications.driver = [] {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] oslo_messaging_notifications.retry = -1 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] oslo_messaging_notifications.transport_url = **** {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] key_manager.fixed_key = **** {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] barbican.barbican_api_version = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] barbican.barbican_endpoint = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] barbican.barbican_endpoint_type = public {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] barbican.barbican_region_name = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] barbican.cafile = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] barbican.certfile = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] barbican.collect_timing = False {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] barbican.insecure = False {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] barbican.keyfile = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] barbican.number_of_retries = 60 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] barbican.retry_delay = 1 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] barbican.send_service_user_token = False {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] barbican.split_loggers = False {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] barbican.timeout = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] barbican.verify_ssl = True {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] barbican.verify_ssl_path = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] barbican_service_user.auth_section = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] barbican_service_user.auth_type = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] barbican_service_user.cafile = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] barbican_service_user.certfile = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] barbican_service_user.collect_timing = False {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] barbican_service_user.insecure = False {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] barbican_service_user.keyfile = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] barbican_service_user.split_loggers = False {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] barbican_service_user.timeout = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] vault.approle_role_id = **** {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] vault.approle_secret_id = **** {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] vault.kv_mountpoint = secret {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] vault.kv_path = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] vault.kv_version = 2 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] vault.namespace = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] vault.root_token_id = **** {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] vault.ssl_ca_crt_file = None {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] vault.timeout = 60.0 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] vault.use_ssl = False {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:36 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] ******************************************************************************** {{(pid=86457) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 10 15:46:36 devstack cinder-volume[76322]: DEBUG oslo_concurrency.lockutils [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] Acquiring lock "singleton_lock" {{(pid=76322) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 10 15:46:36 devstack cinder-volume[76322]: DEBUG oslo_concurrency.lockutils [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] Acquired lock "singleton_lock" {{(pid=76322) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 10 15:46:36 devstack cinder-volume[76322]: DEBUG oslo_concurrency.lockutils [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] Releasing lock "singleton_lock" {{(pid=76322) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 10 15:46:36 devstack cinder-volume[76322]: WARNING amqp [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 10 15:46:36 devstack cinder-volume[76322]: WARNING amqp [None req-c1806254-3dfc-43fb-b819-11fc71a45769 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 10 15:46:36 devstack sudo[86733]: pam_unix(sudo:session): session closed for user root Jul 10 15:46:36 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-cecf80e7-d11f-4a93-8a9a-4ab16ca90365 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.845s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:46:36 devstack cinder-volume[86721]: INFO cinder.volume.drivers.quobyte [None req-cecf80e7-d11f-4a93-8a9a-4ab16ca90365 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 succeeded Jul 10 15:46:36 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-cecf80e7-d11f-4a93-8a9a-4ab16ca90365 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:46:36 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-cecf80e7-d11f-4a93-8a9a-4ab16ca90365 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.864s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:46:36 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-cecf80e7-d11f-4a93-8a9a-4ab16ca90365 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:46:37 devstack sudo[86818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 15:46:37 devstack sudo[86818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:46:37 devstack sudo[86818]: pam_unix(sudo:session): session closed for user root Jul 10 15:46:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-cecf80e7-d11f-4a93-8a9a-4ab16ca90365 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.646s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:46:37 devstack cinder-volume[86721]: INFO cinder.volume.driver [None req-cecf80e7-d11f-4a93-8a9a-4ab16ca90365 None None] Driver hasn't implemented _init_vendor_properties() Jul 10 15:46:37 devstack cinder-volume[86721]: DEBUG cinder.volume.driver [None req-cecf80e7-d11f-4a93-8a9a-4ab16ca90365 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577095031738, 'free_capacity_gb': 1775.7577095031738, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86721) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 10 15:46:37 devstack cinder-volume[86721]: DEBUG oslo_db.sqlalchemy.engines [None req-cecf80e7-d11f-4a93-8a9a-4ab16ca90365 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86721) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 15:46:37 devstack cinder-volume[86721]: DEBUG dbcounter [-] [86721] Writer thread running {{(pid=86721) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 10 15:46:37 devstack cinder-volume[86721]: DEBUG cinder.db.api [None req-cecf80e7-d11f-4a93-8a9a-4ab16ca90365 None None] Building query based on filter {{(pid=86721) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 10 15:46:37 devstack cinder-volume[86721]: DEBUG cinder.image.image_utils [None req-cecf80e7-d11f-4a93-8a9a-4ab16ca90365 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86721) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 10 15:46:37 devstack cinder-volume[86721]: INFO cinder.keymgr.migration [None req-62a556b5-e8fa-4b40-beeb-e16711a23af5 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 10 15:46:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-cecf80e7-d11f-4a93-8a9a-4ab16ca90365 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:46:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-cecf80e7-d11f-4a93-8a9a-4ab16ca90365 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:46:37 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-cecf80e7-d11f-4a93-8a9a-4ab16ca90365 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:46:37 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-cecf80e7-d11f-4a93-8a9a-4ab16ca90365 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:46:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-cecf80e7-d11f-4a93-8a9a-4ab16ca90365 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:46:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-cecf80e7-d11f-4a93-8a9a-4ab16ca90365 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:46:37 devstack sudo[86838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 15:46:37 devstack sudo[86838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:46:38 devstack sudo[86838]: pam_unix(sudo:session): session closed for user root Jul 10 15:46:38 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-cecf80e7-d11f-4a93-8a9a-4ab16ca90365 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.653s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:46:38 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-cecf80e7-d11f-4a93-8a9a-4ab16ca90365 None None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 15:46:38 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-cecf80e7-d11f-4a93-8a9a-4ab16ca90365 None None] Driver initialization completed successfully. Jul 10 15:46:38 devstack cinder-volume[86721]: INFO cinder.manager [None req-cecf80e7-d11f-4a93-8a9a-4ab16ca90365 None None] Initiating service 3 cleanup Jul 10 15:46:38 devstack cinder-volume[86721]: INFO cinder.manager [None req-cecf80e7-d11f-4a93-8a9a-4ab16ca90365 None None] Service 3 cleanup completed. Jul 10 15:46:38 devstack cinder-volume[86721]: DEBUG cinder.service [None req-cecf80e7-d11f-4a93-8a9a-4ab16ca90365 None None] Creating RPC server for service cinder-volume {{(pid=86721) start /opt/stack/cinder/cinder/service.py:231}} Jul 10 15:46:38 devstack cinder-volume[86721]: DEBUG cinder.service [None req-cecf80e7-d11f-4a93-8a9a-4ab16ca90365 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86721) start /opt/stack/cinder/cinder/service.py:237}} Jul 10 15:46:38 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-cecf80e7-d11f-4a93-8a9a-4ab16ca90365 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 10 15:46:38 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-cecf80e7-d11f-4a93-8a9a-4ab16ca90365 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:46:38 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-cecf80e7-d11f-4a93-8a9a-4ab16ca90365 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:46:38 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-cecf80e7-d11f-4a93-8a9a-4ab16ca90365 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:46:38 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-cecf80e7-d11f-4a93-8a9a-4ab16ca90365 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:46:38 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-cecf80e7-d11f-4a93-8a9a-4ab16ca90365 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:46:38 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-cecf80e7-d11f-4a93-8a9a-4ab16ca90365 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:46:38 devstack sudo[86861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 15:46:38 devstack sudo[86861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:46:39 devstack sudo[86861]: pam_unix(sudo:session): session closed for user root Jul 10 15:46:39 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-cecf80e7-d11f-4a93-8a9a-4ab16ca90365 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.709s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:46:39 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-cecf80e7-d11f-4a93-8a9a-4ab16ca90365 None None] Driver post RPC initialization completed successfully. Jul 10 15:46:43 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-748bc2ec-7134-4d3d-838b-49d14d4f9501 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:46:43 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-748bc2ec-7134-4d3d-838b-49d14d4f9501 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:46:43 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-748bc2ec-7134-4d3d-838b-49d14d4f9501 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:46:43 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-748bc2ec-7134-4d3d-838b-49d14d4f9501 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:46:43 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-748bc2ec-7134-4d3d-838b-49d14d4f9501 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:46:43 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-748bc2ec-7134-4d3d-838b-49d14d4f9501 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:46:43 devstack sudo[87064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 15:46:43 devstack sudo[87064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:46:44 devstack sudo[87064]: pam_unix(sudo:session): session closed for user root Jul 10 15:46:44 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-748bc2ec-7134-4d3d-838b-49d14d4f9501 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.683s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:46:44 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-748bc2ec-7134-4d3d-838b-49d14d4f9501 None None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 15:46:44 devstack cinder-volume[86457]: INFO oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] Caught SIGTERM, stopping children Jul 10 15:46:44 devstack cinder-volume[86457]: DEBUG oslo_concurrency.lockutils [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] Acquiring lock "singleton_lock" {{(pid=86457) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 10 15:46:44 devstack cinder-volume[86457]: DEBUG oslo_concurrency.lockutils [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] Acquired lock "singleton_lock" {{(pid=86457) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 10 15:46:44 devstack cinder-volume[86457]: DEBUG oslo_concurrency.lockutils [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] Releasing lock "singleton_lock" {{(pid=86457) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 10 15:46:44 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] Stop services. {{(pid=86457) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 10 15:46:44 devstack cinder-volume[86457]: DEBUG oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] Killing children. {{(pid=86457) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 10 15:46:44 devstack cinder-volume[86457]: INFO oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] Waiting on 1 children to exit Jul 10 15:46:46 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] Acquiring lock "singleton_lock" {{(pid=86721) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 10 15:46:46 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] Acquired lock "singleton_lock" {{(pid=86721) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 10 15:46:46 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] Releasing lock "singleton_lock" {{(pid=86721) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 10 15:46:46 devstack cinder-volume[86721]: WARNING amqp [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 10 15:46:46 devstack cinder-volume[86721]: WARNING amqp [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 10 15:46:46 devstack cinder-volume[86457]: INFO oslo_service.backend._eventlet.service [None req-436d138d-a2cb-4a2b-9434-402c1e06625c None None] Child 86721 exited with status 0 Jul 10 15:46:47 devstack cinder-volume[87167]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 10 15:46:47 devstack cinder-volume[87167]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 10 15:46:47 devstack cinder-volume[87167]: we strongly recommend against using it for new projects. Jul 10 15:46:47 devstack cinder-volume[87167]: If you are already using Eventlet, we recommend migrating to a different Jul 10 15:46:47 devstack cinder-volume[87167]: framework. For more detail see Jul 10 15:46:47 devstack cinder-volume[87167]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 10 15:46:47 devstack cinder-volume[87167]: import eventlet # noqa Jul 10 15:46:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87167) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 10 15:46:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87167) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 10 15:46:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87167) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 10 15:46:51 devstack cinder-volume[87167]: INFO dbcounter [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] Registered counter for database cinder Jul 10 15:46:51 devstack cinder-volume[87167]: DEBUG oslo_db.sqlalchemy.engines [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87167) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 15:46:51 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writer thread running {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 10 15:46:51 devstack cinder-volume[87167]: INFO cinder.rpc [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 10 15:46:51 devstack cinder-volume[87167]: INFO cinder.rpc [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 10 15:46:51 devstack cinder-volume[87167]: DEBUG oslo_db.sqlalchemy.engines [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87167) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 15:46:51 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] Determined volume DB was empty at startup. Jul 10 15:46:51 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87167) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 10 15:46:51 devstack cinder-volume[87167]: WARNING stevedore.named [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 10 15:46:51 devstack cinder-volume[87167]: WARNING castellan.key_manager [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 10 15:46:51 devstack cinder-volume[87167]: WARNING cinder.keymgr.conf_key_mgr [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 10 15:46:51 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 10 15:46:51 devstack cinder-volume[87167]: DEBUG oslo_db.sqlalchemy.engines [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87167) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 15:46:51 devstack cinder-volume[87167]: INFO oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] Starting 1 workers Jul 10 15:46:51 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] Started child 87420 {{(pid=87167) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 10 15:46:51 devstack cinder-volume[87420]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] Full set of CONF: {{(pid=87167) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] ******************************************************************************** {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] Configuration options gathered from: {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] ================================================================================ {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] allow_availability_zone_fallback = False {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] allow_compression_on_image_upload = False {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] allowed_direct_url_schemes = [] {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] api_rate_limit = True {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] auth_strategy = keystone {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] backend_availability_zone = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] backend_host = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] backend_name = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] backend_stats_polling_interval = 60 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] backup_api_class = cinder.backup.api.API {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] backup_name_template = backup-%s {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] backup_use_same_host = False {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] backup_use_temp_snapshot = False {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] chap_password = **** {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] chap_username = {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] cinder_internal_tenant_project_id = 293df3badd6f4d8cacd5ee5e7ea8585f {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] cinder_internal_tenant_user_id = afe66ebb36dd4b90bb08571db9126407 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] cluster = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] compression_format = gzip {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] compute_api_class = cinder.compute.nova.API {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] config_dir = [] {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] config_source = [] {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] control_exchange = openstack {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] debug = True {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] default_availability_zone = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] default_group_type = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] default_volume_type = QuobyteHD {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] disk_geometry = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] driver_client_cert = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] driver_client_cert_key = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-dfdba423-0451-449a-9dd6-b38302176d72 None None] Starting volume driver QuobyteDriver (1.1.14) Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] driver_data_namespace = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-dfdba423-0451-449a-9dd6-b38302176d72 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87420) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] driver_ssl_cert_path = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] driver_ssl_cert_verify = False {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] driver_use_ssl = False {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] enable_new_services = True {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] enable_unsupported_driver = False {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] enabled_backends = ['QuobyteHD'] {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] enforce_multipath_for_image_xfer = False {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] filter_function = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] glance_api_insecure = False {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] glance_api_servers = ['http://192.168.122.81/image'] {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] glance_api_ssl_compression = False {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] glance_ca_certificates_file = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] glance_catalog_info = image:glance:publicURL {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] glance_certfile = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] glance_keyfile = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] glance_num_retries = 3 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] glance_request_timeout = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] goodness_function = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] graceful_shutdown_timeout = 5 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] group_api_class = cinder.group.api.API {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] host = devstack {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] image_compress_on_upload = True {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] image_conversion_address_space_limit = 1 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] image_conversion_cpu_limit = 60 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] image_conversion_disable = False {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] image_upload_use_cinder_backend = False {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] image_upload_use_internal_tenant = False {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] image_volume_cache_enabled = False {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] image_volume_cache_max_count = 0 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] image_volume_cache_max_size_gb = 0 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] init_host_max_objects_retrieval = 0 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] instance_format = [instance: %(uuid)s] {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] iscsi_target_flags = {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] iscsi_write_cache = on {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] iser_helper = tgtadm {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] iser_ip_address = 192.168.122.81 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] iser_port = 3260 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] log_color = False {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] log_config_append = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] log_dir = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] log_file = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] log_options = True {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] log_rotate_interval = 1 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] log_rotate_interval_type = days {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] log_rotation_type = none {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] max_age = 0 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] max_logfile_count = 30 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] max_logfile_size_mb = 200 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] max_over_subscription_ratio = 20.0 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] message_reap_interval = 86400 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] message_ttl = 2592000 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] migration_create_volume_timeout_secs = 300 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] monkey_patch = False {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] monkey_patch_modules = [] {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] my_ip = 192.168.122.81 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] no_snapshot_gb_quota = False {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] num_iser_scan_tries = 3 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] num_shell_tries = 3 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] num_volume_device_scan_tries = 3 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] nvmeof_conn_info_version = 1 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] nvmet_ns_id = 10 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] nvmet_port_id = 1 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] osapi_max_limit = 1000 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] osapi_volume_ext_list = [] {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] osapi_volume_listen = 0.0.0.0 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] osapi_volume_listen_port = 8776 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] osapi_volume_use_ssl = False {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] osapi_volume_workers = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] per_volume_size_limit = -1 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] periodic_fuzzy_delay = 60 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] periodic_interval = 60 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] project_id_regex = [0-9a-f\-]+ {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] public_endpoint = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] publish_errors = False {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] quota_backup_gigabytes = 1000 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] quota_backups = 10 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] quota_gigabytes = 1000 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] quota_groups = 10 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] quota_snapshots = 10 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] quota_volumes = 10 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] rate_limit_burst = 0 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] rate_limit_except_level = CRITICAL {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] rate_limit_interval = 0 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] reinit_driver_count = 3 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] replication_device = **** {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] report_discard_supported = False {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] report_interval = 120 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] reservation_clean_interval = 86400 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] reservation_expire = 86400 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] reserved_image_namespaces = [] {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] reserved_percentage = 0 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] rpc_response_timeout = 120 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] run_external_periodic_tasks = True {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] scst_target_driver = iscsi {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] scst_target_iqn_name = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] service_down_time = 720 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] shell_completion = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] snapshot_name_template = snapshot-%s {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] split_loggers = False {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] state_path = /opt/stack/data/cinder {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] storage_availability_zone = nova {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] storage_protocol = iSCSI {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] syslog_log_facility = LOG_USER {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] target_helper = lioadm {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-dfdba423-0451-449a-9dd6-b38302176d72 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87420) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] target_ip_address = 192.168.122.81 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87420]: WARNING cinder.volume.drivers.quobyte [None req-dfdba423-0451-449a-9dd6-b38302176d72 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] target_port = 3260 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87420]: WARNING cinder.volume.drivers.quobyte [None req-dfdba423-0451-449a-9dd6-b38302176d72 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] target_protocol = iscsi {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] target_secondary_ip_addresses = [] {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-dfdba423-0451-449a-9dd6-b38302176d72 None None] Running cmd (subprocess): mount.quobyte {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] trace_flags = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] transfer_api_class = cinder.transfer.api.API {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] transport_url = **** {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] until_refresh = 0 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] use_chap_auth = False {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] use_default_quota_class = True {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] use_journal = False {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] use_json = False {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] use_multipath_for_image_xfer = False {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] use_stderr = False {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] use_syslog = False {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] verify_glance_signatures = enabled {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] volume_api_class = cinder.volume.api.API {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] volume_backend_name = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] volume_clear = zero {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] volume_clear_ionice = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] volume_clear_size = 0 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] volume_copy_bps_limit = 0 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] volume_dd_blocksize = 1M {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] volume_name_template = volume-%s {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] volume_service_inithost_offload = False {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] volume_usage_audit_period = month {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] zoning_mode = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] oslo_concurrency.disable_process_locking = False {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] keystone_authtoken.auth_section = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] keystone_authtoken.auth_type = password {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] keystone_authtoken.auth_version = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] keystone_authtoken.cache = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] keystone_authtoken.certfile = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] keystone_authtoken.delay_auth_decision = False {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] keystone_authtoken.http_connect_timeout = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] keystone_authtoken.include_service_catalog = True {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] keystone_authtoken.insecure = False {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] keystone_authtoken.interface = public {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] keystone_authtoken.keyfile = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] keystone_authtoken.memcache_password = {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] keystone_authtoken.memcache_username = {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] keystone_authtoken.region_name = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] keystone_authtoken.service_token_roles_required = True {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] keystone_authtoken.service_type = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] keystone_authtoken.token_cache_time = 300 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.81/identity {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] cache.backend = dogpile.cache.null {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] cache.backend_argument = **** {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] cache.backend_expiration_time = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] cache.config_prefix = cache.oslo {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] cache.debug_cache_backend = False {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] cache.enable_retry_client = False {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] cache.enable_socket_keepalive = False {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] cache.enabled = False {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] cache.expiration_time = 600 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] cache.hashclient_retry_attempts = 2 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] cache.memcache_dead_retry = 300 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] cache.memcache_pool_maxsize = 10 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] cache.memcache_sasl_enabled = False {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] cache.password = **** {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] cache.proxies = [] {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] cache.redis_db = 0 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] cache.redis_sentinel_service_name = mymaster {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] cache.redis_server = localhost:6379 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] cache.retry_attempts = 2 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] cache.retry_delay = 0.0 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] cache.socket_keepalive_count = 1 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] cache.socket_keepalive_idle = 1 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] cache.socket_keepalive_interval = 1 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] cache.socket_timeout = 1.0 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] cache.tls_allowed_ciphers = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] cache.tls_cafile = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] cache.tls_certfile = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] cache.tls_enabled = False {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] cache.tls_keyfile = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] cache.username = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] coordination.backend_url = **** {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] database.asyncio_connection = **** {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] database.asyncio_slave_connection = **** {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] database.backend = sqlalchemy {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] database.connection = **** {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] database.connection_debug = 0 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] database.connection_parameters = {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] database.connection_recycle_time = 3600 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] database.connection_trace = False {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] database.db_inc_retry_interval = True {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] database.db_max_retries = 20 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] database.db_max_retry_interval = 10 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] database.db_retry_interval = 1 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] database.max_overflow = 50 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] database.max_pool_size = 5 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] database.max_retries = 10 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] database.mysql_wsrep_sync_wait = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] database.pool_timeout = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] database.retry_interval = 10 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] database.slave_connection = **** {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] database.sqlite_synchronous = True {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] database.synchronous_reader = True {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] database.use_db_reconnect = False {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] profiler.connection_string = messaging:// {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] profiler.enabled = False {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] profiler.es_doc_type = notification {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack quobyte-client[87422]: Reading configuration file: /etc/quobyte/client.cfg Jul 10 15:46:52 devstack quobyte-client[87422]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] profiler.es_scroll_size = 10000 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] profiler.es_scroll_time = 2m {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] profiler.filter_error_trace = False {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] profiler.hmac_keys = **** {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] profiler.sentinel_service_name = mymaster {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] profiler.socket_timeout = 0.1 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] profiler.trace_requests = False {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] profiler.trace_sqlalchemy = False {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] profiler_jaeger.process_tags = {} {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-dfdba423-0451-449a-9dd6-b38302176d72 None None] CMD "mount.quobyte" returned: 1 in 0.061s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] profiler_jaeger.service_name_prefix = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] profiler_otlp.service_name_prefix = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-dfdba423-0451-449a-9dd6-b38302176d72 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] oslo_policy.enforce_new_defaults = True {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] oslo_policy.enforce_scope = False {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-dfdba423-0451-449a-9dd6-b38302176d72 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] oslo_policy.policy_default_rule = default {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-dfdba423-0451-449a-9dd6-b38302176d72 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] oslo_policy.policy_file = policy.yaml {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] oslo_policy.remote_timeout = 60.0 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] privsep_osbrick.group = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] privsep_osbrick.helper_command = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-dfdba423-0451-449a-9dd6-b38302176d72 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-dfdba423-0451-449a-9dd6-b38302176d72 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] privsep_osbrick.user = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-dfdba423-0451-449a-9dd6-b38302176d72 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] cinder_sys_admin.group = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] cinder_sys_admin.helper_command = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] cinder_sys_admin.user = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] service_user.auth_section = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] service_user.auth_type = password {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] service_user.cafile = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] service_user.certfile = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] service_user.collect_timing = False {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] service_user.insecure = False {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] service_user.keyfile = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] service_user.send_service_user_token = True {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] service_user.split_loggers = False {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] service_user.timeout = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] glance.auth_section = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] glance.auth_type = password {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] glance.certfile = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] glance.collect_timing = False {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] glance.insecure = False {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] glance.keyfile = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] glance.region_name = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] glance.split_loggers = False {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] glance.timeout = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] backend_defaults.backend_availability_zone = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] backend_defaults.chap_password = **** {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] backend_defaults.chap_username = {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] backend_defaults.disk_geometry = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] backend_defaults.driver_client_cert = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] backend_defaults.driver_client_cert_key = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] backend_defaults.driver_data_namespace = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] backend_defaults.driver_use_ssl = False {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] backend_defaults.enable_unsupported_driver = False {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] backend_defaults.extra_capabilities = {} {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] backend_defaults.filter_function = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] backend_defaults.goodness_function = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] backend_defaults.iscsi_target_flags = {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] backend_defaults.iscsi_write_cache = on {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] backend_defaults.iser_helper = tgtadm {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] backend_defaults.iser_ip_address = 192.168.122.81 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] backend_defaults.iser_port = 3260 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] backend_defaults.nas_host = {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] backend_defaults.nas_login = admin {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] backend_defaults.nas_mount_options = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] backend_defaults.nas_password = **** {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] backend_defaults.nas_private_key = {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack sudo[87423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] backend_defaults.nas_share_path = {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] backend_defaults.nas_ssh_port = 22 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack sudo[87423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] backend_defaults.num_shell_tries = 3 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] backend_defaults.nvmet_port_id = 1 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] backend_defaults.quobyte_client_cfg = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] backend_defaults.quobyte_volume_url = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] backend_defaults.replication_device = **** {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] backend_defaults.report_discard_supported = False {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] backend_defaults.reserved_percentage = 0 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] backend_defaults.scst_target_driver = iscsi {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] backend_defaults.scst_target_iqn_name = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] backend_defaults.storage_protocol = iSCSI {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] backend_defaults.target_helper = tgtadm {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] backend_defaults.target_ip_address = 192.168.122.81 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] backend_defaults.target_port = 3260 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] backend_defaults.target_protocol = iscsi {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] backend_defaults.trace_flags = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] backend_defaults.unique_fqdn_network = True {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] backend_defaults.use_chap_auth = False {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] backend_defaults.volume_backend_name = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] backend_defaults.volume_clear = zero {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] backend_defaults.volume_clear_ionice = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] backend_defaults.volume_clear_size = 0 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] oslo_reports.file_event_handler = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] oslo_reports.log_dir = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] QuobyteHD.backend_availability_zone = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] QuobyteHD.backend_host = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] QuobyteHD.chap_password = **** {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] QuobyteHD.chap_username = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] QuobyteHD.chiscsi_conf = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] QuobyteHD.disk_geometry = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] QuobyteHD.driver_client_cert = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] QuobyteHD.driver_client_cert_key = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] QuobyteHD.driver_data_namespace = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] QuobyteHD.driver_use_ssl = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] QuobyteHD.enable_unsupported_driver = True {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] QuobyteHD.extra_capabilities = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] QuobyteHD.filter_function = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] QuobyteHD.goodness_function = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] QuobyteHD.iscsi_target_flags = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] QuobyteHD.iscsi_write_cache = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] QuobyteHD.iser_helper = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] QuobyteHD.iser_ip_address = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] QuobyteHD.iser_port = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] QuobyteHD.iser_target_prefix = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] QuobyteHD.nas_host = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] QuobyteHD.nas_login = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] QuobyteHD.nas_mount_options = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] QuobyteHD.nas_password = **** {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] QuobyteHD.nas_private_key = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] QuobyteHD.nas_share_path = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] QuobyteHD.nas_ssh_port = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] QuobyteHD.num_shell_tries = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] QuobyteHD.nvmet_ns_id = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] QuobyteHD.nvmet_port_id = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] QuobyteHD.replication_device = **** {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] QuobyteHD.report_discard_supported = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] QuobyteHD.reserved_percentage = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] QuobyteHD.scst_target_driver = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] QuobyteHD.storage_protocol = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] QuobyteHD.target_helper = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] QuobyteHD.target_ip_address = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] QuobyteHD.target_port = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] QuobyteHD.target_prefix = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] QuobyteHD.target_protocol = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] QuobyteHD.trace_flags = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] QuobyteHD.unique_fqdn_network = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] QuobyteHD.use_chap_auth = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] QuobyteHD.volume_clear = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] QuobyteHD.volume_clear_ionice = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] QuobyteHD.volume_clear_size = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] QuobyteHD.volumes_dir = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] oslo_messaging_rabbit.ssl = False {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] oslo_messaging_rabbit.ssl_version = {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] oslo_messaging_notifications.driver = [] {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] oslo_messaging_notifications.retry = -1 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] oslo_messaging_notifications.transport_url = **** {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] key_manager.fixed_key = **** {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] barbican.barbican_api_version = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] barbican.barbican_endpoint = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] barbican.barbican_endpoint_type = public {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] barbican.barbican_region_name = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] barbican.cafile = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] barbican.certfile = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] barbican.collect_timing = False {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] barbican.insecure = False {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] barbican.keyfile = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] barbican.number_of_retries = 60 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] barbican.retry_delay = 1 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] barbican.send_service_user_token = False {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] barbican.split_loggers = False {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] barbican.timeout = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] barbican.verify_ssl = True {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] barbican.verify_ssl_path = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] barbican_service_user.auth_section = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] barbican_service_user.auth_type = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] barbican_service_user.cafile = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] barbican_service_user.certfile = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] barbican_service_user.collect_timing = False {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] barbican_service_user.insecure = False {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] barbican_service_user.keyfile = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] barbican_service_user.split_loggers = False {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] barbican_service_user.timeout = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] vault.approle_role_id = **** {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] vault.approle_secret_id = **** {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] vault.kv_mountpoint = secret {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] vault.kv_path = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] vault.kv_version = 2 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] vault.namespace = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] vault.root_token_id = **** {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] vault.ssl_ca_crt_file = None {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] vault.timeout = 60.0 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] vault.use_ssl = False {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 15:46:52 devstack cinder-volume[87167]: DEBUG oslo_service.backend._eventlet.service [None req-97f39692-4484-499c-ba61-55a2fb89536e None None] ******************************************************************************** {{(pid=87167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 10 15:46:52 devstack sudo[87423]: pam_unix(sudo:session): session closed for user root Jul 10 15:46:52 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-dfdba423-0451-449a-9dd6-b38302176d72 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.614s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:46:52 devstack cinder-volume[87420]: INFO cinder.volume.driver [None req-dfdba423-0451-449a-9dd6-b38302176d72 None None] Driver hasn't implemented _init_vendor_properties() Jul 10 15:46:52 devstack cinder-volume[87420]: DEBUG cinder.volume.driver [None req-dfdba423-0451-449a-9dd6-b38302176d72 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577095031738, 'free_capacity_gb': 1775.7577095031738, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87420) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 10 15:46:52 devstack cinder-volume[87420]: DEBUG oslo_db.sqlalchemy.engines [None req-dfdba423-0451-449a-9dd6-b38302176d72 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87420) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 15:46:52 devstack cinder-volume[87420]: DEBUG dbcounter [-] [87420] Writer thread running {{(pid=87420) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 10 15:46:52 devstack cinder-volume[87420]: DEBUG cinder.db.api [None req-dfdba423-0451-449a-9dd6-b38302176d72 None None] Building query based on filter {{(pid=87420) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 10 15:46:52 devstack cinder-volume[87420]: DEBUG cinder.image.image_utils [None req-dfdba423-0451-449a-9dd6-b38302176d72 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87420) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 10 15:46:52 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-dfdba423-0451-449a-9dd6-b38302176d72 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:46:52 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-dfdba423-0451-449a-9dd6-b38302176d72 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:46:52 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-dfdba423-0451-449a-9dd6-b38302176d72 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:46:52 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-dfdba423-0451-449a-9dd6-b38302176d72 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:46:52 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-dfdba423-0451-449a-9dd6-b38302176d72 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:46:52 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-dfdba423-0451-449a-9dd6-b38302176d72 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:46:52 devstack cinder-volume[87420]: INFO cinder.keymgr.migration [None req-e2318bdb-5110-41b3-b1df-903f92871793 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 10 15:46:52 devstack sudo[87429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 15:46:52 devstack sudo[87429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:46:53 devstack sudo[87429]: pam_unix(sudo:session): session closed for user root Jul 10 15:46:53 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-dfdba423-0451-449a-9dd6-b38302176d72 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.615s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:46:53 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-dfdba423-0451-449a-9dd6-b38302176d72 None None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 15:46:53 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-dfdba423-0451-449a-9dd6-b38302176d72 None None] Driver initialization completed successfully. Jul 10 15:46:53 devstack cinder-volume[87420]: INFO cinder.manager [None req-dfdba423-0451-449a-9dd6-b38302176d72 None None] Initiating service 3 cleanup Jul 10 15:46:53 devstack cinder-volume[87420]: INFO cinder.manager [None req-dfdba423-0451-449a-9dd6-b38302176d72 None None] Service 3 cleanup completed. Jul 10 15:46:53 devstack cinder-volume[87420]: DEBUG cinder.service [None req-dfdba423-0451-449a-9dd6-b38302176d72 None None] Creating RPC server for service cinder-volume {{(pid=87420) start /opt/stack/cinder/cinder/service.py:231}} Jul 10 15:46:53 devstack cinder-volume[87420]: DEBUG cinder.service [None req-dfdba423-0451-449a-9dd6-b38302176d72 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87420) start /opt/stack/cinder/cinder/service.py:237}} Jul 10 15:46:53 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-dfdba423-0451-449a-9dd6-b38302176d72 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 10 15:46:53 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-dfdba423-0451-449a-9dd6-b38302176d72 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:46:53 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-dfdba423-0451-449a-9dd6-b38302176d72 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:46:53 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-dfdba423-0451-449a-9dd6-b38302176d72 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:46:53 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-dfdba423-0451-449a-9dd6-b38302176d72 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:46:53 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-dfdba423-0451-449a-9dd6-b38302176d72 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:46:53 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-dfdba423-0451-449a-9dd6-b38302176d72 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:46:53 devstack sudo[87433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 15:46:53 devstack sudo[87433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:46:54 devstack sudo[87433]: pam_unix(sudo:session): session closed for user root Jul 10 15:46:54 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-dfdba423-0451-449a-9dd6-b38302176d72 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.613s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:46:54 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-dfdba423-0451-449a-9dd6-b38302176d72 None None] Driver post RPC initialization completed successfully. Jul 10 15:47:01 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 15:47:03 devstack cinder-volume[87420]: DEBUG dbcounter [-] [87420] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=87420) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 15:47:04 devstack cinder-volume[87420]: DEBUG dbcounter [-] [87420] Writing DB stats cinder:SELECT=3 {{(pid=87420) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 15:47:17 devstack cinder-volume[87420]: DEBUG oslo_service.periodic_task [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Running periodic task VolumeManager._thread_info {{(pid=87420) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 15:47:17 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] thread count: 6 {{(pid=87420) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 15:47:17 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] thread info: [<_MainThread(MainThread, started 133639250378880)>, , , , , ] {{(pid=87420) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 15:48:09 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-615c87e2-2f04-4aaa-a7d2-8e59dbdeacdc tempest-DeleteServersTestJSON-1023489511 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 15:48:10 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-615c87e2-2f04-4aaa-a7d2-8e59dbdeacdc tempest-DeleteServersTestJSON-1023489511 None] Flow 'volume_create_manager' (35265387-bcc4-4ee2-a806-9cbf57ed02e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:48:10 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-615c87e2-2f04-4aaa-a7d2-8e59dbdeacdc tempest-DeleteServersTestJSON-1023489511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adad274f-12f5-4698-a9ec-61722d250fd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:48:10 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-615c87e2-2f04-4aaa-a7d2-8e59dbdeacdc tempest-DeleteServersTestJSON-1023489511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adad274f-12f5-4698-a9ec-61722d250fd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:48:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1336244852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d814b47a-d924-4390-8356-84dec4656b09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84cbc260ddef4d2289e2de7d5da75c91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:48:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:48:10Z,use_quota=True,user_id='f38efdf2f9d248728a2d98ac2a075df7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:48:10 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-615c87e2-2f04-4aaa-a7d2-8e59dbdeacdc tempest-DeleteServersTestJSON-1023489511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e1f3732-1f32-45b0-a2f7-16a76acb34df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:48:10 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-615c87e2-2f04-4aaa-a7d2-8e59dbdeacdc tempest-DeleteServersTestJSON-1023489511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e1f3732-1f32-45b0-a2f7-16a76acb34df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:48:10 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-615c87e2-2f04-4aaa-a7d2-8e59dbdeacdc tempest-DeleteServersTestJSON-1023489511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a5807c1-0c96-4231-b112-d450e4903924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:48:10 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-615c87e2-2f04-4aaa-a7d2-8e59dbdeacdc tempest-DeleteServersTestJSON-1023489511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a5807c1-0c96-4231-b112-d450e4903924) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd814b47a-d924-4390-8356-84dec4656b09', 'volume_name': 'volume-d814b47a-d924-4390-8356-84dec4656b09', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:48:10 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-615c87e2-2f04-4aaa-a7d2-8e59dbdeacdc tempest-DeleteServersTestJSON-1023489511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e636c1f1-1e56-445f-80cf-ec8975664c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:48:10 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-615c87e2-2f04-4aaa-a7d2-8e59dbdeacdc tempest-DeleteServersTestJSON-1023489511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e636c1f1-1e56-445f-80cf-ec8975664c0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:48:10 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-615c87e2-2f04-4aaa-a7d2-8e59dbdeacdc tempest-DeleteServersTestJSON-1023489511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b10d9d67-913a-4db2-bc62-a79e70cad625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:48:10 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-615c87e2-2f04-4aaa-a7d2-8e59dbdeacdc tempest-DeleteServersTestJSON-1023489511 None] Volume d814b47a-d924-4390-8356-84dec4656b09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d814b47a-d924-4390-8356-84dec4656b09', 'volume_size': 1} Jul 10 15:48:10 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-615c87e2-2f04-4aaa-a7d2-8e59dbdeacdc tempest-DeleteServersTestJSON-1023489511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:48:10 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-615c87e2-2f04-4aaa-a7d2-8e59dbdeacdc tempest-DeleteServersTestJSON-1023489511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:48:10 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-615c87e2-2f04-4aaa-a7d2-8e59dbdeacdc tempest-DeleteServersTestJSON-1023489511 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:48:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1336244852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d814b47a-d924-4390-8356-84dec4656b09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84cbc260ddef4d2289e2de7d5da75c91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:48:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:48:10Z,use_quota=True,user_id='f38efdf2f9d248728a2d98ac2a075df7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 15:48:10 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-615c87e2-2f04-4aaa-a7d2-8e59dbdeacdc tempest-DeleteServersTestJSON-1023489511 None] Creating volume d814b47a-d924-4390-8356-84dec4656b09 {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 15:48:10 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-615c87e2-2f04-4aaa-a7d2-8e59dbdeacdc tempest-DeleteServersTestJSON-1023489511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:48:10 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-615c87e2-2f04-4aaa-a7d2-8e59dbdeacdc tempest-DeleteServersTestJSON-1023489511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:48:10 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-615c87e2-2f04-4aaa-a7d2-8e59dbdeacdc tempest-DeleteServersTestJSON-1023489511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:48:10 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-615c87e2-2f04-4aaa-a7d2-8e59dbdeacdc tempest-DeleteServersTestJSON-1023489511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:48:10 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-615c87e2-2f04-4aaa-a7d2-8e59dbdeacdc tempest-DeleteServersTestJSON-1023489511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:48:10 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-615c87e2-2f04-4aaa-a7d2-8e59dbdeacdc tempest-DeleteServersTestJSON-1023489511 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 15:48:10 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-615c87e2-2f04-4aaa-a7d2-8e59dbdeacdc tempest-DeleteServersTestJSON-1023489511 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 15:48:10 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-615c87e2-2f04-4aaa-a7d2-8e59dbdeacdc tempest-DeleteServersTestJSON-1023489511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d814b47a-d924-4390-8356-84dec4656b09 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:48:10 devstack sudo[88003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d814b47a-d924-4390-8356-84dec4656b09 1073741824 Jul 10 15:48:10 devstack sudo[88003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:48:12 devstack sudo[88003]: pam_unix(sudo:session): session closed for user root Jul 10 15:48:12 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-615c87e2-2f04-4aaa-a7d2-8e59dbdeacdc tempest-DeleteServersTestJSON-1023489511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d814b47a-d924-4390-8356-84dec4656b09 1073741824" returned: 0 in 2.330s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:48:12 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-615c87e2-2f04-4aaa-a7d2-8e59dbdeacdc tempest-DeleteServersTestJSON-1023489511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d814b47a-d924-4390-8356-84dec4656b09 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:48:12 devstack sudo[88344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d814b47a-d924-4390-8356-84dec4656b09 Jul 10 15:48:12 devstack sudo[88344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:48:14 devstack sudo[88344]: pam_unix(sudo:session): session closed for user root Jul 10 15:48:14 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-615c87e2-2f04-4aaa-a7d2-8e59dbdeacdc tempest-DeleteServersTestJSON-1023489511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d814b47a-d924-4390-8356-84dec4656b09" returned: 0 in 1.957s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:48:14 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-615c87e2-2f04-4aaa-a7d2-8e59dbdeacdc tempest-DeleteServersTestJSON-1023489511 None] <== create_volume: return (4387ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 15:48:14 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-615c87e2-2f04-4aaa-a7d2-8e59dbdeacdc tempest-DeleteServersTestJSON-1023489511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.391s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:48:14 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-615c87e2-2f04-4aaa-a7d2-8e59dbdeacdc tempest-DeleteServersTestJSON-1023489511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b10d9d67-913a-4db2-bc62-a79e70cad625) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d814b47a-d924-4390-8356-84dec4656b09', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:48:14 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-615c87e2-2f04-4aaa-a7d2-8e59dbdeacdc tempest-DeleteServersTestJSON-1023489511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c6c0310-4584-4239-ad58-5fe6bb31fd0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:48:14 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-615c87e2-2f04-4aaa-a7d2-8e59dbdeacdc tempest-DeleteServersTestJSON-1023489511 None] Volume volume-d814b47a-d924-4390-8356-84dec4656b09 (d814b47a-d924-4390-8356-84dec4656b09): created successfully Jul 10 15:48:14 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-615c87e2-2f04-4aaa-a7d2-8e59dbdeacdc tempest-DeleteServersTestJSON-1023489511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c6c0310-4584-4239-ad58-5fe6bb31fd0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:48:14 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-615c87e2-2f04-4aaa-a7d2-8e59dbdeacdc tempest-DeleteServersTestJSON-1023489511 None] Flow 'volume_create_manager' (35265387-bcc4-4ee2-a806-9cbf57ed02e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:48:14 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-615c87e2-2f04-4aaa-a7d2-8e59dbdeacdc tempest-DeleteServersTestJSON-1023489511 None] Created volume successfully. Jul 10 15:48:15 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-12803918-4439-440a-ad55-df6e9ed8efb8 tempest-VolumesAdminNegativeTest-277386917 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 15:48:15 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-12803918-4439-440a-ad55-df6e9ed8efb8 tempest-VolumesAdminNegativeTest-277386917 None] Flow 'volume_create_manager' (78adc87c-becc-4a6f-b6ca-de92336c2cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:48:15 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-12803918-4439-440a-ad55-df6e9ed8efb8 tempest-VolumesAdminNegativeTest-277386917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b945cf42-a213-40ba-8237-86f327c55fe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:48:15 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-12803918-4439-440a-ad55-df6e9ed8efb8 tempest-VolumesAdminNegativeTest-277386917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b945cf42-a213-40ba-8237-86f327c55fe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:48:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1385871246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf692061-d99f-4495-9e22-fb77b7868607,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e0c5513a79740d69b2813dbeb57ce99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:48:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:48:15Z,use_quota=True,user_id='e9a595f40e314dfba6745bbd0a57f591',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:48:15 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-12803918-4439-440a-ad55-df6e9ed8efb8 tempest-VolumesAdminNegativeTest-277386917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8efc827a-0ec6-4971-8a3c-5c38d1067fd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:48:15 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-12803918-4439-440a-ad55-df6e9ed8efb8 tempest-VolumesAdminNegativeTest-277386917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8efc827a-0ec6-4971-8a3c-5c38d1067fd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:48:15 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-12803918-4439-440a-ad55-df6e9ed8efb8 tempest-VolumesAdminNegativeTest-277386917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (736b0c09-b0d9-4e0e-b195-55a86a3c8d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:48:15 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-12803918-4439-440a-ad55-df6e9ed8efb8 tempest-VolumesAdminNegativeTest-277386917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (736b0c09-b0d9-4e0e-b195-55a86a3c8d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf692061-d99f-4495-9e22-fb77b7868607', 'volume_name': 'volume-bf692061-d99f-4495-9e22-fb77b7868607', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:48:15 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-12803918-4439-440a-ad55-df6e9ed8efb8 tempest-VolumesAdminNegativeTest-277386917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c017eee7-6097-4bb5-949d-2b02743d50bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:48:15 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-12803918-4439-440a-ad55-df6e9ed8efb8 tempest-VolumesAdminNegativeTest-277386917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c017eee7-6097-4bb5-949d-2b02743d50bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:48:15 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-12803918-4439-440a-ad55-df6e9ed8efb8 tempest-VolumesAdminNegativeTest-277386917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c6af3fe-bd11-4b0d-95c6-02e366fc2e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:48:15 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-12803918-4439-440a-ad55-df6e9ed8efb8 tempest-VolumesAdminNegativeTest-277386917 None] Volume bf692061-d99f-4495-9e22-fb77b7868607: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf692061-d99f-4495-9e22-fb77b7868607', 'volume_size': 1} Jul 10 15:48:15 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-12803918-4439-440a-ad55-df6e9ed8efb8 tempest-VolumesAdminNegativeTest-277386917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:48:15 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-12803918-4439-440a-ad55-df6e9ed8efb8 tempest-VolumesAdminNegativeTest-277386917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:48:15 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-12803918-4439-440a-ad55-df6e9ed8efb8 tempest-VolumesAdminNegativeTest-277386917 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:48:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1385871246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf692061-d99f-4495-9e22-fb77b7868607,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e0c5513a79740d69b2813dbeb57ce99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:48:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:48:15Z,use_quota=True,user_id='e9a595f40e314dfba6745bbd0a57f591',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 15:48:15 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-12803918-4439-440a-ad55-df6e9ed8efb8 tempest-VolumesAdminNegativeTest-277386917 None] Creating volume bf692061-d99f-4495-9e22-fb77b7868607 {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 15:48:15 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-12803918-4439-440a-ad55-df6e9ed8efb8 tempest-VolumesAdminNegativeTest-277386917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:48:15 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-12803918-4439-440a-ad55-df6e9ed8efb8 tempest-VolumesAdminNegativeTest-277386917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:48:15 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-12803918-4439-440a-ad55-df6e9ed8efb8 tempest-VolumesAdminNegativeTest-277386917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:48:15 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-12803918-4439-440a-ad55-df6e9ed8efb8 tempest-VolumesAdminNegativeTest-277386917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:48:15 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-12803918-4439-440a-ad55-df6e9ed8efb8 tempest-VolumesAdminNegativeTest-277386917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:48:15 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-12803918-4439-440a-ad55-df6e9ed8efb8 tempest-VolumesAdminNegativeTest-277386917 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 15:48:15 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-12803918-4439-440a-ad55-df6e9ed8efb8 tempest-VolumesAdminNegativeTest-277386917 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 15:48:15 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-12803918-4439-440a-ad55-df6e9ed8efb8 tempest-VolumesAdminNegativeTest-277386917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-bf692061-d99f-4495-9e22-fb77b7868607 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:48:15 devstack sudo[88358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-bf692061-d99f-4495-9e22-fb77b7868607 1073741824 Jul 10 15:48:15 devstack sudo[88358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:48:17 devstack cinder-volume[87420]: DEBUG oslo_service.periodic_task [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87420) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 15:48:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:48:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:48:17 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:48:17 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:48:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:48:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:48:17 devstack sudo[88375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 15:48:17 devstack sudo[88375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:48:17 devstack sudo[88358]: pam_unix(sudo:session): session closed for user root Jul 10 15:48:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-12803918-4439-440a-ad55-df6e9ed8efb8 tempest-VolumesAdminNegativeTest-277386917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-bf692061-d99f-4495-9e22-fb77b7868607 1073741824" returned: 0 in 2.042s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:48:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-12803918-4439-440a-ad55-df6e9ed8efb8 tempest-VolumesAdminNegativeTest-277386917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-bf692061-d99f-4495-9e22-fb77b7868607 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:48:17 devstack sudo[88377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-bf692061-d99f-4495-9e22-fb77b7868607 Jul 10 15:48:17 devstack sudo[88377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:48:19 devstack sudo[88375]: pam_unix(sudo:session): session closed for user root Jul 10 15:48:19 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 2.114s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:48:19 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 15:48:19 devstack cinder-volume[87420]: DEBUG oslo_service.periodic_task [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Running periodic task VolumeManager._thread_info {{(pid=87420) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 15:48:19 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] thread count: 6 {{(pid=87420) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 15:48:19 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] thread info: [<_MainThread(MainThread, started 133639250378880)>, , , , , ] {{(pid=87420) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 15:48:19 devstack sudo[88377]: pam_unix(sudo:session): session closed for user root Jul 10 15:48:19 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-12803918-4439-440a-ad55-df6e9ed8efb8 tempest-VolumesAdminNegativeTest-277386917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-bf692061-d99f-4495-9e22-fb77b7868607" returned: 0 in 1.944s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:48:19 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-12803918-4439-440a-ad55-df6e9ed8efb8 tempest-VolumesAdminNegativeTest-277386917 None] <== create_volume: return (4126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 15:48:19 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-12803918-4439-440a-ad55-df6e9ed8efb8 tempest-VolumesAdminNegativeTest-277386917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.131s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:48:19 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-12803918-4439-440a-ad55-df6e9ed8efb8 tempest-VolumesAdminNegativeTest-277386917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c6af3fe-bd11-4b0d-95c6-02e366fc2e7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf692061-d99f-4495-9e22-fb77b7868607', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:48:19 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-12803918-4439-440a-ad55-df6e9ed8efb8 tempest-VolumesAdminNegativeTest-277386917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49df48ba-c71f-461c-814e-56a78038606b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:48:19 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-12803918-4439-440a-ad55-df6e9ed8efb8 tempest-VolumesAdminNegativeTest-277386917 None] Volume volume-bf692061-d99f-4495-9e22-fb77b7868607 (bf692061-d99f-4495-9e22-fb77b7868607): created successfully Jul 10 15:48:19 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-12803918-4439-440a-ad55-df6e9ed8efb8 tempest-VolumesAdminNegativeTest-277386917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49df48ba-c71f-461c-814e-56a78038606b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:48:19 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-12803918-4439-440a-ad55-df6e9ed8efb8 tempest-VolumesAdminNegativeTest-277386917 None] Flow 'volume_create_manager' (78adc87c-becc-4a6f-b6ca-de92336c2cfb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:48:19 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-12803918-4439-440a-ad55-df6e9ed8efb8 tempest-VolumesAdminNegativeTest-277386917 None] Created volume successfully. Jul 10 15:48:22 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-2c08f18a-e8bb-428b-b91d-646b843496c9 tempest-VolumesAdminNegativeTest-277386917 None] Acquiring lock "cinder-bf692061-d99f-4495-9e22-fb77b7868607-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:48:22 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-2c08f18a-e8bb-428b-b91d-646b843496c9 tempest-VolumesAdminNegativeTest-277386917 None] Lock "cinder-bf692061-d99f-4495-9e22-fb77b7868607-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:48:22 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-2c08f18a-e8bb-428b-b91d-646b843496c9 tempest-VolumesAdminNegativeTest-277386917 None] Acquiring lock "cinder-quobyte-bf692061-d99f-4495-9e22-fb77b7868607" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:48:22 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-2c08f18a-e8bb-428b-b91d-646b843496c9 tempest-VolumesAdminNegativeTest-277386917 None] Lock "cinder-quobyte-bf692061-d99f-4495-9e22-fb77b7868607" acquired by "delete_volume" :: waited 0.036s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:48:22 devstack cinder-volume[87420]: INFO oslo.privsep.daemon [None req-2c08f18a-e8bb-428b-b91d-646b843496c9 tempest-VolumesAdminNegativeTest-277386917 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpv5bkh5i1/privsep.sock'] Jul 10 15:48:22 devstack sudo[88476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpv5bkh5i1/privsep.sock Jul 10 15:48:22 devstack sudo[88476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:48:23 devstack cinder-volume[87420]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jul 10 15:48:23 devstack cinder-volume[87420]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 10 15:48:23 devstack cinder-volume[87420]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 10 15:48:23 devstack cinder-volume[87420]: WARNING oslo.privsep.daemon [-] privsep log: Jul 10 15:48:23 devstack cinder-volume[87420]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 10 15:48:23 devstack cinder-volume[87420]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 10 15:48:23 devstack cinder-volume[87420]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 10 15:48:23 devstack cinder-volume[87420]: WARNING oslo.privsep.daemon [-] privsep log: Jul 10 15:48:23 devstack cinder-volume[87420]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jul 10 15:48:24 devstack cinder-volume[87420]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jul 10 15:48:24 devstack cinder-volume[87420]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 10 15:48:24 devstack cinder-volume[87420]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 10 15:48:24 devstack cinder-volume[87420]: WARNING oslo.privsep.daemon [-] privsep log: Jul 10 15:48:24 devstack cinder-volume[87420]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 10 15:48:24 devstack cinder-volume[87420]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 10 15:48:24 devstack cinder-volume[87420]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 10 15:48:24 devstack cinder-volume[87420]: WARNING oslo.privsep.daemon [-] privsep log: Jul 10 15:48:24 devstack cinder-volume[87420]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jul 10 15:48:24 devstack cinder-volume[87420]: WARNING py.warnings [req-3e0960be-0e0c-4d50-b558-664ba5328576 req-aa6c6dfe-b01a-4953-8a37-559a82ee3ca5 tempest-DeleteServersTestJSON-1023489511 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Jul 10 15:48:24 devstack cinder-volume[87420]: .first() Jul 10 15:48:24 devstack cinder-volume[87420]: Jul 10 15:48:24 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [req-3e0960be-0e0c-4d50-b558-664ba5328576 req-aa6c6dfe-b01a-4953-8a37-559a82ee3ca5 tempest-DeleteServersTestJSON-1023489511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:48:24 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [req-3e0960be-0e0c-4d50-b558-664ba5328576 req-aa6c6dfe-b01a-4953-8a37-559a82ee3ca5 tempest-DeleteServersTestJSON-1023489511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:48:24 devstack sudo[88476]: pam_unix(sudo:session): session closed for user root Jul 10 15:48:24 devstack cinder-volume[87420]: INFO oslo.privsep.daemon [None req-2c08f18a-e8bb-428b-b91d-646b843496c9 tempest-VolumesAdminNegativeTest-277386917 None] Spawned new privsep daemon via rootwrap Jul 10 15:48:24 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [None req-2c08f18a-e8bb-428b-b91d-646b843496c9 tempest-VolumesAdminNegativeTest-277386917 None] Accepted privsep connection to /tmp/tmpv5bkh5i1/privsep.sock {{(pid=87420) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 10 15:48:24 devstack cinder-volume[87420]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 10 15:48:24 devstack cinder-volume[87420]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 10 15:48:24 devstack cinder-volume[87420]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 10 15:48:24 devstack cinder-volume[87420]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88516 Jul 10 15:48:24 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa539431-b507-44dc-b86b-dd36a4fce2de]: (2,) {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:48:24 devstack cinder-volume[87420]: WARNING oslo_privsep.priv_context [req-3e0960be-0e0c-4d50-b558-664ba5328576 req-aa6c6dfe-b01a-4953-8a37-559a82ee3ca5 tempest-DeleteServersTestJSON-1023489511 None] privsep daemon already running Jul 10 15:48:24 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[21a07d44-348b-4d66-9dde-2a4fcf194e3c]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:48:24 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-2c08f18a-e8bb-428b-b91d-646b843496c9 tempest-VolumesAdminNegativeTest-277386917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-bf692061-d99f-4495-9e22-fb77b7868607 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:48:24 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc461367-11cf-442b-be44-5c8d96c299f4]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:48:24 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [req-3e0960be-0e0c-4d50-b558-664ba5328576 req-aa6c6dfe-b01a-4953-8a37-559a82ee3ca5 tempest-DeleteServersTestJSON-1023489511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d814b47a-d924-4390-8356-84dec4656b09 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:48:24 devstack sudo[88530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-bf692061-d99f-4495-9e22-fb77b7868607 Jul 10 15:48:24 devstack sudo[88530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:48:25 devstack sudo[88531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d814b47a-d924-4390-8356-84dec4656b09 Jul 10 15:48:25 devstack sudo[88531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:48:26 devstack sudo[88530]: pam_unix(sudo:session): session closed for user root Jul 10 15:48:26 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-2c08f18a-e8bb-428b-b91d-646b843496c9 tempest-VolumesAdminNegativeTest-277386917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-bf692061-d99f-4495-9e22-fb77b7868607" returned: 0 in 1.610s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:48:26 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-2c08f18a-e8bb-428b-b91d-646b843496c9 tempest-VolumesAdminNegativeTest-277386917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-bf692061-d99f-4495-9e22-fb77b7868607 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:48:26 devstack sudo[88553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-bf692061-d99f-4495-9e22-fb77b7868607 Jul 10 15:48:26 devstack sudo[88553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:48:26 devstack sudo[88531]: pam_unix(sudo:session): session closed for user root Jul 10 15:48:26 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [req-3e0960be-0e0c-4d50-b558-664ba5328576 req-aa6c6dfe-b01a-4953-8a37-559a82ee3ca5 tempest-DeleteServersTestJSON-1023489511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d814b47a-d924-4390-8356-84dec4656b09" returned: 0 in 1.968s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:48:26 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [req-3e0960be-0e0c-4d50-b558-664ba5328576 req-aa6c6dfe-b01a-4953-8a37-559a82ee3ca5 tempest-DeleteServersTestJSON-1023489511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.325s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:48:27 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [req-3e0960be-0e0c-4d50-b558-664ba5328576 req-aa6c6dfe-b01a-4953-8a37-559a82ee3ca5 tempest-DeleteServersTestJSON-1023489511 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80', 'name': 'volume-d814b47a-d924-4390-8356-84dec4656b09', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bba4fbcd-d57b-4454-b919-a1b54eed4463', 'enforce_multipath': True} {{(pid=87420) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 15:48:27 devstack cinder-volume[87420]: INFO cinder.volume.manager [req-3e0960be-0e0c-4d50-b558-664ba5328576 req-aa6c6dfe-b01a-4953-8a37-559a82ee3ca5 tempest-DeleteServersTestJSON-1023489511 None] attachment_update completed successfully. Jul 10 15:48:28 devstack sudo[88553]: pam_unix(sudo:session): session closed for user root Jul 10 15:48:28 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-2c08f18a-e8bb-428b-b91d-646b843496c9 tempest-VolumesAdminNegativeTest-277386917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-bf692061-d99f-4495-9e22-fb77b7868607" returned: 0 in 1.709s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:48:28 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-2c08f18a-e8bb-428b-b91d-646b843496c9 tempest-VolumesAdminNegativeTest-277386917 None] Lock "cinder-quobyte-bf692061-d99f-4495-9e22-fb77b7868607" released by "delete_volume" :: held 5.863s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:48:28 devstack cinder-volume[87420]: WARNING cinder.quota [None req-2c08f18a-e8bb-428b-b91d-646b843496c9 tempest-VolumesAdminNegativeTest-277386917 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 10 15:48:28 devstack cinder-volume[87420]: WARNING cinder.quota [None req-2c08f18a-e8bb-428b-b91d-646b843496c9 tempest-VolumesAdminNegativeTest-277386917 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 10 15:48:28 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-2c08f18a-e8bb-428b-b91d-646b843496c9 tempest-VolumesAdminNegativeTest-277386917 None] Created reservations ['e25c083e-1c58-4557-803e-20efe9f24538', '7166c23e-3d58-4286-b4df-da8a4df3cbe3', '8b8dc6e7-4f76-440a-809b-4b4d3c84a802', 'cc7f5acd-ef03-46b8-9eb3-3f1caa336f72'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 15:48:28 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-2c08f18a-e8bb-428b-b91d-646b843496c9 tempest-VolumesAdminNegativeTest-277386917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:48:28 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-2c08f18a-e8bb-428b-b91d-646b843496c9 tempest-VolumesAdminNegativeTest-277386917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:48:28 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-2c08f18a-e8bb-428b-b91d-646b843496c9 tempest-VolumesAdminNegativeTest-277386917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:48:28 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-2c08f18a-e8bb-428b-b91d-646b843496c9 tempest-VolumesAdminNegativeTest-277386917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:48:28 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-2c08f18a-e8bb-428b-b91d-646b843496c9 tempest-VolumesAdminNegativeTest-277386917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:48:28 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-2c08f18a-e8bb-428b-b91d-646b843496c9 tempest-VolumesAdminNegativeTest-277386917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:48:28 devstack sudo[88561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 15:48:28 devstack sudo[88561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:48:30 devstack sudo[88561]: pam_unix(sudo:session): session closed for user root Jul 10 15:48:30 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-2c08f18a-e8bb-428b-b91d-646b843496c9 tempest-VolumesAdminNegativeTest-277386917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 1.996s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:48:30 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-2c08f18a-e8bb-428b-b91d-646b843496c9 tempest-VolumesAdminNegativeTest-277386917 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 15:48:30 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-2c08f18a-e8bb-428b-b91d-646b843496c9 tempest-VolumesAdminNegativeTest-277386917 None] Deleted volume successfully. Jul 10 15:48:30 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-2c08f18a-e8bb-428b-b91d-646b843496c9 tempest-VolumesAdminNegativeTest-277386917 None] Lock "cinder-bf692061-d99f-4495-9e22-fb77b7868607-delete_volume" released by "delete_volume" :: held 8.445s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:48:38 devstack cinder-volume[87420]: DEBUG dbcounter [-] [87420] Writing DB stats cinder:SELECT=17,cinder:INSERT=4,cinder:UPDATE=13,cinder:DELETE=1 {{(pid=87420) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 15:48:40 devstack cinder-volume[87420]: DEBUG dbcounter [-] [87420] Writing DB stats cinder:SELECT=12,cinder:UPDATE=18,cinder:DELETE=2,cinder:INSERT=2 {{(pid=87420) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 15:48:40 devstack cinder-volume[87420]: INFO cinder.volume.manager [req-653b045e-4886-4d1c-90bb-947f96aabf6a req-3076f507-5727-4748-ada8-63adb57dd280 tempest-DeleteServersTestJSON-1023489511 None] Terminate volume connection completed successfully. Jul 10 15:48:40 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [req-653b045e-4886-4d1c-90bb-947f96aabf6a req-3076f507-5727-4748-ada8-63adb57dd280 tempest-DeleteServersTestJSON-1023489511 None] Deleting attachment bba4fbcd-d57b-4454-b919-a1b54eed4463. {{(pid=87420) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 15:48:42 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1de021f-0523-4d63-aec1-d231e15c2a17 tempest-ServersNegativeTestJSON-447045243 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 15:48:42 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-e1de021f-0523-4d63-aec1-d231e15c2a17 tempest-ServersNegativeTestJSON-447045243 None] Flow 'volume_create_manager' (81770b1b-3e2d-438b-9dd4-2ad65bd4ced7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:48:42 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-e1de021f-0523-4d63-aec1-d231e15c2a17 tempest-ServersNegativeTestJSON-447045243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6edaf61d-3a26-4f7e-b6cf-f82cbe767f36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:48:42 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-e1de021f-0523-4d63-aec1-d231e15c2a17 tempest-ServersNegativeTestJSON-447045243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6edaf61d-3a26-4f7e-b6cf-f82cbe767f36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:48:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-219645095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a29eae2-11ff-42ca-9c7c-0b8a3ef45ef0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='885a57b4eb1a45a09a23fd68037ea224',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:48:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:48:43Z,use_quota=True,user_id='a1cb15a72fd74dec96fafe2eb7fe3d7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:48:42 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-e1de021f-0523-4d63-aec1-d231e15c2a17 tempest-ServersNegativeTestJSON-447045243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53bf89b6-c4ad-4630-b569-d5175bc63524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:48:42 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-e1de021f-0523-4d63-aec1-d231e15c2a17 tempest-ServersNegativeTestJSON-447045243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53bf89b6-c4ad-4630-b569-d5175bc63524) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:48:42 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-e1de021f-0523-4d63-aec1-d231e15c2a17 tempest-ServersNegativeTestJSON-447045243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6a150db-9587-43a2-8e6a-c4142f09f6b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:48:42 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-e1de021f-0523-4d63-aec1-d231e15c2a17 tempest-ServersNegativeTestJSON-447045243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6a150db-9587-43a2-8e6a-c4142f09f6b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a29eae2-11ff-42ca-9c7c-0b8a3ef45ef0', 'volume_name': 'volume-1a29eae2-11ff-42ca-9c7c-0b8a3ef45ef0', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:48:42 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-e1de021f-0523-4d63-aec1-d231e15c2a17 tempest-ServersNegativeTestJSON-447045243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9cb48b0-c662-42f8-aaae-6b011522befc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:48:42 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-e1de021f-0523-4d63-aec1-d231e15c2a17 tempest-ServersNegativeTestJSON-447045243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9cb48b0-c662-42f8-aaae-6b011522befc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:48:42 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-e1de021f-0523-4d63-aec1-d231e15c2a17 tempest-ServersNegativeTestJSON-447045243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cafbede2-53b3-4ab3-a389-d567ef1386ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:48:42 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-e1de021f-0523-4d63-aec1-d231e15c2a17 tempest-ServersNegativeTestJSON-447045243 None] Volume 1a29eae2-11ff-42ca-9c7c-0b8a3ef45ef0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a29eae2-11ff-42ca-9c7c-0b8a3ef45ef0', 'volume_size': 1} Jul 10 15:48:42 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-e1de021f-0523-4d63-aec1-d231e15c2a17 tempest-ServersNegativeTestJSON-447045243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:48:42 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-e1de021f-0523-4d63-aec1-d231e15c2a17 tempest-ServersNegativeTestJSON-447045243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:48:42 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-e1de021f-0523-4d63-aec1-d231e15c2a17 tempest-ServersNegativeTestJSON-447045243 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:48:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-219645095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a29eae2-11ff-42ca-9c7c-0b8a3ef45ef0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='885a57b4eb1a45a09a23fd68037ea224',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:48:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:48:43Z,use_quota=True,user_id='a1cb15a72fd74dec96fafe2eb7fe3d7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 15:48:42 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-e1de021f-0523-4d63-aec1-d231e15c2a17 tempest-ServersNegativeTestJSON-447045243 None] Creating volume 1a29eae2-11ff-42ca-9c7c-0b8a3ef45ef0 {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 15:48:42 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-e1de021f-0523-4d63-aec1-d231e15c2a17 tempest-ServersNegativeTestJSON-447045243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:48:42 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-e1de021f-0523-4d63-aec1-d231e15c2a17 tempest-ServersNegativeTestJSON-447045243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:48:42 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-e1de021f-0523-4d63-aec1-d231e15c2a17 tempest-ServersNegativeTestJSON-447045243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:48:42 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-e1de021f-0523-4d63-aec1-d231e15c2a17 tempest-ServersNegativeTestJSON-447045243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:48:42 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-e1de021f-0523-4d63-aec1-d231e15c2a17 tempest-ServersNegativeTestJSON-447045243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:48:42 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-e1de021f-0523-4d63-aec1-d231e15c2a17 tempest-ServersNegativeTestJSON-447045243 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 15:48:42 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-e1de021f-0523-4d63-aec1-d231e15c2a17 tempest-ServersNegativeTestJSON-447045243 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 15:48:42 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-e1de021f-0523-4d63-aec1-d231e15c2a17 tempest-ServersNegativeTestJSON-447045243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1a29eae2-11ff-42ca-9c7c-0b8a3ef45ef0 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:48:42 devstack sudo[89070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1a29eae2-11ff-42ca-9c7c-0b8a3ef45ef0 1073741824 Jul 10 15:48:42 devstack sudo[89070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:48:43 devstack sudo[89070]: pam_unix(sudo:session): session closed for user root Jul 10 15:48:43 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-e1de021f-0523-4d63-aec1-d231e15c2a17 tempest-ServersNegativeTestJSON-447045243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1a29eae2-11ff-42ca-9c7c-0b8a3ef45ef0 1073741824" returned: 0 in 1.201s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:48:43 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-e1de021f-0523-4d63-aec1-d231e15c2a17 tempest-ServersNegativeTestJSON-447045243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1a29eae2-11ff-42ca-9c7c-0b8a3ef45ef0 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:48:43 devstack sudo[89082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1a29eae2-11ff-42ca-9c7c-0b8a3ef45ef0 Jul 10 15:48:43 devstack sudo[89082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:48:44 devstack sudo[89082]: pam_unix(sudo:session): session closed for user root Jul 10 15:48:44 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-e1de021f-0523-4d63-aec1-d231e15c2a17 tempest-ServersNegativeTestJSON-447045243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1a29eae2-11ff-42ca-9c7c-0b8a3ef45ef0" returned: 0 in 0.718s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:48:44 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-e1de021f-0523-4d63-aec1-d231e15c2a17 tempest-ServersNegativeTestJSON-447045243 None] <== create_volume: return (1973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 15:48:44 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-e1de021f-0523-4d63-aec1-d231e15c2a17 tempest-ServersNegativeTestJSON-447045243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.976s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:48:44 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-e1de021f-0523-4d63-aec1-d231e15c2a17 tempest-ServersNegativeTestJSON-447045243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cafbede2-53b3-4ab3-a389-d567ef1386ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a29eae2-11ff-42ca-9c7c-0b8a3ef45ef0', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:48:44 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-e1de021f-0523-4d63-aec1-d231e15c2a17 tempest-ServersNegativeTestJSON-447045243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (216500d9-3fdf-4bbb-8640-a97f47789cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:48:44 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-e1de021f-0523-4d63-aec1-d231e15c2a17 tempest-ServersNegativeTestJSON-447045243 None] Volume volume-1a29eae2-11ff-42ca-9c7c-0b8a3ef45ef0 (1a29eae2-11ff-42ca-9c7c-0b8a3ef45ef0): created successfully Jul 10 15:48:44 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-e1de021f-0523-4d63-aec1-d231e15c2a17 tempest-ServersNegativeTestJSON-447045243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (216500d9-3fdf-4bbb-8640-a97f47789cac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:48:44 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-e1de021f-0523-4d63-aec1-d231e15c2a17 tempest-ServersNegativeTestJSON-447045243 None] Flow 'volume_create_manager' (81770b1b-3e2d-438b-9dd4-2ad65bd4ced7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:48:44 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-e1de021f-0523-4d63-aec1-d231e15c2a17 tempest-ServersNegativeTestJSON-447045243 None] Created volume successfully. Jul 10 15:48:45 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-4e6cd8cb-c11f-4339-9321-69c7a6a570cc tempest-DeleteServersTestJSON-1023489511 None] Acquiring lock "cinder-d814b47a-d924-4390-8356-84dec4656b09-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:48:45 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-4e6cd8cb-c11f-4339-9321-69c7a6a570cc tempest-DeleteServersTestJSON-1023489511 None] Lock "cinder-d814b47a-d924-4390-8356-84dec4656b09-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:48:45 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-4e6cd8cb-c11f-4339-9321-69c7a6a570cc tempest-DeleteServersTestJSON-1023489511 None] Acquiring lock "cinder-quobyte-d814b47a-d924-4390-8356-84dec4656b09" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:48:45 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-4e6cd8cb-c11f-4339-9321-69c7a6a570cc tempest-DeleteServersTestJSON-1023489511 None] Lock "cinder-quobyte-d814b47a-d924-4390-8356-84dec4656b09" acquired by "delete_volume" :: waited 0.022s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:48:45 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[720355c4-bd78-43d9-9b91-68afa8f1db01]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:48:45 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4e6cd8cb-c11f-4339-9321-69c7a6a570cc tempest-DeleteServersTestJSON-1023489511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d814b47a-d924-4390-8356-84dec4656b09 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:48:45 devstack sudo[89089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d814b47a-d924-4390-8356-84dec4656b09 Jul 10 15:48:45 devstack sudo[89089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:48:45 devstack sudo[89089]: pam_unix(sudo:session): session closed for user root Jul 10 15:48:45 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4e6cd8cb-c11f-4339-9321-69c7a6a570cc tempest-DeleteServersTestJSON-1023489511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d814b47a-d924-4390-8356-84dec4656b09" returned: 0 in 0.816s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:48:45 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4e6cd8cb-c11f-4339-9321-69c7a6a570cc tempest-DeleteServersTestJSON-1023489511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d814b47a-d924-4390-8356-84dec4656b09 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:48:45 devstack sudo[89097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d814b47a-d924-4390-8356-84dec4656b09 Jul 10 15:48:45 devstack sudo[89097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:48:46 devstack sudo[89097]: pam_unix(sudo:session): session closed for user root Jul 10 15:48:46 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4e6cd8cb-c11f-4339-9321-69c7a6a570cc tempest-DeleteServersTestJSON-1023489511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d814b47a-d924-4390-8356-84dec4656b09" returned: 0 in 0.821s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:48:46 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-4e6cd8cb-c11f-4339-9321-69c7a6a570cc tempest-DeleteServersTestJSON-1023489511 None] Lock "cinder-quobyte-d814b47a-d924-4390-8356-84dec4656b09" released by "delete_volume" :: held 1.730s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:48:46 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-4e6cd8cb-c11f-4339-9321-69c7a6a570cc tempest-DeleteServersTestJSON-1023489511 None] Created reservations ['d75da3e0-6ea5-445c-a46b-c1435a4d247c', '57e17674-2c28-4088-82da-1bcaa9b38ed8', 'e3d963dc-0061-4425-8a5f-f1275ca4513b', 'bcd4bef9-27b4-4d6d-8670-3b300ea7510d'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 15:48:46 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-4e6cd8cb-c11f-4339-9321-69c7a6a570cc tempest-DeleteServersTestJSON-1023489511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:48:46 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-4e6cd8cb-c11f-4339-9321-69c7a6a570cc tempest-DeleteServersTestJSON-1023489511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:48:46 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-4e6cd8cb-c11f-4339-9321-69c7a6a570cc tempest-DeleteServersTestJSON-1023489511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:48:46 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-4e6cd8cb-c11f-4339-9321-69c7a6a570cc tempest-DeleteServersTestJSON-1023489511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:48:46 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-4e6cd8cb-c11f-4339-9321-69c7a6a570cc tempest-DeleteServersTestJSON-1023489511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:48:46 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4e6cd8cb-c11f-4339-9321-69c7a6a570cc tempest-DeleteServersTestJSON-1023489511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:48:47 devstack sudo[89102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 15:48:47 devstack sudo[89102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:48:47 devstack sudo[89102]: pam_unix(sudo:session): session closed for user root Jul 10 15:48:47 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4e6cd8cb-c11f-4339-9321-69c7a6a570cc tempest-DeleteServersTestJSON-1023489511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.896s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:48:47 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-4e6cd8cb-c11f-4339-9321-69c7a6a570cc tempest-DeleteServersTestJSON-1023489511 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 15:48:47 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-4e6cd8cb-c11f-4339-9321-69c7a6a570cc tempest-DeleteServersTestJSON-1023489511 None] Deleted volume successfully. Jul 10 15:48:47 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-4e6cd8cb-c11f-4339-9321-69c7a6a570cc tempest-DeleteServersTestJSON-1023489511 None] Lock "cinder-d814b47a-d924-4390-8356-84dec4656b09-delete_volume" released by "delete_volume" :: held 2.926s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:48:49 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-654d6b02-5764-422d-9d57-753306f2579f tempest-ServersNegativeTestJSON-447045243 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 15:48:50 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-654d6b02-5764-422d-9d57-753306f2579f tempest-ServersNegativeTestJSON-447045243 None] Flow 'volume_create_manager' (72f31405-659c-4ddd-afe5-81ed6069cb5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:48:50 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-654d6b02-5764-422d-9d57-753306f2579f tempest-ServersNegativeTestJSON-447045243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (034f9547-97d6-4c8a-b464-69700e595873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:48:50 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-654d6b02-5764-422d-9d57-753306f2579f tempest-ServersNegativeTestJSON-447045243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (034f9547-97d6-4c8a-b464-69700e595873) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:48:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1337921465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dd8450d-5cf1-4bf3-b858-104dd2463ed0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='885a57b4eb1a45a09a23fd68037ea224',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:48:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:48:50Z,use_quota=True,user_id='a1cb15a72fd74dec96fafe2eb7fe3d7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:48:50 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-654d6b02-5764-422d-9d57-753306f2579f tempest-ServersNegativeTestJSON-447045243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8bfb320-f952-449d-bd7a-e4d2dbbc8249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:48:50 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-654d6b02-5764-422d-9d57-753306f2579f tempest-ServersNegativeTestJSON-447045243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8bfb320-f952-449d-bd7a-e4d2dbbc8249) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:48:50 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-654d6b02-5764-422d-9d57-753306f2579f tempest-ServersNegativeTestJSON-447045243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c7403ae-75f1-4d4d-b667-8963c4963e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:48:50 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-654d6b02-5764-422d-9d57-753306f2579f tempest-ServersNegativeTestJSON-447045243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c7403ae-75f1-4d4d-b667-8963c4963e20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3dd8450d-5cf1-4bf3-b858-104dd2463ed0', 'volume_name': 'volume-3dd8450d-5cf1-4bf3-b858-104dd2463ed0', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:48:50 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-654d6b02-5764-422d-9d57-753306f2579f tempest-ServersNegativeTestJSON-447045243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (801f165e-c6ab-4772-b2b9-967aa3e9a6cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:48:50 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-654d6b02-5764-422d-9d57-753306f2579f tempest-ServersNegativeTestJSON-447045243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (801f165e-c6ab-4772-b2b9-967aa3e9a6cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:48:50 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-654d6b02-5764-422d-9d57-753306f2579f tempest-ServersNegativeTestJSON-447045243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cf68624-5e4c-46e5-bbbb-b8c22c5c862a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:48:50 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-654d6b02-5764-422d-9d57-753306f2579f tempest-ServersNegativeTestJSON-447045243 None] Volume 3dd8450d-5cf1-4bf3-b858-104dd2463ed0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3dd8450d-5cf1-4bf3-b858-104dd2463ed0', 'volume_size': 1} Jul 10 15:48:50 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-654d6b02-5764-422d-9d57-753306f2579f tempest-ServersNegativeTestJSON-447045243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:48:50 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-654d6b02-5764-422d-9d57-753306f2579f tempest-ServersNegativeTestJSON-447045243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:48:50 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-654d6b02-5764-422d-9d57-753306f2579f tempest-ServersNegativeTestJSON-447045243 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:48:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1337921465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dd8450d-5cf1-4bf3-b858-104dd2463ed0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='885a57b4eb1a45a09a23fd68037ea224',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:48:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:48:50Z,use_quota=True,user_id='a1cb15a72fd74dec96fafe2eb7fe3d7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 15:48:50 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-654d6b02-5764-422d-9d57-753306f2579f tempest-ServersNegativeTestJSON-447045243 None] Creating volume 3dd8450d-5cf1-4bf3-b858-104dd2463ed0 {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 15:48:50 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-654d6b02-5764-422d-9d57-753306f2579f tempest-ServersNegativeTestJSON-447045243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:48:50 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-654d6b02-5764-422d-9d57-753306f2579f tempest-ServersNegativeTestJSON-447045243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:48:50 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-654d6b02-5764-422d-9d57-753306f2579f tempest-ServersNegativeTestJSON-447045243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:48:50 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-654d6b02-5764-422d-9d57-753306f2579f tempest-ServersNegativeTestJSON-447045243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:48:50 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-654d6b02-5764-422d-9d57-753306f2579f tempest-ServersNegativeTestJSON-447045243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:48:50 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-654d6b02-5764-422d-9d57-753306f2579f tempest-ServersNegativeTestJSON-447045243 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 15:48:50 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-654d6b02-5764-422d-9d57-753306f2579f tempest-ServersNegativeTestJSON-447045243 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 15:48:50 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-654d6b02-5764-422d-9d57-753306f2579f tempest-ServersNegativeTestJSON-447045243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3dd8450d-5cf1-4bf3-b858-104dd2463ed0 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:48:50 devstack sudo[89127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3dd8450d-5cf1-4bf3-b858-104dd2463ed0 1073741824 Jul 10 15:48:50 devstack sudo[89127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:48:51 devstack sudo[89127]: pam_unix(sudo:session): session closed for user root Jul 10 15:48:51 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-654d6b02-5764-422d-9d57-753306f2579f tempest-ServersNegativeTestJSON-447045243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3dd8450d-5cf1-4bf3-b858-104dd2463ed0 1073741824" returned: 0 in 1.001s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:48:51 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-654d6b02-5764-422d-9d57-753306f2579f tempest-ServersNegativeTestJSON-447045243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3dd8450d-5cf1-4bf3-b858-104dd2463ed0 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:48:51 devstack sudo[89149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3dd8450d-5cf1-4bf3-b858-104dd2463ed0 Jul 10 15:48:51 devstack sudo[89149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:48:51 devstack sudo[89149]: pam_unix(sudo:session): session closed for user root Jul 10 15:48:51 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-654d6b02-5764-422d-9d57-753306f2579f tempest-ServersNegativeTestJSON-447045243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3dd8450d-5cf1-4bf3-b858-104dd2463ed0" returned: 0 in 0.715s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:48:51 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-654d6b02-5764-422d-9d57-753306f2579f tempest-ServersNegativeTestJSON-447045243 None] <== create_volume: return (1768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 15:48:51 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-654d6b02-5764-422d-9d57-753306f2579f tempest-ServersNegativeTestJSON-447045243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.772s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:48:51 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-654d6b02-5764-422d-9d57-753306f2579f tempest-ServersNegativeTestJSON-447045243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cf68624-5e4c-46e5-bbbb-b8c22c5c862a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3dd8450d-5cf1-4bf3-b858-104dd2463ed0', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:48:51 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-654d6b02-5764-422d-9d57-753306f2579f tempest-ServersNegativeTestJSON-447045243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42822962-f4e8-4037-a8ce-bba76d60525f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:48:51 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-654d6b02-5764-422d-9d57-753306f2579f tempest-ServersNegativeTestJSON-447045243 None] Volume volume-3dd8450d-5cf1-4bf3-b858-104dd2463ed0 (3dd8450d-5cf1-4bf3-b858-104dd2463ed0): created successfully Jul 10 15:48:51 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-654d6b02-5764-422d-9d57-753306f2579f tempest-ServersNegativeTestJSON-447045243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42822962-f4e8-4037-a8ce-bba76d60525f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:48:51 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-654d6b02-5764-422d-9d57-753306f2579f tempest-ServersNegativeTestJSON-447045243 None] Flow 'volume_create_manager' (72f31405-659c-4ddd-afe5-81ed6069cb5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:48:51 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-654d6b02-5764-422d-9d57-753306f2579f tempest-ServersNegativeTestJSON-447045243 None] Created volume successfully. Jul 10 15:48:53 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-7d03e8bb-faae-410e-8f9b-3c8826424f23 tempest-ServersNegativeTestJSON-447045243 None] Acquiring lock "cinder-3dd8450d-5cf1-4bf3-b858-104dd2463ed0-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:48:53 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-7d03e8bb-faae-410e-8f9b-3c8826424f23 tempest-ServersNegativeTestJSON-447045243 None] Lock "cinder-3dd8450d-5cf1-4bf3-b858-104dd2463ed0-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:48:53 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-7d03e8bb-faae-410e-8f9b-3c8826424f23 tempest-ServersNegativeTestJSON-447045243 None] Acquiring lock "cinder-quobyte-3dd8450d-5cf1-4bf3-b858-104dd2463ed0" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:48:53 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-7d03e8bb-faae-410e-8f9b-3c8826424f23 tempest-ServersNegativeTestJSON-447045243 None] Lock "cinder-quobyte-3dd8450d-5cf1-4bf3-b858-104dd2463ed0" acquired by "delete_volume" :: waited 0.014s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:48:53 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[456434e2-a304-4886-ade7-f7afec518281]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:48:53 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-7d03e8bb-faae-410e-8f9b-3c8826424f23 tempest-ServersNegativeTestJSON-447045243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3dd8450d-5cf1-4bf3-b858-104dd2463ed0 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:48:53 devstack sudo[89166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3dd8450d-5cf1-4bf3-b858-104dd2463ed0 Jul 10 15:48:53 devstack sudo[89166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:48:54 devstack sudo[89166]: pam_unix(sudo:session): session closed for user root Jul 10 15:48:54 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-7d03e8bb-faae-410e-8f9b-3c8826424f23 tempest-ServersNegativeTestJSON-447045243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3dd8450d-5cf1-4bf3-b858-104dd2463ed0" returned: 0 in 1.060s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:48:54 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-7d03e8bb-faae-410e-8f9b-3c8826424f23 tempest-ServersNegativeTestJSON-447045243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3dd8450d-5cf1-4bf3-b858-104dd2463ed0 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:48:54 devstack sudo[89172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3dd8450d-5cf1-4bf3-b858-104dd2463ed0 Jul 10 15:48:54 devstack sudo[89172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:48:55 devstack sudo[89172]: pam_unix(sudo:session): session closed for user root Jul 10 15:48:55 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-7d03e8bb-faae-410e-8f9b-3c8826424f23 tempest-ServersNegativeTestJSON-447045243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3dd8450d-5cf1-4bf3-b858-104dd2463ed0" returned: 0 in 0.832s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:48:55 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-7d03e8bb-faae-410e-8f9b-3c8826424f23 tempest-ServersNegativeTestJSON-447045243 None] Lock "cinder-quobyte-3dd8450d-5cf1-4bf3-b858-104dd2463ed0" released by "delete_volume" :: held 1.951s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:48:55 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-7d03e8bb-faae-410e-8f9b-3c8826424f23 tempest-ServersNegativeTestJSON-447045243 None] Created reservations ['500b57cf-ced9-4354-b095-c5d0b0476676', '9a68402e-6d3e-45ac-bb1f-42112e9c0bd6', 'aca0ef5c-38c3-4603-b834-a96454faaefa', 'd5588858-46e4-47db-86bf-81d6c1b1574c'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 15:48:55 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-7d03e8bb-faae-410e-8f9b-3c8826424f23 tempest-ServersNegativeTestJSON-447045243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:48:55 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-7d03e8bb-faae-410e-8f9b-3c8826424f23 tempest-ServersNegativeTestJSON-447045243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:48:55 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-7d03e8bb-faae-410e-8f9b-3c8826424f23 tempest-ServersNegativeTestJSON-447045243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:48:55 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-7d03e8bb-faae-410e-8f9b-3c8826424f23 tempest-ServersNegativeTestJSON-447045243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:48:55 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-7d03e8bb-faae-410e-8f9b-3c8826424f23 tempest-ServersNegativeTestJSON-447045243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:48:55 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-7d03e8bb-faae-410e-8f9b-3c8826424f23 tempest-ServersNegativeTestJSON-447045243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:48:55 devstack sudo[89176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 15:48:55 devstack sudo[89176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:48:55 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-dce97df3-af18-4c6e-96f0-50c679765cb2 tempest-ServersNegativeTestJSON-447045243 None] Acquiring lock "cinder-1a29eae2-11ff-42ca-9c7c-0b8a3ef45ef0-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:48:55 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-dce97df3-af18-4c6e-96f0-50c679765cb2 tempest-ServersNegativeTestJSON-447045243 None] Lock "cinder-1a29eae2-11ff-42ca-9c7c-0b8a3ef45ef0-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:48:55 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-dce97df3-af18-4c6e-96f0-50c679765cb2 tempest-ServersNegativeTestJSON-447045243 None] Acquiring lock "cinder-quobyte-1a29eae2-11ff-42ca-9c7c-0b8a3ef45ef0" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:48:55 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-dce97df3-af18-4c6e-96f0-50c679765cb2 tempest-ServersNegativeTestJSON-447045243 None] Lock "cinder-quobyte-1a29eae2-11ff-42ca-9c7c-0b8a3ef45ef0" acquired by "delete_volume" :: waited 0.034s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:48:55 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[401a35e1-cce9-40d6-a34d-05dad286602c]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:48:55 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-dce97df3-af18-4c6e-96f0-50c679765cb2 tempest-ServersNegativeTestJSON-447045243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1a29eae2-11ff-42ca-9c7c-0b8a3ef45ef0 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:48:56 devstack sudo[89178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1a29eae2-11ff-42ca-9c7c-0b8a3ef45ef0 Jul 10 15:48:56 devstack sudo[89178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:48:56 devstack sudo[89176]: pam_unix(sudo:session): session closed for user root Jul 10 15:48:56 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-7d03e8bb-faae-410e-8f9b-3c8826424f23 tempest-ServersNegativeTestJSON-447045243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 1.379s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:48:56 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-7d03e8bb-faae-410e-8f9b-3c8826424f23 tempest-ServersNegativeTestJSON-447045243 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 15:48:56 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-7d03e8bb-faae-410e-8f9b-3c8826424f23 tempest-ServersNegativeTestJSON-447045243 None] Deleted volume successfully. Jul 10 15:48:56 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-7d03e8bb-faae-410e-8f9b-3c8826424f23 tempest-ServersNegativeTestJSON-447045243 None] Lock "cinder-3dd8450d-5cf1-4bf3-b858-104dd2463ed0-delete_volume" released by "delete_volume" :: held 3.672s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:48:57 devstack sudo[89178]: pam_unix(sudo:session): session closed for user root Jul 10 15:48:57 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-dce97df3-af18-4c6e-96f0-50c679765cb2 tempest-ServersNegativeTestJSON-447045243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1a29eae2-11ff-42ca-9c7c-0b8a3ef45ef0" returned: 0 in 1.551s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:48:57 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-dce97df3-af18-4c6e-96f0-50c679765cb2 tempest-ServersNegativeTestJSON-447045243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1a29eae2-11ff-42ca-9c7c-0b8a3ef45ef0 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:48:57 devstack sudo[89232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1a29eae2-11ff-42ca-9c7c-0b8a3ef45ef0 Jul 10 15:48:57 devstack sudo[89232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:48:58 devstack sudo[89232]: pam_unix(sudo:session): session closed for user root Jul 10 15:48:58 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-dce97df3-af18-4c6e-96f0-50c679765cb2 tempest-ServersNegativeTestJSON-447045243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1a29eae2-11ff-42ca-9c7c-0b8a3ef45ef0" returned: 0 in 1.024s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:48:58 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-dce97df3-af18-4c6e-96f0-50c679765cb2 tempest-ServersNegativeTestJSON-447045243 None] Lock "cinder-quobyte-1a29eae2-11ff-42ca-9c7c-0b8a3ef45ef0" released by "delete_volume" :: held 2.660s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:48:58 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-dce97df3-af18-4c6e-96f0-50c679765cb2 tempest-ServersNegativeTestJSON-447045243 None] Created reservations ['c0b7c483-0493-441f-8938-f845a0614f64', '9a17b309-7d23-4cbe-864c-f91a357645be', '5510a338-9caa-4c37-ac8a-f4027e514811', '2ef63604-4eb5-4f40-bd07-97a93399ce5a'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 15:48:58 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-dce97df3-af18-4c6e-96f0-50c679765cb2 tempest-ServersNegativeTestJSON-447045243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:48:58 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-dce97df3-af18-4c6e-96f0-50c679765cb2 tempest-ServersNegativeTestJSON-447045243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:48:58 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-dce97df3-af18-4c6e-96f0-50c679765cb2 tempest-ServersNegativeTestJSON-447045243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:48:58 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-dce97df3-af18-4c6e-96f0-50c679765cb2 tempest-ServersNegativeTestJSON-447045243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:48:58 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-dce97df3-af18-4c6e-96f0-50c679765cb2 tempest-ServersNegativeTestJSON-447045243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:48:58 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-dce97df3-af18-4c6e-96f0-50c679765cb2 tempest-ServersNegativeTestJSON-447045243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:48:58 devstack sudo[89274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 15:48:58 devstack sudo[89274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:49:00 devstack sudo[89274]: pam_unix(sudo:session): session closed for user root Jul 10 15:49:00 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-dce97df3-af18-4c6e-96f0-50c679765cb2 tempest-ServersNegativeTestJSON-447045243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 1.694s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:49:00 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-dce97df3-af18-4c6e-96f0-50c679765cb2 tempest-ServersNegativeTestJSON-447045243 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 15:49:00 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-dce97df3-af18-4c6e-96f0-50c679765cb2 tempest-ServersNegativeTestJSON-447045243 None] Deleted volume successfully. Jul 10 15:49:00 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-dce97df3-af18-4c6e-96f0-50c679765cb2 tempest-ServersNegativeTestJSON-447045243 None] Lock "cinder-1a29eae2-11ff-42ca-9c7c-0b8a3ef45ef0-delete_volume" released by "delete_volume" :: held 4.786s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:49:00 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-7147562f-106c-4189-945f-adb313d0dad8 tempest-VolumesTestJSON-729853637 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 15:49:00 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-7147562f-106c-4189-945f-adb313d0dad8 tempest-VolumesTestJSON-729853637 None] Flow 'volume_create_manager' (3eb290f4-a683-4882-8c73-ce9f08759f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:49:00 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-7147562f-106c-4189-945f-adb313d0dad8 tempest-VolumesTestJSON-729853637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (175a28a6-123a-4da2-ab34-ea4b93d29368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:49:00 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-7147562f-106c-4189-945f-adb313d0dad8 tempest-VolumesTestJSON-729853637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (175a28a6-123a-4da2-ab34-ea4b93d29368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:49:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1610807360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a90e1db0-c7ae-432d-9be0-0da6c65a78da,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9f771a73a8b042d7bfa0fd4bf65289e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:49:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:49:01Z,use_quota=True,user_id='dbd42d62e60041c684f8a7b09acbcdfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:49:00 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-7147562f-106c-4189-945f-adb313d0dad8 tempest-VolumesTestJSON-729853637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8ef2bc5-ff47-4aa5-b2bd-a76d3d64c15d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:49:00 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-7147562f-106c-4189-945f-adb313d0dad8 tempest-VolumesTestJSON-729853637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8ef2bc5-ff47-4aa5-b2bd-a76d3d64c15d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:49:00 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-7147562f-106c-4189-945f-adb313d0dad8 tempest-VolumesTestJSON-729853637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fe58a37-8c71-4d60-9b2f-d8b658b9c65e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:49:00 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-7147562f-106c-4189-945f-adb313d0dad8 tempest-VolumesTestJSON-729853637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fe58a37-8c71-4d60-9b2f-d8b658b9c65e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a90e1db0-c7ae-432d-9be0-0da6c65a78da', 'volume_name': 'volume-a90e1db0-c7ae-432d-9be0-0da6c65a78da', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:49:00 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-7147562f-106c-4189-945f-adb313d0dad8 tempest-VolumesTestJSON-729853637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (871b3d10-2f50-40a0-90f8-39f5060ce726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:49:01 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-7147562f-106c-4189-945f-adb313d0dad8 tempest-VolumesTestJSON-729853637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (871b3d10-2f50-40a0-90f8-39f5060ce726) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:49:01 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-7147562f-106c-4189-945f-adb313d0dad8 tempest-VolumesTestJSON-729853637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3970cc73-ff22-4bd0-8146-02e3611f5900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:49:01 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-7147562f-106c-4189-945f-adb313d0dad8 tempest-VolumesTestJSON-729853637 None] Volume a90e1db0-c7ae-432d-9be0-0da6c65a78da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a90e1db0-c7ae-432d-9be0-0da6c65a78da', 'volume_size': 1} Jul 10 15:49:01 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-7147562f-106c-4189-945f-adb313d0dad8 tempest-VolumesTestJSON-729853637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:49:01 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-7147562f-106c-4189-945f-adb313d0dad8 tempest-VolumesTestJSON-729853637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:49:01 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-7147562f-106c-4189-945f-adb313d0dad8 tempest-VolumesTestJSON-729853637 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:49:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1610807360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a90e1db0-c7ae-432d-9be0-0da6c65a78da,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9f771a73a8b042d7bfa0fd4bf65289e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:49:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:49:01Z,use_quota=True,user_id='dbd42d62e60041c684f8a7b09acbcdfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 15:49:01 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-7147562f-106c-4189-945f-adb313d0dad8 tempest-VolumesTestJSON-729853637 None] Creating volume a90e1db0-c7ae-432d-9be0-0da6c65a78da {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 15:49:01 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-7147562f-106c-4189-945f-adb313d0dad8 tempest-VolumesTestJSON-729853637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:49:01 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-7147562f-106c-4189-945f-adb313d0dad8 tempest-VolumesTestJSON-729853637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:49:01 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-7147562f-106c-4189-945f-adb313d0dad8 tempest-VolumesTestJSON-729853637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:49:01 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-7147562f-106c-4189-945f-adb313d0dad8 tempest-VolumesTestJSON-729853637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:49:01 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-7147562f-106c-4189-945f-adb313d0dad8 tempest-VolumesTestJSON-729853637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:49:01 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-7147562f-106c-4189-945f-adb313d0dad8 tempest-VolumesTestJSON-729853637 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 15:49:01 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-7147562f-106c-4189-945f-adb313d0dad8 tempest-VolumesTestJSON-729853637 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 15:49:01 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-7147562f-106c-4189-945f-adb313d0dad8 tempest-VolumesTestJSON-729853637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a90e1db0-c7ae-432d-9be0-0da6c65a78da 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:49:01 devstack sudo[89308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a90e1db0-c7ae-432d-9be0-0da6c65a78da 1073741824 Jul 10 15:49:01 devstack sudo[89308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:49:03 devstack sudo[89308]: pam_unix(sudo:session): session closed for user root Jul 10 15:49:03 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-7147562f-106c-4189-945f-adb313d0dad8 tempest-VolumesTestJSON-729853637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a90e1db0-c7ae-432d-9be0-0da6c65a78da 1073741824" returned: 0 in 2.114s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:49:03 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-7147562f-106c-4189-945f-adb313d0dad8 tempest-VolumesTestJSON-729853637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a90e1db0-c7ae-432d-9be0-0da6c65a78da {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:49:03 devstack sudo[89334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a90e1db0-c7ae-432d-9be0-0da6c65a78da Jul 10 15:49:03 devstack sudo[89334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:49:04 devstack sudo[89334]: pam_unix(sudo:session): session closed for user root Jul 10 15:49:04 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-7147562f-106c-4189-945f-adb313d0dad8 tempest-VolumesTestJSON-729853637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a90e1db0-c7ae-432d-9be0-0da6c65a78da" returned: 0 in 1.224s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:49:04 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-7147562f-106c-4189-945f-adb313d0dad8 tempest-VolumesTestJSON-729853637 None] <== create_volume: return (3434ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 15:49:04 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-7147562f-106c-4189-945f-adb313d0dad8 tempest-VolumesTestJSON-729853637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.441s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:49:04 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-7147562f-106c-4189-945f-adb313d0dad8 tempest-VolumesTestJSON-729853637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3970cc73-ff22-4bd0-8146-02e3611f5900) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a90e1db0-c7ae-432d-9be0-0da6c65a78da', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:49:04 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-7147562f-106c-4189-945f-adb313d0dad8 tempest-VolumesTestJSON-729853637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c41df330-c729-4130-9d9d-6a9987290080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:49:04 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-7147562f-106c-4189-945f-adb313d0dad8 tempest-VolumesTestJSON-729853637 None] Volume volume-a90e1db0-c7ae-432d-9be0-0da6c65a78da (a90e1db0-c7ae-432d-9be0-0da6c65a78da): created successfully Jul 10 15:49:04 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-7147562f-106c-4189-945f-adb313d0dad8 tempest-VolumesTestJSON-729853637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c41df330-c729-4130-9d9d-6a9987290080) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:49:04 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-7147562f-106c-4189-945f-adb313d0dad8 tempest-VolumesTestJSON-729853637 None] Flow 'volume_create_manager' (3eb290f4-a683-4882-8c73-ce9f08759f93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:49:04 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-7147562f-106c-4189-945f-adb313d0dad8 tempest-VolumesTestJSON-729853637 None] Created volume successfully. Jul 10 15:49:06 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2bd04c3-fbc9-45c5-a779-602aa70da244 tempest-VolumesTestJSON-729853637 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 15:49:06 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c2bd04c3-fbc9-45c5-a779-602aa70da244 tempest-VolumesTestJSON-729853637 None] Flow 'volume_create_manager' (41461836-b4cc-439b-ab64-213f0c2d633e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:49:06 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c2bd04c3-fbc9-45c5-a779-602aa70da244 tempest-VolumesTestJSON-729853637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e93fb1f2-73fa-484b-8a6e-b40cbae35c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:49:06 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c2bd04c3-fbc9-45c5-a779-602aa70da244 tempest-VolumesTestJSON-729853637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e93fb1f2-73fa-484b-8a6e-b40cbae35c6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:49:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2056070605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c54b7901-a676-4f89-bb18-0a9676d4d52b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9f771a73a8b042d7bfa0fd4bf65289e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:49:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:49:07Z,use_quota=True,user_id='dbd42d62e60041c684f8a7b09acbcdfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:49:07 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c2bd04c3-fbc9-45c5-a779-602aa70da244 tempest-VolumesTestJSON-729853637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a964c791-ba66-4803-90a8-6ed3c787b697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:49:07 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c2bd04c3-fbc9-45c5-a779-602aa70da244 tempest-VolumesTestJSON-729853637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a964c791-ba66-4803-90a8-6ed3c787b697) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:49:07 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c2bd04c3-fbc9-45c5-a779-602aa70da244 tempest-VolumesTestJSON-729853637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b13fbf58-0eda-4f0f-a849-2d6266c1269b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:49:07 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c2bd04c3-fbc9-45c5-a779-602aa70da244 tempest-VolumesTestJSON-729853637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b13fbf58-0eda-4f0f-a849-2d6266c1269b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c54b7901-a676-4f89-bb18-0a9676d4d52b', 'volume_name': 'volume-c54b7901-a676-4f89-bb18-0a9676d4d52b', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:49:07 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c2bd04c3-fbc9-45c5-a779-602aa70da244 tempest-VolumesTestJSON-729853637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68f2781a-41c3-48ae-8cd5-20cfd4794bc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:49:07 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c2bd04c3-fbc9-45c5-a779-602aa70da244 tempest-VolumesTestJSON-729853637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68f2781a-41c3-48ae-8cd5-20cfd4794bc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:49:07 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c2bd04c3-fbc9-45c5-a779-602aa70da244 tempest-VolumesTestJSON-729853637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e714899-7c27-4167-9798-0cd41ae4f487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:49:07 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-c2bd04c3-fbc9-45c5-a779-602aa70da244 tempest-VolumesTestJSON-729853637 None] Volume c54b7901-a676-4f89-bb18-0a9676d4d52b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c54b7901-a676-4f89-bb18-0a9676d4d52b', 'volume_size': 1} Jul 10 15:49:07 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-c2bd04c3-fbc9-45c5-a779-602aa70da244 tempest-VolumesTestJSON-729853637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:49:07 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-c2bd04c3-fbc9-45c5-a779-602aa70da244 tempest-VolumesTestJSON-729853637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:49:07 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-c2bd04c3-fbc9-45c5-a779-602aa70da244 tempest-VolumesTestJSON-729853637 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:49:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2056070605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c54b7901-a676-4f89-bb18-0a9676d4d52b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9f771a73a8b042d7bfa0fd4bf65289e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:49:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:49:07Z,use_quota=True,user_id='dbd42d62e60041c684f8a7b09acbcdfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 15:49:07 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-c2bd04c3-fbc9-45c5-a779-602aa70da244 tempest-VolumesTestJSON-729853637 None] Creating volume c54b7901-a676-4f89-bb18-0a9676d4d52b {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 15:49:07 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-c2bd04c3-fbc9-45c5-a779-602aa70da244 tempest-VolumesTestJSON-729853637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:49:07 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-c2bd04c3-fbc9-45c5-a779-602aa70da244 tempest-VolumesTestJSON-729853637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:49:07 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-c2bd04c3-fbc9-45c5-a779-602aa70da244 tempest-VolumesTestJSON-729853637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:49:07 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-c2bd04c3-fbc9-45c5-a779-602aa70da244 tempest-VolumesTestJSON-729853637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:49:07 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-c2bd04c3-fbc9-45c5-a779-602aa70da244 tempest-VolumesTestJSON-729853637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:49:07 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-c2bd04c3-fbc9-45c5-a779-602aa70da244 tempest-VolumesTestJSON-729853637 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 15:49:07 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-c2bd04c3-fbc9-45c5-a779-602aa70da244 tempest-VolumesTestJSON-729853637 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 15:49:07 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c2bd04c3-fbc9-45c5-a779-602aa70da244 tempest-VolumesTestJSON-729853637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-c54b7901-a676-4f89-bb18-0a9676d4d52b 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:49:07 devstack sudo[89343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-c54b7901-a676-4f89-bb18-0a9676d4d52b 1073741824 Jul 10 15:49:07 devstack sudo[89343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:49:08 devstack sudo[89343]: pam_unix(sudo:session): session closed for user root Jul 10 15:49:08 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c2bd04c3-fbc9-45c5-a779-602aa70da244 tempest-VolumesTestJSON-729853637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-c54b7901-a676-4f89-bb18-0a9676d4d52b 1073741824" returned: 0 in 1.318s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:49:08 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c2bd04c3-fbc9-45c5-a779-602aa70da244 tempest-VolumesTestJSON-729853637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-c54b7901-a676-4f89-bb18-0a9676d4d52b {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:49:08 devstack sudo[89349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-c54b7901-a676-4f89-bb18-0a9676d4d52b Jul 10 15:49:08 devstack sudo[89349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:49:09 devstack sudo[89349]: pam_unix(sudo:session): session closed for user root Jul 10 15:49:09 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c2bd04c3-fbc9-45c5-a779-602aa70da244 tempest-VolumesTestJSON-729853637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-c54b7901-a676-4f89-bb18-0a9676d4d52b" returned: 0 in 1.187s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:49:09 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-c2bd04c3-fbc9-45c5-a779-602aa70da244 tempest-VolumesTestJSON-729853637 None] <== create_volume: return (2601ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 15:49:09 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-c2bd04c3-fbc9-45c5-a779-602aa70da244 tempest-VolumesTestJSON-729853637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.608s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:49:09 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c2bd04c3-fbc9-45c5-a779-602aa70da244 tempest-VolumesTestJSON-729853637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e714899-7c27-4167-9798-0cd41ae4f487) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c54b7901-a676-4f89-bb18-0a9676d4d52b', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:49:09 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c2bd04c3-fbc9-45c5-a779-602aa70da244 tempest-VolumesTestJSON-729853637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05567460-28c4-40bb-8358-5c0474ea2dda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:49:09 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-c2bd04c3-fbc9-45c5-a779-602aa70da244 tempest-VolumesTestJSON-729853637 None] Volume volume-c54b7901-a676-4f89-bb18-0a9676d4d52b (c54b7901-a676-4f89-bb18-0a9676d4d52b): created successfully Jul 10 15:49:09 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c2bd04c3-fbc9-45c5-a779-602aa70da244 tempest-VolumesTestJSON-729853637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05567460-28c4-40bb-8358-5c0474ea2dda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:49:09 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c2bd04c3-fbc9-45c5-a779-602aa70da244 tempest-VolumesTestJSON-729853637 None] Flow 'volume_create_manager' (41461836-b4cc-439b-ab64-213f0c2d633e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:49:09 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-c2bd04c3-fbc9-45c5-a779-602aa70da244 tempest-VolumesTestJSON-729853637 None] Created volume successfully. Jul 10 15:49:10 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-70314107-cb28-406c-bc41-84a371a93d5d tempest-VolumesTestJSON-729853637 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 15:49:10 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-70314107-cb28-406c-bc41-84a371a93d5d tempest-VolumesTestJSON-729853637 None] Flow 'volume_create_manager' (6b3dbb83-d8e3-456d-b83f-3a368068b140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:49:10 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-70314107-cb28-406c-bc41-84a371a93d5d tempest-VolumesTestJSON-729853637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eccda77a-4d0f-405c-8669-84a8fbd264b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:49:10 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-70314107-cb28-406c-bc41-84a371a93d5d tempest-VolumesTestJSON-729853637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eccda77a-4d0f-405c-8669-84a8fbd264b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:49:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-518600132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e2761d4-bc2c-452b-bab9-f1113aed0d91,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9f771a73a8b042d7bfa0fd4bf65289e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:49:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:49:11Z,use_quota=True,user_id='dbd42d62e60041c684f8a7b09acbcdfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:49:10 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-70314107-cb28-406c-bc41-84a371a93d5d tempest-VolumesTestJSON-729853637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f280f03-cc69-42f5-8e04-0d3f2bb44198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:49:10 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-70314107-cb28-406c-bc41-84a371a93d5d tempest-VolumesTestJSON-729853637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f280f03-cc69-42f5-8e04-0d3f2bb44198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:49:11 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-70314107-cb28-406c-bc41-84a371a93d5d tempest-VolumesTestJSON-729853637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (899cfc80-a5dc-4842-a98d-d2c72dbdf8d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:49:11 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-70314107-cb28-406c-bc41-84a371a93d5d tempest-VolumesTestJSON-729853637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (899cfc80-a5dc-4842-a98d-d2c72dbdf8d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e2761d4-bc2c-452b-bab9-f1113aed0d91', 'volume_name': 'volume-3e2761d4-bc2c-452b-bab9-f1113aed0d91', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:49:11 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-70314107-cb28-406c-bc41-84a371a93d5d tempest-VolumesTestJSON-729853637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a7c4d42-afa2-495c-ade6-651404dda04f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:49:11 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-70314107-cb28-406c-bc41-84a371a93d5d tempest-VolumesTestJSON-729853637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a7c4d42-afa2-495c-ade6-651404dda04f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:49:11 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-70314107-cb28-406c-bc41-84a371a93d5d tempest-VolumesTestJSON-729853637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bb04802-20df-4c26-b896-02edddd78de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:49:11 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-70314107-cb28-406c-bc41-84a371a93d5d tempest-VolumesTestJSON-729853637 None] Volume 3e2761d4-bc2c-452b-bab9-f1113aed0d91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e2761d4-bc2c-452b-bab9-f1113aed0d91', 'volume_size': 1} Jul 10 15:49:11 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-70314107-cb28-406c-bc41-84a371a93d5d tempest-VolumesTestJSON-729853637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:49:11 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-70314107-cb28-406c-bc41-84a371a93d5d tempest-VolumesTestJSON-729853637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:49:11 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-70314107-cb28-406c-bc41-84a371a93d5d tempest-VolumesTestJSON-729853637 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:49:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-518600132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e2761d4-bc2c-452b-bab9-f1113aed0d91,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9f771a73a8b042d7bfa0fd4bf65289e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:49:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:49:11Z,use_quota=True,user_id='dbd42d62e60041c684f8a7b09acbcdfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 15:49:11 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-70314107-cb28-406c-bc41-84a371a93d5d tempest-VolumesTestJSON-729853637 None] Creating volume 3e2761d4-bc2c-452b-bab9-f1113aed0d91 {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 15:49:11 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-70314107-cb28-406c-bc41-84a371a93d5d tempest-VolumesTestJSON-729853637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:49:11 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-70314107-cb28-406c-bc41-84a371a93d5d tempest-VolumesTestJSON-729853637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:49:11 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-70314107-cb28-406c-bc41-84a371a93d5d tempest-VolumesTestJSON-729853637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:49:11 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-70314107-cb28-406c-bc41-84a371a93d5d tempest-VolumesTestJSON-729853637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:49:11 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-70314107-cb28-406c-bc41-84a371a93d5d tempest-VolumesTestJSON-729853637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:49:11 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-70314107-cb28-406c-bc41-84a371a93d5d tempest-VolumesTestJSON-729853637 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 15:49:11 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-70314107-cb28-406c-bc41-84a371a93d5d tempest-VolumesTestJSON-729853637 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 15:49:11 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-70314107-cb28-406c-bc41-84a371a93d5d tempest-VolumesTestJSON-729853637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3e2761d4-bc2c-452b-bab9-f1113aed0d91 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:49:11 devstack sudo[89358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3e2761d4-bc2c-452b-bab9-f1113aed0d91 1073741824 Jul 10 15:49:11 devstack sudo[89358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:49:12 devstack sudo[89358]: pam_unix(sudo:session): session closed for user root Jul 10 15:49:12 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-70314107-cb28-406c-bc41-84a371a93d5d tempest-VolumesTestJSON-729853637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3e2761d4-bc2c-452b-bab9-f1113aed0d91 1073741824" returned: 0 in 1.286s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:49:12 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-70314107-cb28-406c-bc41-84a371a93d5d tempest-VolumesTestJSON-729853637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3e2761d4-bc2c-452b-bab9-f1113aed0d91 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:49:12 devstack sudo[89370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3e2761d4-bc2c-452b-bab9-f1113aed0d91 Jul 10 15:49:12 devstack sudo[89370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:49:13 devstack sudo[89370]: pam_unix(sudo:session): session closed for user root Jul 10 15:49:13 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-70314107-cb28-406c-bc41-84a371a93d5d tempest-VolumesTestJSON-729853637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3e2761d4-bc2c-452b-bab9-f1113aed0d91" returned: 0 in 0.977s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:49:13 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-70314107-cb28-406c-bc41-84a371a93d5d tempest-VolumesTestJSON-729853637 None] <== create_volume: return (2329ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 15:49:13 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-70314107-cb28-406c-bc41-84a371a93d5d tempest-VolumesTestJSON-729853637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.331s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:49:13 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-70314107-cb28-406c-bc41-84a371a93d5d tempest-VolumesTestJSON-729853637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bb04802-20df-4c26-b896-02edddd78de4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e2761d4-bc2c-452b-bab9-f1113aed0d91', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:49:13 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-70314107-cb28-406c-bc41-84a371a93d5d tempest-VolumesTestJSON-729853637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9009c143-f3f8-4966-b327-5a495048cc87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:49:13 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-70314107-cb28-406c-bc41-84a371a93d5d tempest-VolumesTestJSON-729853637 None] Volume volume-3e2761d4-bc2c-452b-bab9-f1113aed0d91 (3e2761d4-bc2c-452b-bab9-f1113aed0d91): created successfully Jul 10 15:49:13 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-70314107-cb28-406c-bc41-84a371a93d5d tempest-VolumesTestJSON-729853637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9009c143-f3f8-4966-b327-5a495048cc87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:49:13 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-70314107-cb28-406c-bc41-84a371a93d5d tempest-VolumesTestJSON-729853637 None] Flow 'volume_create_manager' (6b3dbb83-d8e3-456d-b83f-3a368068b140) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:49:13 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-70314107-cb28-406c-bc41-84a371a93d5d tempest-VolumesTestJSON-729853637 None] Created volume successfully. Jul 10 15:49:16 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-f7fc1317-9827-4f0e-aa76-d2f755ef1338 tempest-VolumesTestJSON-729853637 None] Acquiring lock "cinder-3e2761d4-bc2c-452b-bab9-f1113aed0d91-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:49:16 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-f7fc1317-9827-4f0e-aa76-d2f755ef1338 tempest-VolumesTestJSON-729853637 None] Lock "cinder-3e2761d4-bc2c-452b-bab9-f1113aed0d91-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:49:16 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-f7fc1317-9827-4f0e-aa76-d2f755ef1338 tempest-VolumesTestJSON-729853637 None] Acquiring lock "cinder-quobyte-3e2761d4-bc2c-452b-bab9-f1113aed0d91" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:49:16 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-f7fc1317-9827-4f0e-aa76-d2f755ef1338 tempest-VolumesTestJSON-729853637 None] Lock "cinder-quobyte-3e2761d4-bc2c-452b-bab9-f1113aed0d91" acquired by "delete_volume" :: waited 0.030s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:49:16 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[afefcee9-2fc1-4426-8caa-d68e1245d802]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:49:16 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f7fc1317-9827-4f0e-aa76-d2f755ef1338 tempest-VolumesTestJSON-729853637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3e2761d4-bc2c-452b-bab9-f1113aed0d91 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:49:16 devstack sudo[89426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3e2761d4-bc2c-452b-bab9-f1113aed0d91 Jul 10 15:49:16 devstack sudo[89426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:49:17 devstack cinder-volume[87420]: DEBUG oslo_service.periodic_task [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87420) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 15:49:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:49:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:49:17 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:49:17 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:49:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:49:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:49:17 devstack sudo[89426]: pam_unix(sudo:session): session closed for user root Jul 10 15:49:17 devstack sudo[89432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 15:49:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f7fc1317-9827-4f0e-aa76-d2f755ef1338 tempest-VolumesTestJSON-729853637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3e2761d4-bc2c-452b-bab9-f1113aed0d91" returned: 0 in 1.149s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:49:17 devstack sudo[89432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:49:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f7fc1317-9827-4f0e-aa76-d2f755ef1338 tempest-VolumesTestJSON-729853637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3e2761d4-bc2c-452b-bab9-f1113aed0d91 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:49:17 devstack sudo[89434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3e2761d4-bc2c-452b-bab9-f1113aed0d91 Jul 10 15:49:17 devstack sudo[89434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:49:18 devstack sudo[89432]: pam_unix(sudo:session): session closed for user root Jul 10 15:49:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 1.227s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:49:18 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 15:49:18 devstack cinder-volume[87420]: DEBUG oslo_service.periodic_task [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Running periodic task VolumeManager._thread_info {{(pid=87420) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 15:49:18 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] thread count: 8 {{(pid=87420) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 15:49:18 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] thread info: [<_MainThread(MainThread, started 133639250378880)>, , , , , , , ] {{(pid=87420) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 15:49:18 devstack sudo[89434]: pam_unix(sudo:session): session closed for user root Jul 10 15:49:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f7fc1317-9827-4f0e-aa76-d2f755ef1338 tempest-VolumesTestJSON-729853637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3e2761d4-bc2c-452b-bab9-f1113aed0d91" returned: 0 in 1.242s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:49:18 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-f7fc1317-9827-4f0e-aa76-d2f755ef1338 tempest-VolumesTestJSON-729853637 None] Lock "cinder-quobyte-3e2761d4-bc2c-452b-bab9-f1113aed0d91" released by "delete_volume" :: held 2.453s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:49:18 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-f7fc1317-9827-4f0e-aa76-d2f755ef1338 tempest-VolumesTestJSON-729853637 None] Created reservations ['c8673c7f-2371-4124-8dfd-490078d56980', 'b264989d-c8ac-4de1-87fa-820dfa1dbb64', '59f7d684-cb92-4105-8066-3d3f4cb0a132', '3c2ec0d1-4eec-47e7-98d2-920aa1e51ae4'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 15:49:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-f7fc1317-9827-4f0e-aa76-d2f755ef1338 tempest-VolumesTestJSON-729853637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:49:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-f7fc1317-9827-4f0e-aa76-d2f755ef1338 tempest-VolumesTestJSON-729853637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:49:18 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-f7fc1317-9827-4f0e-aa76-d2f755ef1338 tempest-VolumesTestJSON-729853637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:49:18 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-f7fc1317-9827-4f0e-aa76-d2f755ef1338 tempest-VolumesTestJSON-729853637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:49:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-f7fc1317-9827-4f0e-aa76-d2f755ef1338 tempest-VolumesTestJSON-729853637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:49:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f7fc1317-9827-4f0e-aa76-d2f755ef1338 tempest-VolumesTestJSON-729853637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:49:18 devstack sudo[89438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 15:49:18 devstack sudo[89438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:49:19 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-17032d06-256b-4391-8cc2-819892bce817 tempest-VolumesTestJSON-729853637 None] Acquiring lock "cinder-c54b7901-a676-4f89-bb18-0a9676d4d52b-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:49:19 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-17032d06-256b-4391-8cc2-819892bce817 tempest-VolumesTestJSON-729853637 None] Lock "cinder-c54b7901-a676-4f89-bb18-0a9676d4d52b-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:49:19 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-17032d06-256b-4391-8cc2-819892bce817 tempest-VolumesTestJSON-729853637 None] Acquiring lock "cinder-quobyte-c54b7901-a676-4f89-bb18-0a9676d4d52b" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:49:19 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-17032d06-256b-4391-8cc2-819892bce817 tempest-VolumesTestJSON-729853637 None] Lock "cinder-quobyte-c54b7901-a676-4f89-bb18-0a9676d4d52b" acquired by "delete_volume" :: waited 0.026s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:49:19 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca6afed7-db96-4df6-bd08-c6627220467f]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:49:19 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-17032d06-256b-4391-8cc2-819892bce817 tempest-VolumesTestJSON-729853637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-c54b7901-a676-4f89-bb18-0a9676d4d52b {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:49:19 devstack sudo[89438]: pam_unix(sudo:session): session closed for user root Jul 10 15:49:19 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f7fc1317-9827-4f0e-aa76-d2f755ef1338 tempest-VolumesTestJSON-729853637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 1.002s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:49:19 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-f7fc1317-9827-4f0e-aa76-d2f755ef1338 tempest-VolumesTestJSON-729853637 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 15:49:19 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-f7fc1317-9827-4f0e-aa76-d2f755ef1338 tempest-VolumesTestJSON-729853637 None] Deleted volume successfully. Jul 10 15:49:19 devstack sudo[89441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-c54b7901-a676-4f89-bb18-0a9676d4d52b Jul 10 15:49:19 devstack sudo[89441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:49:19 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-f7fc1317-9827-4f0e-aa76-d2f755ef1338 tempest-VolumesTestJSON-729853637 None] Lock "cinder-3e2761d4-bc2c-452b-bab9-f1113aed0d91-delete_volume" released by "delete_volume" :: held 3.841s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:49:21 devstack sudo[89441]: pam_unix(sudo:session): session closed for user root Jul 10 15:49:21 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-17032d06-256b-4391-8cc2-819892bce817 tempest-VolumesTestJSON-729853637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-c54b7901-a676-4f89-bb18-0a9676d4d52b" returned: 0 in 1.749s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:49:21 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-17032d06-256b-4391-8cc2-819892bce817 tempest-VolumesTestJSON-729853637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-c54b7901-a676-4f89-bb18-0a9676d4d52b {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:49:21 devstack sudo[89447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-c54b7901-a676-4f89-bb18-0a9676d4d52b Jul 10 15:49:21 devstack sudo[89447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:49:22 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa09e919-974f-42de-9653-4b5f746cb445 tempest-ServerRescueNegativeTestJSON-57207049 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 15:49:22 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-aa09e919-974f-42de-9653-4b5f746cb445 tempest-ServerRescueNegativeTestJSON-57207049 None] Flow 'volume_create_manager' (2375ccbb-4b70-41a4-be81-411a7df7cc7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:49:22 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-aa09e919-974f-42de-9653-4b5f746cb445 tempest-ServerRescueNegativeTestJSON-57207049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1301b004-313b-4ad6-900e-299d364203f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:49:22 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-aa09e919-974f-42de-9653-4b5f746cb445 tempest-ServerRescueNegativeTestJSON-57207049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1301b004-313b-4ad6-900e-299d364203f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:49:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-284128721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c21ba4a7-7f79-40ab-882d-11c88d4dcdf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c18e865e71e84ede9c62fd799be15255',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:49:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:49:22Z,use_quota=True,user_id='7cb6bde66ab24090983f2f0ec7b1b833',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:49:22 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-aa09e919-974f-42de-9653-4b5f746cb445 tempest-ServerRescueNegativeTestJSON-57207049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17021cda-8fbc-4a0a-acf8-328760a5622d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:49:22 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-aa09e919-974f-42de-9653-4b5f746cb445 tempest-ServerRescueNegativeTestJSON-57207049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17021cda-8fbc-4a0a-acf8-328760a5622d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:49:22 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-aa09e919-974f-42de-9653-4b5f746cb445 tempest-ServerRescueNegativeTestJSON-57207049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7125cf7b-9b10-48ea-a9d9-a98a1660545b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:49:22 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-aa09e919-974f-42de-9653-4b5f746cb445 tempest-ServerRescueNegativeTestJSON-57207049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7125cf7b-9b10-48ea-a9d9-a98a1660545b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c21ba4a7-7f79-40ab-882d-11c88d4dcdf1', 'volume_name': 'volume-c21ba4a7-7f79-40ab-882d-11c88d4dcdf1', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:49:22 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-aa09e919-974f-42de-9653-4b5f746cb445 tempest-ServerRescueNegativeTestJSON-57207049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1aa7fb40-44a8-4998-b03e-48d7817e2276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:49:22 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-aa09e919-974f-42de-9653-4b5f746cb445 tempest-ServerRescueNegativeTestJSON-57207049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1aa7fb40-44a8-4998-b03e-48d7817e2276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:49:22 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-aa09e919-974f-42de-9653-4b5f746cb445 tempest-ServerRescueNegativeTestJSON-57207049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78c6236a-5053-4bb4-9a05-af5e96ca91ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:49:22 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-aa09e919-974f-42de-9653-4b5f746cb445 tempest-ServerRescueNegativeTestJSON-57207049 None] Volume c21ba4a7-7f79-40ab-882d-11c88d4dcdf1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c21ba4a7-7f79-40ab-882d-11c88d4dcdf1', 'volume_size': 1} Jul 10 15:49:22 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-aa09e919-974f-42de-9653-4b5f746cb445 tempest-ServerRescueNegativeTestJSON-57207049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:49:22 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-aa09e919-974f-42de-9653-4b5f746cb445 tempest-ServerRescueNegativeTestJSON-57207049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:49:22 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-aa09e919-974f-42de-9653-4b5f746cb445 tempest-ServerRescueNegativeTestJSON-57207049 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:49:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-284128721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c21ba4a7-7f79-40ab-882d-11c88d4dcdf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c18e865e71e84ede9c62fd799be15255',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:49:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:49:22Z,use_quota=True,user_id='7cb6bde66ab24090983f2f0ec7b1b833',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 15:49:22 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-aa09e919-974f-42de-9653-4b5f746cb445 tempest-ServerRescueNegativeTestJSON-57207049 None] Creating volume c21ba4a7-7f79-40ab-882d-11c88d4dcdf1 {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 15:49:22 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-aa09e919-974f-42de-9653-4b5f746cb445 tempest-ServerRescueNegativeTestJSON-57207049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:49:22 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-aa09e919-974f-42de-9653-4b5f746cb445 tempest-ServerRescueNegativeTestJSON-57207049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:49:22 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-aa09e919-974f-42de-9653-4b5f746cb445 tempest-ServerRescueNegativeTestJSON-57207049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:49:22 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-aa09e919-974f-42de-9653-4b5f746cb445 tempest-ServerRescueNegativeTestJSON-57207049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:49:22 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-aa09e919-974f-42de-9653-4b5f746cb445 tempest-ServerRescueNegativeTestJSON-57207049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:49:22 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-aa09e919-974f-42de-9653-4b5f746cb445 tempest-ServerRescueNegativeTestJSON-57207049 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 15:49:22 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-aa09e919-974f-42de-9653-4b5f746cb445 tempest-ServerRescueNegativeTestJSON-57207049 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 15:49:22 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-aa09e919-974f-42de-9653-4b5f746cb445 tempest-ServerRescueNegativeTestJSON-57207049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-c21ba4a7-7f79-40ab-882d-11c88d4dcdf1 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:49:22 devstack sudo[89451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-c21ba4a7-7f79-40ab-882d-11c88d4dcdf1 1073741824 Jul 10 15:49:22 devstack sudo[89451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:49:23 devstack sudo[89447]: pam_unix(sudo:session): session closed for user root Jul 10 15:49:23 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-17032d06-256b-4391-8cc2-819892bce817 tempest-VolumesTestJSON-729853637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-c54b7901-a676-4f89-bb18-0a9676d4d52b" returned: 0 in 1.873s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:49:23 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-17032d06-256b-4391-8cc2-819892bce817 tempest-VolumesTestJSON-729853637 None] Lock "cinder-quobyte-c54b7901-a676-4f89-bb18-0a9676d4d52b" released by "delete_volume" :: held 3.707s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:49:23 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-17032d06-256b-4391-8cc2-819892bce817 tempest-VolumesTestJSON-729853637 None] Created reservations ['8246b0df-7eaa-49b6-9b97-e6b1fa07e5a6', '3d26b1c1-5586-4b6b-bd8d-a3b2f60c881f', '8a20e613-1292-46c7-bc9b-e56ecbb067e5', '332cba32-8053-432c-8ee4-8904582de5b4'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 15:49:23 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-17032d06-256b-4391-8cc2-819892bce817 tempest-VolumesTestJSON-729853637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:49:23 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-17032d06-256b-4391-8cc2-819892bce817 tempest-VolumesTestJSON-729853637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:49:23 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-17032d06-256b-4391-8cc2-819892bce817 tempest-VolumesTestJSON-729853637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:49:23 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-17032d06-256b-4391-8cc2-819892bce817 tempest-VolumesTestJSON-729853637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:49:23 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-17032d06-256b-4391-8cc2-819892bce817 tempest-VolumesTestJSON-729853637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:49:23 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-17032d06-256b-4391-8cc2-819892bce817 tempest-VolumesTestJSON-729853637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:49:23 devstack sudo[89488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 15:49:23 devstack sudo[89488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:49:24 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-c595c46d-b5bc-4a9d-bf06-bcc257389070 tempest-VolumesTestJSON-729853637 None] Acquiring lock "cinder-a90e1db0-c7ae-432d-9be0-0da6c65a78da-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:49:24 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-c595c46d-b5bc-4a9d-bf06-bcc257389070 tempest-VolumesTestJSON-729853637 None] Lock "cinder-a90e1db0-c7ae-432d-9be0-0da6c65a78da-delete_volume" acquired by "delete_volume" :: waited 0.081s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:49:24 devstack sudo[89451]: pam_unix(sudo:session): session closed for user root Jul 10 15:49:24 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-aa09e919-974f-42de-9653-4b5f746cb445 tempest-ServerRescueNegativeTestJSON-57207049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-c21ba4a7-7f79-40ab-882d-11c88d4dcdf1 1073741824" returned: 0 in 2.377s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:49:24 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-c595c46d-b5bc-4a9d-bf06-bcc257389070 tempest-VolumesTestJSON-729853637 None] Acquiring lock "cinder-quobyte-a90e1db0-c7ae-432d-9be0-0da6c65a78da" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:49:24 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-aa09e919-974f-42de-9653-4b5f746cb445 tempest-ServerRescueNegativeTestJSON-57207049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-c21ba4a7-7f79-40ab-882d-11c88d4dcdf1 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:49:24 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-c595c46d-b5bc-4a9d-bf06-bcc257389070 tempest-VolumesTestJSON-729853637 None] Lock "cinder-quobyte-a90e1db0-c7ae-432d-9be0-0da6c65a78da" acquired by "delete_volume" :: waited 0.076s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:49:24 devstack sudo[89499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-c21ba4a7-7f79-40ab-882d-11c88d4dcdf1 Jul 10 15:49:24 devstack sudo[89499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:49:24 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[a42e59e5-3763-49ec-9eae-76d70fc1e258]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:49:24 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c595c46d-b5bc-4a9d-bf06-bcc257389070 tempest-VolumesTestJSON-729853637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a90e1db0-c7ae-432d-9be0-0da6c65a78da {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:49:25 devstack sudo[89501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a90e1db0-c7ae-432d-9be0-0da6c65a78da Jul 10 15:49:25 devstack sudo[89501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:49:25 devstack sudo[89488]: pam_unix(sudo:session): session closed for user root Jul 10 15:49:25 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-17032d06-256b-4391-8cc2-819892bce817 tempest-VolumesTestJSON-729853637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 1.864s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:49:25 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-17032d06-256b-4391-8cc2-819892bce817 tempest-VolumesTestJSON-729853637 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 15:49:25 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-17032d06-256b-4391-8cc2-819892bce817 tempest-VolumesTestJSON-729853637 None] Deleted volume successfully. Jul 10 15:49:25 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-17032d06-256b-4391-8cc2-819892bce817 tempest-VolumesTestJSON-729853637 None] Lock "cinder-c54b7901-a676-4f89-bb18-0a9676d4d52b-delete_volume" released by "delete_volume" :: held 5.971s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:49:26 devstack sudo[89499]: pam_unix(sudo:session): session closed for user root Jul 10 15:49:26 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-aa09e919-974f-42de-9653-4b5f746cb445 tempest-ServerRescueNegativeTestJSON-57207049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-c21ba4a7-7f79-40ab-882d-11c88d4dcdf1" returned: 0 in 1.380s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:49:26 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-aa09e919-974f-42de-9653-4b5f746cb445 tempest-ServerRescueNegativeTestJSON-57207049 None] <== create_volume: return (4026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 15:49:26 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-aa09e919-974f-42de-9653-4b5f746cb445 tempest-ServerRescueNegativeTestJSON-57207049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.032s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:49:26 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-aa09e919-974f-42de-9653-4b5f746cb445 tempest-ServerRescueNegativeTestJSON-57207049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78c6236a-5053-4bb4-9a05-af5e96ca91ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c21ba4a7-7f79-40ab-882d-11c88d4dcdf1', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:49:26 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-aa09e919-974f-42de-9653-4b5f746cb445 tempest-ServerRescueNegativeTestJSON-57207049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d8bdf5e-4393-41e3-8a06-42a8a21287ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:49:26 devstack sudo[89501]: pam_unix(sudo:session): session closed for user root Jul 10 15:49:26 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c595c46d-b5bc-4a9d-bf06-bcc257389070 tempest-VolumesTestJSON-729853637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a90e1db0-c7ae-432d-9be0-0da6c65a78da" returned: 0 in 1.370s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:49:26 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c595c46d-b5bc-4a9d-bf06-bcc257389070 tempest-VolumesTestJSON-729853637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a90e1db0-c7ae-432d-9be0-0da6c65a78da {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:49:26 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-aa09e919-974f-42de-9653-4b5f746cb445 tempest-ServerRescueNegativeTestJSON-57207049 None] Volume volume-c21ba4a7-7f79-40ab-882d-11c88d4dcdf1 (c21ba4a7-7f79-40ab-882d-11c88d4dcdf1): created successfully Jul 10 15:49:26 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-aa09e919-974f-42de-9653-4b5f746cb445 tempest-ServerRescueNegativeTestJSON-57207049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d8bdf5e-4393-41e3-8a06-42a8a21287ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:49:26 devstack sudo[89508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a90e1db0-c7ae-432d-9be0-0da6c65a78da Jul 10 15:49:26 devstack sudo[89508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:49:26 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-aa09e919-974f-42de-9653-4b5f746cb445 tempest-ServerRescueNegativeTestJSON-57207049 None] Flow 'volume_create_manager' (2375ccbb-4b70-41a4-be81-411a7df7cc7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:49:26 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-aa09e919-974f-42de-9653-4b5f746cb445 tempest-ServerRescueNegativeTestJSON-57207049 None] Created volume successfully. Jul 10 15:49:27 devstack sudo[89508]: pam_unix(sudo:session): session closed for user root Jul 10 15:49:27 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c595c46d-b5bc-4a9d-bf06-bcc257389070 tempest-VolumesTestJSON-729853637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a90e1db0-c7ae-432d-9be0-0da6c65a78da" returned: 0 in 1.043s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:49:27 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-c595c46d-b5bc-4a9d-bf06-bcc257389070 tempest-VolumesTestJSON-729853637 None] Lock "cinder-quobyte-a90e1db0-c7ae-432d-9be0-0da6c65a78da" released by "delete_volume" :: held 2.501s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:49:27 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-c595c46d-b5bc-4a9d-bf06-bcc257389070 tempest-VolumesTestJSON-729853637 None] Created reservations ['8e56ef0c-7d7a-4ec7-967f-1ea852cc63f3', 'f2ce269e-bfda-44d4-a457-9784d390fd9f', '9b2658d2-0114-4268-a0e9-f67d56757153', 'c6b17697-c904-420a-acb2-d14976f83791'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 15:49:27 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-c595c46d-b5bc-4a9d-bf06-bcc257389070 tempest-VolumesTestJSON-729853637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:49:27 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-c595c46d-b5bc-4a9d-bf06-bcc257389070 tempest-VolumesTestJSON-729853637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:49:27 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-c595c46d-b5bc-4a9d-bf06-bcc257389070 tempest-VolumesTestJSON-729853637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:49:27 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-c595c46d-b5bc-4a9d-bf06-bcc257389070 tempest-VolumesTestJSON-729853637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:49:27 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-c595c46d-b5bc-4a9d-bf06-bcc257389070 tempest-VolumesTestJSON-729853637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:49:27 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c595c46d-b5bc-4a9d-bf06-bcc257389070 tempest-VolumesTestJSON-729853637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:49:27 devstack sudo[89512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 15:49:27 devstack sudo[89512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:49:29 devstack sudo[89512]: pam_unix(sudo:session): session closed for user root Jul 10 15:49:29 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c595c46d-b5bc-4a9d-bf06-bcc257389070 tempest-VolumesTestJSON-729853637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 1.591s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:49:29 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-c595c46d-b5bc-4a9d-bf06-bcc257389070 tempest-VolumesTestJSON-729853637 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 15:49:29 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-c595c46d-b5bc-4a9d-bf06-bcc257389070 tempest-VolumesTestJSON-729853637 None] Deleted volume successfully. Jul 10 15:49:29 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-c595c46d-b5bc-4a9d-bf06-bcc257389070 tempest-VolumesTestJSON-729853637 None] Lock "cinder-a90e1db0-c7ae-432d-9be0-0da6c65a78da-delete_volume" released by "delete_volume" :: held 4.671s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:49:34 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-fa0e0e72-5811-4ba9-9b41-ad60fc420909 tempest-GroupSnapshotsTest-1929455548 None] Group tempest-GroupSnapshotsTest-Group-1775254550: creating Jul 10 15:49:34 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-fa0e0e72-5811-4ba9-9b41-ad60fc420909 tempest-GroupSnapshotsTest-1929455548 None] Group tempest-GroupSnapshotsTest-Group-1775254550: created successfully Jul 10 15:49:34 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-fa0e0e72-5811-4ba9-9b41-ad60fc420909 tempest-GroupSnapshotsTest-1929455548 None] Create group completed successfully. Jul 10 15:49:36 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-64a61777-9922-428d-9acb-585490aa1f1b tempest-GroupSnapshotsTest-1929455548 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 15:49:36 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-64a61777-9922-428d-9acb-585490aa1f1b tempest-GroupSnapshotsTest-1929455548 None] Flow 'volume_create_manager' (555c6d55-7243-4acc-a51d-666004577c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:49:36 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-64a61777-9922-428d-9acb-585490aa1f1b tempest-GroupSnapshotsTest-1929455548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5ef81f4-0f63-4e11-ad1d-fe570eecd8b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:49:36 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-64a61777-9922-428d-9acb-585490aa1f1b tempest-GroupSnapshotsTest-1929455548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5ef81f4-0f63-4e11-ad1d-fe570eecd8b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:49:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1714115083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e9395a85-16e1-4c5f-a291-9ce9d3cc36e8,host='devstack@QuobyteHD#QuobyteHD',id=4944e769-20aa-4122-9ae3-f4b20ddc1e4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e411f85fbd545ba9d5af3a552fec9e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:49:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:49:37Z,use_quota=True,user_id='d71b7302462541a89453c96eb1f7de16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da4e2e6-4c32-436c-8df8-199b3556c97a),volume_type_id=1da4e2e6-4c32-436c-8df8-199b3556c97a)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:49:36 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-64a61777-9922-428d-9acb-585490aa1f1b tempest-GroupSnapshotsTest-1929455548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6861361b-0880-4cc5-ae03-3c93cb58f4f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:49:36 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-64a61777-9922-428d-9acb-585490aa1f1b tempest-GroupSnapshotsTest-1929455548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6861361b-0880-4cc5-ae03-3c93cb58f4f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:49:36 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-64a61777-9922-428d-9acb-585490aa1f1b tempest-GroupSnapshotsTest-1929455548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a8aa9d9-356e-48a9-ba62-1e167bc7cd08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:49:36 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-64a61777-9922-428d-9acb-585490aa1f1b tempest-GroupSnapshotsTest-1929455548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a8aa9d9-356e-48a9-ba62-1e167bc7cd08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4944e769-20aa-4122-9ae3-f4b20ddc1e4d', 'volume_name': 'volume-4944e769-20aa-4122-9ae3-f4b20ddc1e4d', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:49:36 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-64a61777-9922-428d-9acb-585490aa1f1b tempest-GroupSnapshotsTest-1929455548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a149a078-7601-4365-b68c-974b4bb6c259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:49:36 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-64a61777-9922-428d-9acb-585490aa1f1b tempest-GroupSnapshotsTest-1929455548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a149a078-7601-4365-b68c-974b4bb6c259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:49:36 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-64a61777-9922-428d-9acb-585490aa1f1b tempest-GroupSnapshotsTest-1929455548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28eaa1c7-f85e-4e0a-8bbb-7340e66218d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:49:36 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-64a61777-9922-428d-9acb-585490aa1f1b tempest-GroupSnapshotsTest-1929455548 None] Volume 4944e769-20aa-4122-9ae3-f4b20ddc1e4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4944e769-20aa-4122-9ae3-f4b20ddc1e4d', 'volume_size': 1} Jul 10 15:49:36 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-64a61777-9922-428d-9acb-585490aa1f1b tempest-GroupSnapshotsTest-1929455548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:49:36 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-64a61777-9922-428d-9acb-585490aa1f1b tempest-GroupSnapshotsTest-1929455548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:49:36 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-64a61777-9922-428d-9acb-585490aa1f1b tempest-GroupSnapshotsTest-1929455548 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e9395a85-16e1-4c5f-a291-9ce9d3cc36e8,created_at=2026-07-10T13:49:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1714115083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e9395a85-16e1-4c5f-a291-9ce9d3cc36e8,host='devstack@QuobyteHD#QuobyteHD',id=4944e769-20aa-4122-9ae3-f4b20ddc1e4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e411f85fbd545ba9d5af3a552fec9e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:49:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:49:37Z,use_quota=True,user_id='d71b7302462541a89453c96eb1f7de16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da4e2e6-4c32-436c-8df8-199b3556c97a),volume_type_id=1da4e2e6-4c32-436c-8df8-199b3556c97a)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 15:49:36 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-64a61777-9922-428d-9acb-585490aa1f1b tempest-GroupSnapshotsTest-1929455548 None] Creating volume 4944e769-20aa-4122-9ae3-f4b20ddc1e4d {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 15:49:36 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-64a61777-9922-428d-9acb-585490aa1f1b tempest-GroupSnapshotsTest-1929455548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:49:36 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-64a61777-9922-428d-9acb-585490aa1f1b tempest-GroupSnapshotsTest-1929455548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:49:36 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-64a61777-9922-428d-9acb-585490aa1f1b tempest-GroupSnapshotsTest-1929455548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:49:36 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-64a61777-9922-428d-9acb-585490aa1f1b tempest-GroupSnapshotsTest-1929455548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:49:36 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-64a61777-9922-428d-9acb-585490aa1f1b tempest-GroupSnapshotsTest-1929455548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:49:36 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-64a61777-9922-428d-9acb-585490aa1f1b tempest-GroupSnapshotsTest-1929455548 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 15:49:36 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-64a61777-9922-428d-9acb-585490aa1f1b tempest-GroupSnapshotsTest-1929455548 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 15:49:36 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-64a61777-9922-428d-9acb-585490aa1f1b tempest-GroupSnapshotsTest-1929455548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4944e769-20aa-4122-9ae3-f4b20ddc1e4d 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:49:36 devstack sudo[89541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4944e769-20aa-4122-9ae3-f4b20ddc1e4d 1073741824 Jul 10 15:49:36 devstack sudo[89541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:49:37 devstack sudo[89541]: pam_unix(sudo:session): session closed for user root Jul 10 15:49:38 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-64a61777-9922-428d-9acb-585490aa1f1b tempest-GroupSnapshotsTest-1929455548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4944e769-20aa-4122-9ae3-f4b20ddc1e4d 1073741824" returned: 0 in 1.216s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:49:38 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-64a61777-9922-428d-9acb-585490aa1f1b tempest-GroupSnapshotsTest-1929455548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4944e769-20aa-4122-9ae3-f4b20ddc1e4d {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:49:38 devstack sudo[89547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4944e769-20aa-4122-9ae3-f4b20ddc1e4d Jul 10 15:49:38 devstack sudo[89547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:49:39 devstack cinder-volume[87420]: DEBUG dbcounter [-] [87420] Writing DB stats cinder:SELECT=42,cinder:UPDATE=72,cinder:INSERT=20,cinder:DELETE=7 {{(pid=87420) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 15:49:39 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-a858b703-c79c-4e14-81a5-9627796b2e2a tempest-TaggedAttachmentsTest-1197600787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 15:49:39 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-a858b703-c79c-4e14-81a5-9627796b2e2a tempest-TaggedAttachmentsTest-1197600787 None] Flow 'volume_create_manager' (c7eb0af2-55d8-43eb-91b9-bca70c883b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:49:39 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-a858b703-c79c-4e14-81a5-9627796b2e2a tempest-TaggedAttachmentsTest-1197600787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb3683b1-f572-4b31-b059-d9c2db64bd71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:49:39 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-a858b703-c79c-4e14-81a5-9627796b2e2a tempest-TaggedAttachmentsTest-1197600787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb3683b1-f572-4b31-b059-d9c2db64bd71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:49:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-207941140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27f25116-9e7b-4fc4-b271-b9079a07c1a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9acf6190d05406d92152340b17845a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:49:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:49:39Z,use_quota=True,user_id='56ca9176272b4a42984c7439300073fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:49:39 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-a858b703-c79c-4e14-81a5-9627796b2e2a tempest-TaggedAttachmentsTest-1197600787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2567a537-09bc-4f62-9be4-e9cee6a4dbd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:49:39 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-a858b703-c79c-4e14-81a5-9627796b2e2a tempest-TaggedAttachmentsTest-1197600787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2567a537-09bc-4f62-9be4-e9cee6a4dbd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:49:39 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-a858b703-c79c-4e14-81a5-9627796b2e2a tempest-TaggedAttachmentsTest-1197600787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3308a028-d318-49b4-8f15-7ed52a8dd6e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:49:39 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-a858b703-c79c-4e14-81a5-9627796b2e2a tempest-TaggedAttachmentsTest-1197600787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3308a028-d318-49b4-8f15-7ed52a8dd6e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27f25116-9e7b-4fc4-b271-b9079a07c1a7', 'volume_name': 'volume-27f25116-9e7b-4fc4-b271-b9079a07c1a7', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:49:39 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-a858b703-c79c-4e14-81a5-9627796b2e2a tempest-TaggedAttachmentsTest-1197600787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0aee0692-a458-4500-8606-e94918027470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:49:39 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-a858b703-c79c-4e14-81a5-9627796b2e2a tempest-TaggedAttachmentsTest-1197600787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0aee0692-a458-4500-8606-e94918027470) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:49:39 devstack sudo[89547]: pam_unix(sudo:session): session closed for user root Jul 10 15:49:39 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-a858b703-c79c-4e14-81a5-9627796b2e2a tempest-TaggedAttachmentsTest-1197600787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9c52dc6-6c97-400e-9d3c-83eeda74141a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:49:39 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-a858b703-c79c-4e14-81a5-9627796b2e2a tempest-TaggedAttachmentsTest-1197600787 None] Volume 27f25116-9e7b-4fc4-b271-b9079a07c1a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27f25116-9e7b-4fc4-b271-b9079a07c1a7', 'volume_size': 1} Jul 10 15:49:39 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-a858b703-c79c-4e14-81a5-9627796b2e2a tempest-TaggedAttachmentsTest-1197600787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:49:39 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-64a61777-9922-428d-9acb-585490aa1f1b tempest-GroupSnapshotsTest-1929455548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4944e769-20aa-4122-9ae3-f4b20ddc1e4d" returned: 0 in 1.351s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:49:39 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-64a61777-9922-428d-9acb-585490aa1f1b tempest-GroupSnapshotsTest-1929455548 None] <== create_volume: return (2637ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 15:49:39 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-64a61777-9922-428d-9acb-585490aa1f1b tempest-GroupSnapshotsTest-1929455548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.640s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:49:39 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-a858b703-c79c-4e14-81a5-9627796b2e2a tempest-TaggedAttachmentsTest-1197600787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.012s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:49:39 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-a858b703-c79c-4e14-81a5-9627796b2e2a tempest-TaggedAttachmentsTest-1197600787 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:49:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-207941140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27f25116-9e7b-4fc4-b271-b9079a07c1a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9acf6190d05406d92152340b17845a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:49:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:49:39Z,use_quota=True,user_id='56ca9176272b4a42984c7439300073fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 15:49:39 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-a858b703-c79c-4e14-81a5-9627796b2e2a tempest-TaggedAttachmentsTest-1197600787 None] Creating volume 27f25116-9e7b-4fc4-b271-b9079a07c1a7 {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 15:49:39 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-a858b703-c79c-4e14-81a5-9627796b2e2a tempest-TaggedAttachmentsTest-1197600787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:49:39 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-a858b703-c79c-4e14-81a5-9627796b2e2a tempest-TaggedAttachmentsTest-1197600787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:49:39 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-a858b703-c79c-4e14-81a5-9627796b2e2a tempest-TaggedAttachmentsTest-1197600787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:49:39 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-a858b703-c79c-4e14-81a5-9627796b2e2a tempest-TaggedAttachmentsTest-1197600787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:49:39 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-a858b703-c79c-4e14-81a5-9627796b2e2a tempest-TaggedAttachmentsTest-1197600787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:49:39 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-a858b703-c79c-4e14-81a5-9627796b2e2a tempest-TaggedAttachmentsTest-1197600787 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 15:49:39 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-a858b703-c79c-4e14-81a5-9627796b2e2a tempest-TaggedAttachmentsTest-1197600787 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 15:49:39 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a858b703-c79c-4e14-81a5-9627796b2e2a tempest-TaggedAttachmentsTest-1197600787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-27f25116-9e7b-4fc4-b271-b9079a07c1a7 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:49:39 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-64a61777-9922-428d-9acb-585490aa1f1b tempest-GroupSnapshotsTest-1929455548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28eaa1c7-f85e-4e0a-8bbb-7340e66218d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4944e769-20aa-4122-9ae3-f4b20ddc1e4d', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:49:39 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-64a61777-9922-428d-9acb-585490aa1f1b tempest-GroupSnapshotsTest-1929455548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3a70309-6c1b-417a-85f1-436dc4d336d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:49:39 devstack sudo[89555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-27f25116-9e7b-4fc4-b271-b9079a07c1a7 1073741824 Jul 10 15:49:39 devstack sudo[89555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:49:39 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-64a61777-9922-428d-9acb-585490aa1f1b tempest-GroupSnapshotsTest-1929455548 None] Volume volume-4944e769-20aa-4122-9ae3-f4b20ddc1e4d (4944e769-20aa-4122-9ae3-f4b20ddc1e4d): created successfully Jul 10 15:49:39 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-64a61777-9922-428d-9acb-585490aa1f1b tempest-GroupSnapshotsTest-1929455548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3a70309-6c1b-417a-85f1-436dc4d336d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:49:39 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-64a61777-9922-428d-9acb-585490aa1f1b tempest-GroupSnapshotsTest-1929455548 None] Flow 'volume_create_manager' (555c6d55-7243-4acc-a51d-666004577c16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:49:39 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-64a61777-9922-428d-9acb-585490aa1f1b tempest-GroupSnapshotsTest-1929455548 None] Created volume successfully. Jul 10 15:49:40 devstack sudo[89555]: pam_unix(sudo:session): session closed for user root Jul 10 15:49:40 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a858b703-c79c-4e14-81a5-9627796b2e2a tempest-TaggedAttachmentsTest-1197600787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-27f25116-9e7b-4fc4-b271-b9079a07c1a7 1073741824" returned: 0 in 1.079s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:49:40 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a858b703-c79c-4e14-81a5-9627796b2e2a tempest-TaggedAttachmentsTest-1197600787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-27f25116-9e7b-4fc4-b271-b9079a07c1a7 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:49:40 devstack sudo[89569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-27f25116-9e7b-4fc4-b271-b9079a07c1a7 Jul 10 15:49:40 devstack sudo[89569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:49:40 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-01cdf652-c56b-43c7-9c81-fec9235f0ca7 tempest-GroupSnapshotsTest-1929455548 None] GroupSnapshot 80d8c4a8-8e45-44fe-bd50-6b4fdca38577: creating. Jul 10 15:49:41 devstack cinder-volume[87420]: DEBUG dbcounter [-] [87420] Writing DB stats cinder:SELECT=56,cinder:UPDATE=71,cinder:DELETE=6,cinder:INSERT=11 {{(pid=87420) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 15:49:41 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-01cdf652-c56b-43c7-9c81-fec9235f0ca7 tempest-GroupSnapshotsTest-1929455548 None] Group snapshot 80d8c4a8-8e45-44fe-bd50-6b4fdca38577: creating. {{(pid=87420) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 10 15:49:41 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-01cdf652-c56b-43c7-9c81-fec9235f0ca7 tempest-GroupSnapshotsTest-1929455548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:49:41 devstack sudo[89569]: pam_unix(sudo:session): session closed for user root Jul 10 15:49:41 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a858b703-c79c-4e14-81a5-9627796b2e2a tempest-TaggedAttachmentsTest-1197600787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-27f25116-9e7b-4fc4-b271-b9079a07c1a7" returned: 0 in 0.748s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:49:41 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-a858b703-c79c-4e14-81a5-9627796b2e2a tempest-TaggedAttachmentsTest-1197600787 None] <== create_volume: return (1872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 15:49:41 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-a858b703-c79c-4e14-81a5-9627796b2e2a tempest-TaggedAttachmentsTest-1197600787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.875s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:49:41 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-01cdf652-c56b-43c7-9c81-fec9235f0ca7 tempest-GroupSnapshotsTest-1929455548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.265s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:49:41 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-a858b703-c79c-4e14-81a5-9627796b2e2a tempest-TaggedAttachmentsTest-1197600787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9c52dc6-6c97-400e-9d3c-83eeda74141a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27f25116-9e7b-4fc4-b271-b9079a07c1a7', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:49:41 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-a858b703-c79c-4e14-81a5-9627796b2e2a tempest-TaggedAttachmentsTest-1197600787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c80d417f-abbc-4e49-a6b2-eae944a9f645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:49:41 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-01cdf652-c56b-43c7-9c81-fec9235f0ca7 tempest-GroupSnapshotsTest-1929455548 None] Creating offline snapshot d5f5aef2-c895-4cfb-8459-a5fe7e38c38c of volume 4944e769-20aa-4122-9ae3-f4b20ddc1e4d {{(pid=87420) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 15:49:41 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-a858b703-c79c-4e14-81a5-9627796b2e2a tempest-TaggedAttachmentsTest-1197600787 None] Volume volume-27f25116-9e7b-4fc4-b271-b9079a07c1a7 (27f25116-9e7b-4fc4-b271-b9079a07c1a7): created successfully Jul 10 15:49:41 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-a858b703-c79c-4e14-81a5-9627796b2e2a tempest-TaggedAttachmentsTest-1197600787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c80d417f-abbc-4e49-a6b2-eae944a9f645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:49:41 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-a858b703-c79c-4e14-81a5-9627796b2e2a tempest-TaggedAttachmentsTest-1197600787 None] Flow 'volume_create_manager' (c7eb0af2-55d8-43eb-91b9-bca70c883b66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:49:41 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[f11e0b46-c3e2-4ef7-8144-5717a973ce40]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:49:41 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-01cdf652-c56b-43c7-9c81-fec9235f0ca7 tempest-GroupSnapshotsTest-1929455548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4944e769-20aa-4122-9ae3-f4b20ddc1e4d {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:49:41 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-a858b703-c79c-4e14-81a5-9627796b2e2a tempest-TaggedAttachmentsTest-1197600787 None] Created volume successfully. Jul 10 15:49:41 devstack sudo[89573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4944e769-20aa-4122-9ae3-f4b20ddc1e4d Jul 10 15:49:41 devstack sudo[89573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:49:42 devstack sudo[89573]: pam_unix(sudo:session): session closed for user root Jul 10 15:49:42 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-01cdf652-c56b-43c7-9c81-fec9235f0ca7 tempest-GroupSnapshotsTest-1929455548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4944e769-20aa-4122-9ae3-f4b20ddc1e4d" returned: 0 in 0.846s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:49:42 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-01cdf652-c56b-43c7-9c81-fec9235f0ca7 tempest-GroupSnapshotsTest-1929455548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4944e769-20aa-4122-9ae3-f4b20ddc1e4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4944e769-20aa-4122-9ae3-f4b20ddc1e4d.d5f5aef2-c895-4cfb-8459-a5fe7e38c38c 1G {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:49:42 devstack sudo[89579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4944e769-20aa-4122-9ae3-f4b20ddc1e4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4944e769-20aa-4122-9ae3-f4b20ddc1e4d.d5f5aef2-c895-4cfb-8459-a5fe7e38c38c 1G Jul 10 15:49:42 devstack sudo[89579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:49:43 devstack sudo[89579]: pam_unix(sudo:session): session closed for user root Jul 10 15:49:43 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-01cdf652-c56b-43c7-9c81-fec9235f0ca7 tempest-GroupSnapshotsTest-1929455548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4944e769-20aa-4122-9ae3-f4b20ddc1e4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4944e769-20aa-4122-9ae3-f4b20ddc1e4d.d5f5aef2-c895-4cfb-8459-a5fe7e38c38c 1G" returned: 0 in 0.959s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:49:43 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-01cdf652-c56b-43c7-9c81-fec9235f0ca7 tempest-GroupSnapshotsTest-1929455548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4944e769-20aa-4122-9ae3-f4b20ddc1e4d -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4944e769-20aa-4122-9ae3-f4b20ddc1e4d.d5f5aef2-c895-4cfb-8459-a5fe7e38c38c {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:49:43 devstack sudo[89592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4944e769-20aa-4122-9ae3-f4b20ddc1e4d -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4944e769-20aa-4122-9ae3-f4b20ddc1e4d.d5f5aef2-c895-4cfb-8459-a5fe7e38c38c Jul 10 15:49:43 devstack sudo[89592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:49:44 devstack sudo[89592]: pam_unix(sudo:session): session closed for user root Jul 10 15:49:44 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-01cdf652-c56b-43c7-9c81-fec9235f0ca7 tempest-GroupSnapshotsTest-1929455548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4944e769-20aa-4122-9ae3-f4b20ddc1e4d -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4944e769-20aa-4122-9ae3-f4b20ddc1e4d.d5f5aef2-c895-4cfb-8459-a5fe7e38c38c" returned: 0 in 0.876s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:49:44 devstack cinder-volume[87420]: WARNING cinder.volume.drivers.remotefs [None req-01cdf652-c56b-43c7-9c81-fec9235f0ca7 tempest-GroupSnapshotsTest-1929455548 None] /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4944e769-20aa-4122-9ae3-f4b20ddc1e4d.d5f5aef2-c895-4cfb-8459-a5fe7e38c38c is being set with open permissions: ugo+rw: NotImplementedError Jul 10 15:49:44 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-01cdf652-c56b-43c7-9c81-fec9235f0ca7 tempest-GroupSnapshotsTest-1929455548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4944e769-20aa-4122-9ae3-f4b20ddc1e4d.d5f5aef2-c895-4cfb-8459-a5fe7e38c38c {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:49:44 devstack sudo[89604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4944e769-20aa-4122-9ae3-f4b20ddc1e4d.d5f5aef2-c895-4cfb-8459-a5fe7e38c38c Jul 10 15:49:44 devstack sudo[89604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:49:44 devstack sudo[89604]: pam_unix(sudo:session): session closed for user root Jul 10 15:49:44 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-01cdf652-c56b-43c7-9c81-fec9235f0ca7 tempest-GroupSnapshotsTest-1929455548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4944e769-20aa-4122-9ae3-f4b20ddc1e4d.d5f5aef2-c895-4cfb-8459-a5fe7e38c38c" returned: 0 in 0.752s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:49:44 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-01cdf652-c56b-43c7-9c81-fec9235f0ca7 tempest-GroupSnapshotsTest-1929455548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4944e769-20aa-4122-9ae3-f4b20ddc1e4d.info {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:49:44 devstack sudo[89631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4944e769-20aa-4122-9ae3-f4b20ddc1e4d.info Jul 10 15:49:44 devstack sudo[89631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:49:45 devstack sudo[89631]: pam_unix(sudo:session): session closed for user root Jul 10 15:49:45 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-01cdf652-c56b-43c7-9c81-fec9235f0ca7 tempest-GroupSnapshotsTest-1929455548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4944e769-20aa-4122-9ae3-f4b20ddc1e4d.info" returned: 0 in 0.815s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:49:45 devstack cinder-volume[87420]: WARNING cinder.volume.drivers.remotefs [None req-01cdf652-c56b-43c7-9c81-fec9235f0ca7 tempest-GroupSnapshotsTest-1929455548 None] /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4944e769-20aa-4122-9ae3-f4b20ddc1e4d.info is being set with open permissions: ugo+rw: NotImplementedError Jul 10 15:49:45 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-01cdf652-c56b-43c7-9c81-fec9235f0ca7 tempest-GroupSnapshotsTest-1929455548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4944e769-20aa-4122-9ae3-f4b20ddc1e4d.info {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:49:45 devstack sudo[89635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4944e769-20aa-4122-9ae3-f4b20ddc1e4d.info Jul 10 15:49:45 devstack sudo[89635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:49:46 devstack sudo[89635]: pam_unix(sudo:session): session closed for user root Jul 10 15:49:46 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-01cdf652-c56b-43c7-9c81-fec9235f0ca7 tempest-GroupSnapshotsTest-1929455548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4944e769-20aa-4122-9ae3-f4b20ddc1e4d.info" returned: 0 in 0.793s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:49:46 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-01cdf652-c56b-43c7-9c81-fec9235f0ca7 tempest-GroupSnapshotsTest-1929455548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.182s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:49:46 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-01cdf652-c56b-43c7-9c81-fec9235f0ca7 tempest-GroupSnapshotsTest-1929455548 None] group_snapshot 80d8c4a8-8e45-44fe-bd50-6b4fdca38577: created successfully Jul 10 15:49:49 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-22c499d6-6740-4600-87db-46727c618127 tempest-GroupSnapshotsTest-1929455548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:49:49 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-22c499d6-6740-4600-87db-46727c618127 tempest-GroupSnapshotsTest-1929455548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:49:49 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-22c499d6-6740-4600-87db-46727c618127 tempest-GroupSnapshotsTest-1929455548 None] Acquiring lock "cinder-quobyte-d5f5aef2-c895-4cfb-8459-a5fe7e38c38c-e1d728a3-6ada-47ee-aabe-d00f8f2c6853" by "_create_volume_from_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:49:49 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-22c499d6-6740-4600-87db-46727c618127 tempest-GroupSnapshotsTest-1929455548 None] Lock "cinder-quobyte-d5f5aef2-c895-4cfb-8459-a5fe7e38c38c-e1d728a3-6ada-47ee-aabe-d00f8f2c6853" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:49:49 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-22c499d6-6740-4600-87db-46727c618127 tempest-GroupSnapshotsTest-1929455548 None] Creating volume e1d728a3-6ada-47ee-aabe-d00f8f2c6853 from snapshot d5f5aef2-c895-4cfb-8459-a5fe7e38c38c {{(pid=87420) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 10 15:49:49 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-22c499d6-6740-4600-87db-46727c618127 tempest-GroupSnapshotsTest-1929455548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:49:49 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-22c499d6-6740-4600-87db-46727c618127 tempest-GroupSnapshotsTest-1929455548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:49:49 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-22c499d6-6740-4600-87db-46727c618127 tempest-GroupSnapshotsTest-1929455548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:49:49 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-22c499d6-6740-4600-87db-46727c618127 tempest-GroupSnapshotsTest-1929455548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:49:49 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-22c499d6-6740-4600-87db-46727c618127 tempest-GroupSnapshotsTest-1929455548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:49:49 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-22c499d6-6740-4600-87db-46727c618127 tempest-GroupSnapshotsTest-1929455548 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 15:49:49 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-22c499d6-6740-4600-87db-46727c618127 tempest-GroupSnapshotsTest-1929455548 None] Acquiring lock "cinder-quobyte-e1d728a3-6ada-47ee-aabe-d00f8f2c6853" by "_copy_volume_from_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:49:49 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-22c499d6-6740-4600-87db-46727c618127 tempest-GroupSnapshotsTest-1929455548 None] Lock "cinder-quobyte-e1d728a3-6ada-47ee-aabe-d00f8f2c6853" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:49:49 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-22c499d6-6740-4600-87db-46727c618127 tempest-GroupSnapshotsTest-1929455548 None] snapshot: d5f5aef2-c895-4cfb-8459-a5fe7e38c38c, volume: e1d728a3-6ada-47ee-aabe-d00f8f2c6853, {{(pid=87420) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 15:49:49 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-22c499d6-6740-4600-87db-46727c618127 tempest-GroupSnapshotsTest-1929455548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:49:49 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-22c499d6-6740-4600-87db-46727c618127 tempest-GroupSnapshotsTest-1929455548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:49:49 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-22c499d6-6740-4600-87db-46727c618127 tempest-GroupSnapshotsTest-1929455548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:49:49 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-22c499d6-6740-4600-87db-46727c618127 tempest-GroupSnapshotsTest-1929455548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:49:49 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-22c499d6-6740-4600-87db-46727c618127 tempest-GroupSnapshotsTest-1929455548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:49:49 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f5cd9ac-556a-4670-90cc-7bea38ce1dec]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:49:49 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-22c499d6-6740-4600-87db-46727c618127 tempest-GroupSnapshotsTest-1929455548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4944e769-20aa-4122-9ae3-f4b20ddc1e4d.d5f5aef2-c895-4cfb-8459-a5fe7e38c38c {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:49:49 devstack sudo[89645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4944e769-20aa-4122-9ae3-f4b20ddc1e4d.d5f5aef2-c895-4cfb-8459-a5fe7e38c38c Jul 10 15:49:49 devstack sudo[89645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:49:50 devstack sudo[89645]: pam_unix(sudo:session): session closed for user root Jul 10 15:49:50 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-22c499d6-6740-4600-87db-46727c618127 tempest-GroupSnapshotsTest-1929455548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4944e769-20aa-4122-9ae3-f4b20ddc1e4d.d5f5aef2-c895-4cfb-8459-a5fe7e38c38c" returned: 0 in 1.123s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:49:50 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-22c499d6-6740-4600-87db-46727c618127 tempest-GroupSnapshotsTest-1929455548 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4944e769-20aa-4122-9ae3-f4b20ddc1e4d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87420) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 15:49:50 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-22c499d6-6740-4600-87db-46727c618127 tempest-GroupSnapshotsTest-1929455548 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4944e769-20aa-4122-9ae3-f4b20ddc1e4d {{(pid=87420) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 15:49:50 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-22c499d6-6740-4600-87db-46727c618127 tempest-GroupSnapshotsTest-1929455548 None] Creating direct copy from snapshot {{(pid=87420) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 15:49:50 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d90fe52-4a20-4a5b-8e9e-09510c897d70]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:49:50 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-22c499d6-6740-4600-87db-46727c618127 tempest-GroupSnapshotsTest-1929455548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4944e769-20aa-4122-9ae3-f4b20ddc1e4d {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:49:50 devstack sudo[89671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4944e769-20aa-4122-9ae3-f4b20ddc1e4d Jul 10 15:49:50 devstack sudo[89671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:49:51 devstack sudo[89671]: pam_unix(sudo:session): session closed for user root Jul 10 15:49:51 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-22c499d6-6740-4600-87db-46727c618127 tempest-GroupSnapshotsTest-1929455548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4944e769-20aa-4122-9ae3-f4b20ddc1e4d" returned: 0 in 0.893s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:49:51 devstack cinder-volume[87420]: DEBUG cinder.utils [None req-22c499d6-6740-4600-87db-46727c618127 tempest-GroupSnapshotsTest-1929455548 None] Path /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-e1d728a3-6ada-47ee-aabe-d00f8f2c6853 not found in is_blk_device check {{(pid=87420) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 15:49:51 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-22c499d6-6740-4600-87db-46727c618127 tempest-GroupSnapshotsTest-1929455548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4944e769-20aa-4122-9ae3-f4b20ddc1e4d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-e1d728a3-6ada-47ee-aabe-d00f8f2c6853 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:49:51 devstack sudo[89700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4944e769-20aa-4122-9ae3-f4b20ddc1e4d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-e1d728a3-6ada-47ee-aabe-d00f8f2c6853 Jul 10 15:49:51 devstack sudo[89700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:49:54 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-c686d68d-4aac-415e-8ffe-53a4f173f36d tempest-ServerRescueNegativeTestJSON-57207049 None] Acquiring lock "cinder-c21ba4a7-7f79-40ab-882d-11c88d4dcdf1-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:49:54 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-c686d68d-4aac-415e-8ffe-53a4f173f36d tempest-ServerRescueNegativeTestJSON-57207049 None] Lock "cinder-c21ba4a7-7f79-40ab-882d-11c88d4dcdf1-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:49:54 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-c686d68d-4aac-415e-8ffe-53a4f173f36d tempest-ServerRescueNegativeTestJSON-57207049 None] Acquiring lock "cinder-quobyte-c21ba4a7-7f79-40ab-882d-11c88d4dcdf1" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:49:54 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-c686d68d-4aac-415e-8ffe-53a4f173f36d tempest-ServerRescueNegativeTestJSON-57207049 None] Lock "cinder-quobyte-c21ba4a7-7f79-40ab-882d-11c88d4dcdf1" acquired by "delete_volume" :: waited 0.062s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:49:55 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fc390ac-19f4-45fd-8bd7-b08c01116a8f]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:49:55 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c686d68d-4aac-415e-8ffe-53a4f173f36d tempest-ServerRescueNegativeTestJSON-57207049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-c21ba4a7-7f79-40ab-882d-11c88d4dcdf1 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:49:55 devstack sudo[89743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-c21ba4a7-7f79-40ab-882d-11c88d4dcdf1 Jul 10 15:49:55 devstack sudo[89743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:49:58 devstack sudo[89743]: pam_unix(sudo:session): session closed for user root Jul 10 15:49:58 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c686d68d-4aac-415e-8ffe-53a4f173f36d tempest-ServerRescueNegativeTestJSON-57207049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-c21ba4a7-7f79-40ab-882d-11c88d4dcdf1" returned: 0 in 3.021s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:49:58 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c686d68d-4aac-415e-8ffe-53a4f173f36d tempest-ServerRescueNegativeTestJSON-57207049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-c21ba4a7-7f79-40ab-882d-11c88d4dcdf1 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:49:58 devstack sudo[89768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-c21ba4a7-7f79-40ab-882d-11c88d4dcdf1 Jul 10 15:49:58 devstack sudo[89768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:50:01 devstack sudo[89768]: pam_unix(sudo:session): session closed for user root Jul 10 15:50:01 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c686d68d-4aac-415e-8ffe-53a4f173f36d tempest-ServerRescueNegativeTestJSON-57207049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-c21ba4a7-7f79-40ab-882d-11c88d4dcdf1" returned: 0 in 3.116s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:50:01 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-c686d68d-4aac-415e-8ffe-53a4f173f36d tempest-ServerRescueNegativeTestJSON-57207049 None] Lock "cinder-quobyte-c21ba4a7-7f79-40ab-882d-11c88d4dcdf1" released by "delete_volume" :: held 6.390s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:50:01 devstack sudo[89700]: pam_unix(sudo:session): session closed for user root Jul 10 15:50:01 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-22c499d6-6740-4600-87db-46727c618127 tempest-GroupSnapshotsTest-1929455548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4944e769-20aa-4122-9ae3-f4b20ddc1e4d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-e1d728a3-6ada-47ee-aabe-d00f8f2c6853" returned: 0 in 10.222s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:50:01 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb2043f5-6472-42fb-80e7-79cf3f7da31d]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:50:01 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-22c499d6-6740-4600-87db-46727c618127 tempest-GroupSnapshotsTest-1929455548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4944e769-20aa-4122-9ae3-f4b20ddc1e4d {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:50:01 devstack sudo[89850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4944e769-20aa-4122-9ae3-f4b20ddc1e4d Jul 10 15:50:01 devstack sudo[89850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:50:01 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-c686d68d-4aac-415e-8ffe-53a4f173f36d tempest-ServerRescueNegativeTestJSON-57207049 None] Created reservations ['64ae13a9-adb2-45c1-a150-6c196050ea1f', '83bd404b-fbc0-4084-bd5f-fd56dbcc0f84', 'ab6a58cd-edb5-4a2a-b8c6-b6efa4a36338', 'c96b4d62-e74e-4ab0-8706-54a3093b0517'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 15:50:02 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-c686d68d-4aac-415e-8ffe-53a4f173f36d tempest-ServerRescueNegativeTestJSON-57207049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:50:02 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-c686d68d-4aac-415e-8ffe-53a4f173f36d tempest-ServerRescueNegativeTestJSON-57207049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:50:02 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-c686d68d-4aac-415e-8ffe-53a4f173f36d tempest-ServerRescueNegativeTestJSON-57207049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:50:02 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-c686d68d-4aac-415e-8ffe-53a4f173f36d tempest-ServerRescueNegativeTestJSON-57207049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:50:02 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-c686d68d-4aac-415e-8ffe-53a4f173f36d tempest-ServerRescueNegativeTestJSON-57207049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:50:02 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c686d68d-4aac-415e-8ffe-53a4f173f36d tempest-ServerRescueNegativeTestJSON-57207049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:50:02 devstack sudo[89852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 15:50:02 devstack sudo[89852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:50:04 devstack sudo[89852]: pam_unix(sudo:session): session closed for user root Jul 10 15:50:04 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c686d68d-4aac-415e-8ffe-53a4f173f36d tempest-ServerRescueNegativeTestJSON-57207049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 2.121s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:50:04 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-c686d68d-4aac-415e-8ffe-53a4f173f36d tempest-ServerRescueNegativeTestJSON-57207049 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 15:50:04 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-c686d68d-4aac-415e-8ffe-53a4f173f36d tempest-ServerRescueNegativeTestJSON-57207049 None] Deleted volume successfully. Jul 10 15:50:04 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-c686d68d-4aac-415e-8ffe-53a4f173f36d tempest-ServerRescueNegativeTestJSON-57207049 None] Lock "cinder-c21ba4a7-7f79-40ab-882d-11c88d4dcdf1-delete_volume" released by "delete_volume" :: held 9.504s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:50:04 devstack sudo[89850]: pam_unix(sudo:session): session closed for user root Jul 10 15:50:04 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-22c499d6-6740-4600-87db-46727c618127 tempest-GroupSnapshotsTest-1929455548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4944e769-20aa-4122-9ae3-f4b20ddc1e4d" returned: 0 in 3.130s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:50:04 devstack cinder-volume[87420]: DEBUG cinder.image.image_utils [None req-22c499d6-6740-4600-87db-46727c618127 tempest-GroupSnapshotsTest-1929455548 None] Image conversion details: src /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4944e769-20aa-4122-9ae3-f4b20ddc1e4d, size 1024.00 MB, duration 10.22 sec, destination /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-e1d728a3-6ada-47ee-aabe-d00f8f2c6853 {{(pid=87420) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 15:50:04 devstack cinder-volume[87420]: INFO cinder.image.image_utils [None req-22c499d6-6740-4600-87db-46727c618127 tempest-GroupSnapshotsTest-1929455548 None] Converted 1024.00 MB image at 100.16 MB/s Jul 10 15:50:04 devstack cinder-volume[87420]: WARNING cinder.volume.drivers.remotefs [None req-22c499d6-6740-4600-87db-46727c618127 tempest-GroupSnapshotsTest-1929455548 None] /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-e1d728a3-6ada-47ee-aabe-d00f8f2c6853 is being set with open permissions: ugo+rw: NotImplementedError Jul 10 15:50:04 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-22c499d6-6740-4600-87db-46727c618127 tempest-GroupSnapshotsTest-1929455548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-e1d728a3-6ada-47ee-aabe-d00f8f2c6853 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:50:04 devstack sudo[89865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-e1d728a3-6ada-47ee-aabe-d00f8f2c6853 Jul 10 15:50:04 devstack sudo[89865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:50:06 devstack sudo[89865]: pam_unix(sudo:session): session closed for user root Jul 10 15:50:06 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-22c499d6-6740-4600-87db-46727c618127 tempest-GroupSnapshotsTest-1929455548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-e1d728a3-6ada-47ee-aabe-d00f8f2c6853" returned: 0 in 1.594s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:50:06 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-22c499d6-6740-4600-87db-46727c618127 tempest-GroupSnapshotsTest-1929455548 None] Lock "cinder-quobyte-e1d728a3-6ada-47ee-aabe-d00f8f2c6853" released by "_copy_volume_from_snapshot" :: held 17.212s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:50:06 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-22c499d6-6740-4600-87db-46727c618127 tempest-GroupSnapshotsTest-1929455548 None] Lock "cinder-quobyte-d5f5aef2-c895-4cfb-8459-a5fe7e38c38c-e1d728a3-6ada-47ee-aabe-d00f8f2c6853" released by "_create_volume_from_snapshot" :: held 17.265s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:50:06 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-22c499d6-6740-4600-87db-46727c618127 tempest-GroupSnapshotsTest-1929455548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 17.294s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:50:06 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-22c499d6-6740-4600-87db-46727c618127 tempest-GroupSnapshotsTest-1929455548 None] Create group from source-snapshot-80d8c4a8-8e45-44fe-bd50-6b4fdca38577 completed successfully. Jul 10 15:50:08 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-7b169653-65ad-4190-a376-a2f068c4ac13 tempest-GroupSnapshotsTest-1929455548 None] Acquiring lock "cinder-quobyte-e1d728a3-6ada-47ee-aabe-d00f8f2c6853" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:50:08 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-7b169653-65ad-4190-a376-a2f068c4ac13 tempest-GroupSnapshotsTest-1929455548 None] Lock "cinder-quobyte-e1d728a3-6ada-47ee-aabe-d00f8f2c6853" acquired by "delete_volume" :: waited 0.035s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:50:08 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[72d9ef7c-c5e9-4de9-a76b-4932f70de558]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:50:08 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-7b169653-65ad-4190-a376-a2f068c4ac13 tempest-GroupSnapshotsTest-1929455548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-e1d728a3-6ada-47ee-aabe-d00f8f2c6853 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:50:08 devstack sudo[89965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-e1d728a3-6ada-47ee-aabe-d00f8f2c6853 Jul 10 15:50:08 devstack sudo[89965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:50:10 devstack sudo[89965]: pam_unix(sudo:session): session closed for user root Jul 10 15:50:10 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-7b169653-65ad-4190-a376-a2f068c4ac13 tempest-GroupSnapshotsTest-1929455548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-e1d728a3-6ada-47ee-aabe-d00f8f2c6853" returned: 0 in 1.600s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:50:10 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-7b169653-65ad-4190-a376-a2f068c4ac13 tempest-GroupSnapshotsTest-1929455548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-e1d728a3-6ada-47ee-aabe-d00f8f2c6853 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:50:10 devstack sudo[89976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-e1d728a3-6ada-47ee-aabe-d00f8f2c6853 Jul 10 15:50:10 devstack sudo[89976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:50:11 devstack sudo[89976]: pam_unix(sudo:session): session closed for user root Jul 10 15:50:11 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-7b169653-65ad-4190-a376-a2f068c4ac13 tempest-GroupSnapshotsTest-1929455548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-e1d728a3-6ada-47ee-aabe-d00f8f2c6853" returned: 0 in 0.895s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:50:11 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-7b169653-65ad-4190-a376-a2f068c4ac13 tempest-GroupSnapshotsTest-1929455548 None] Lock "cinder-quobyte-e1d728a3-6ada-47ee-aabe-d00f8f2c6853" released by "delete_volume" :: held 2.580s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:50:11 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-7b169653-65ad-4190-a376-a2f068c4ac13 tempest-GroupSnapshotsTest-1929455548 None] Created reservations ['a38ebd91-2d31-4a61-87cb-fe7354a84e19'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 15:50:11 devstack cinder-volume[87420]: WARNING cinder.quota [None req-7b169653-65ad-4190-a376-a2f068c4ac13 tempest-GroupSnapshotsTest-1929455548 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-430578504 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-430578504, it is now deprecated. Please use the default quota class for default quota. Jul 10 15:50:11 devstack cinder-volume[87420]: WARNING cinder.quota [None req-7b169653-65ad-4190-a376-a2f068c4ac13 tempest-GroupSnapshotsTest-1929455548 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-430578504 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-430578504, it is now deprecated. Please use the default quota class for default quota. Jul 10 15:50:11 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-7b169653-65ad-4190-a376-a2f068c4ac13 tempest-GroupSnapshotsTest-1929455548 None] Created reservations ['1de81650-4c82-4dc9-9f87-d420e4d4ae4f', 'f577efdd-2b8f-4df3-b6c4-5656e5b5378b', 'edf6e82b-0923-470e-8d21-a1d3c3b6ebcd', '092b034e-da75-4807-b155-aeab14c37488'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 15:50:11 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-7b169653-65ad-4190-a376-a2f068c4ac13 tempest-GroupSnapshotsTest-1929455548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:50:11 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-7b169653-65ad-4190-a376-a2f068c4ac13 tempest-GroupSnapshotsTest-1929455548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:50:11 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-7b169653-65ad-4190-a376-a2f068c4ac13 tempest-GroupSnapshotsTest-1929455548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:50:11 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-7b169653-65ad-4190-a376-a2f068c4ac13 tempest-GroupSnapshotsTest-1929455548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:50:11 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-7b169653-65ad-4190-a376-a2f068c4ac13 tempest-GroupSnapshotsTest-1929455548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:50:11 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-7b169653-65ad-4190-a376-a2f068c4ac13 tempest-GroupSnapshotsTest-1929455548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:50:11 devstack sudo[89981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 15:50:11 devstack sudo[89981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:50:12 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-7a4d9331-fe1f-452b-9e56-9c7d460c93e2 tempest-GroupSnapshotsTest-1929455548 None] group_snapshot 80d8c4a8-8e45-44fe-bd50-6b4fdca38577: deleting Jul 10 15:50:12 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-7a4d9331-fe1f-452b-9e56-9c7d460c93e2 tempest-GroupSnapshotsTest-1929455548 None] group_snapshot 80d8c4a8-8e45-44fe-bd50-6b4fdca38577: deleting {{(pid=87420) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 10 15:50:12 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-7a4d9331-fe1f-452b-9e56-9c7d460c93e2 tempest-GroupSnapshotsTest-1929455548 None] Acquiring lock "cinder-quobyte-4944e769-20aa-4122-9ae3-f4b20ddc1e4d" by "delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:50:13 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-7a4d9331-fe1f-452b-9e56-9c7d460c93e2 tempest-GroupSnapshotsTest-1929455548 None] Lock "cinder-quobyte-4944e769-20aa-4122-9ae3-f4b20ddc1e4d" acquired by "delete_snapshot" :: waited 0.072s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:50:13 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-7a4d9331-fe1f-452b-9e56-9c7d460c93e2 tempest-GroupSnapshotsTest-1929455548 None] Acquiring lock "cinder-quobyte-d5f5aef2-c895-4cfb-8459-a5fe7e38c38c" by "_delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:50:13 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-7a4d9331-fe1f-452b-9e56-9c7d460c93e2 tempest-GroupSnapshotsTest-1929455548 None] Lock "cinder-quobyte-d5f5aef2-c895-4cfb-8459-a5fe7e38c38c" acquired by "_delete_snapshot" :: waited 0.046s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:50:13 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-7a4d9331-fe1f-452b-9e56-9c7d460c93e2 tempest-GroupSnapshotsTest-1929455548 None] Deleting offline snapshot d5f5aef2-c895-4cfb-8459-a5fe7e38c38c of volume 4944e769-20aa-4122-9ae3-f4b20ddc1e4d {{(pid=87420) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 15:50:13 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-7a4d9331-fe1f-452b-9e56-9c7d460c93e2 tempest-GroupSnapshotsTest-1929455548 None] snapshot_file for this snap is: volume-4944e769-20aa-4122-9ae3-f4b20ddc1e4d.d5f5aef2-c895-4cfb-8459-a5fe7e38c38c {{(pid=87420) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 15:50:13 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd158bc2-bf97-4a90-8d55-582c8b0a6423]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:50:13 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-7a4d9331-fe1f-452b-9e56-9c7d460c93e2 tempest-GroupSnapshotsTest-1929455548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4944e769-20aa-4122-9ae3-f4b20ddc1e4d.d5f5aef2-c895-4cfb-8459-a5fe7e38c38c {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:50:13 devstack sudo[89981]: pam_unix(sudo:session): session closed for user root Jul 10 15:50:13 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-7b169653-65ad-4190-a376-a2f068c4ac13 tempest-GroupSnapshotsTest-1929455548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 1.689s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:50:13 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-7b169653-65ad-4190-a376-a2f068c4ac13 tempest-GroupSnapshotsTest-1929455548 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 15:50:13 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-7b169653-65ad-4190-a376-a2f068c4ac13 tempest-GroupSnapshotsTest-1929455548 None] Delete group completed successfully. Jul 10 15:50:13 devstack sudo[89988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4944e769-20aa-4122-9ae3-f4b20ddc1e4d.d5f5aef2-c895-4cfb-8459-a5fe7e38c38c Jul 10 15:50:13 devstack sudo[89988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:50:14 devstack sudo[89988]: pam_unix(sudo:session): session closed for user root Jul 10 15:50:14 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-7a4d9331-fe1f-452b-9e56-9c7d460c93e2 tempest-GroupSnapshotsTest-1929455548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4944e769-20aa-4122-9ae3-f4b20ddc1e4d.d5f5aef2-c895-4cfb-8459-a5fe7e38c38c" returned: 0 in 1.275s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:50:14 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-7a4d9331-fe1f-452b-9e56-9c7d460c93e2 tempest-GroupSnapshotsTest-1929455548 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4944e769-20aa-4122-9ae3-f4b20ddc1e4d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87420) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 15:50:14 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[167a665e-2c0a-454a-9014-2cda0718fdc8]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:50:14 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-7a4d9331-fe1f-452b-9e56-9c7d460c93e2 tempest-GroupSnapshotsTest-1929455548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4944e769-20aa-4122-9ae3-f4b20ddc1e4d {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:50:14 devstack sudo[90000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4944e769-20aa-4122-9ae3-f4b20ddc1e4d Jul 10 15:50:14 devstack sudo[90000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:50:16 devstack sudo[90000]: pam_unix(sudo:session): session closed for user root Jul 10 15:50:16 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-7a4d9331-fe1f-452b-9e56-9c7d460c93e2 tempest-GroupSnapshotsTest-1929455548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4944e769-20aa-4122-9ae3-f4b20ddc1e4d" returned: 0 in 1.510s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:50:16 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-7a4d9331-fe1f-452b-9e56-9c7d460c93e2 tempest-GroupSnapshotsTest-1929455548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4944e769-20aa-4122-9ae3-f4b20ddc1e4d.d5f5aef2-c895-4cfb-8459-a5fe7e38c38c {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:50:16 devstack sudo[90024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4944e769-20aa-4122-9ae3-f4b20ddc1e4d.d5f5aef2-c895-4cfb-8459-a5fe7e38c38c Jul 10 15:50:16 devstack sudo[90024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:50:17 devstack sudo[90024]: pam_unix(sudo:session): session closed for user root Jul 10 15:50:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-7a4d9331-fe1f-452b-9e56-9c7d460c93e2 tempest-GroupSnapshotsTest-1929455548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4944e769-20aa-4122-9ae3-f4b20ddc1e4d.d5f5aef2-c895-4cfb-8459-a5fe7e38c38c" returned: 0 in 1.170s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:50:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-7a4d9331-fe1f-452b-9e56-9c7d460c93e2 tempest-GroupSnapshotsTest-1929455548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4944e769-20aa-4122-9ae3-f4b20ddc1e4d.d5f5aef2-c895-4cfb-8459-a5fe7e38c38c {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:50:17 devstack sudo[90032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4944e769-20aa-4122-9ae3-f4b20ddc1e4d.d5f5aef2-c895-4cfb-8459-a5fe7e38c38c Jul 10 15:50:17 devstack sudo[90032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:50:17 devstack cinder-volume[87420]: DEBUG oslo_service.periodic_task [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87420) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 15:50:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:50:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:50:17 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:50:17 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:50:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:50:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:50:17 devstack sudo[90049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 15:50:17 devstack sudo[90049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:50:18 devstack sudo[90032]: pam_unix(sudo:session): session closed for user root Jul 10 15:50:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-7a4d9331-fe1f-452b-9e56-9c7d460c93e2 tempest-GroupSnapshotsTest-1929455548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4944e769-20aa-4122-9ae3-f4b20ddc1e4d.d5f5aef2-c895-4cfb-8459-a5fe7e38c38c" returned: 0 in 0.797s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:50:18 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-7a4d9331-fe1f-452b-9e56-9c7d460c93e2 tempest-GroupSnapshotsTest-1929455548 None] Lock "cinder-quobyte-d5f5aef2-c895-4cfb-8459-a5fe7e38c38c" released by "_delete_snapshot" :: held 4.967s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:50:18 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-7a4d9331-fe1f-452b-9e56-9c7d460c93e2 tempest-GroupSnapshotsTest-1929455548 None] Lock "cinder-quobyte-4944e769-20aa-4122-9ae3-f4b20ddc1e4d" released by "delete_snapshot" :: held 5.023s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:50:18 devstack cinder-volume[87420]: WARNING cinder.quota [None req-7a4d9331-fe1f-452b-9e56-9c7d460c93e2 tempest-GroupSnapshotsTest-1929455548 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-430578504 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-430578504, it is now deprecated. Please use the default quota class for default quota. Jul 10 15:50:18 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-7a4d9331-fe1f-452b-9e56-9c7d460c93e2 tempest-GroupSnapshotsTest-1929455548 None] Created reservations ['7f7217d6-8509-4b29-84de-f24e746f3d4c', 'e1d66107-5eca-4e34-a25e-2ec68d781457', 'f54d74d4-b2be-4739-9999-1ee2d638f533', '5ef7ef49-0aab-4d28-813a-9aa4ca7fe3f3'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 15:50:18 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-7a4d9331-fe1f-452b-9e56-9c7d460c93e2 tempest-GroupSnapshotsTest-1929455548 None] group_snapshot 80d8c4a8-8e45-44fe-bd50-6b4fdca38577: deleted successfully Jul 10 15:50:18 devstack sudo[90049]: pam_unix(sudo:session): session closed for user root Jul 10 15:50:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.968s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:50:18 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 15:50:19 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-69024eb3-d22b-43bc-945c-abfd37013794 tempest-GroupSnapshotsTest-1929455548 None] Acquiring lock "cinder-quobyte-4944e769-20aa-4122-9ae3-f4b20ddc1e4d" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:50:19 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-69024eb3-d22b-43bc-945c-abfd37013794 tempest-GroupSnapshotsTest-1929455548 None] Lock "cinder-quobyte-4944e769-20aa-4122-9ae3-f4b20ddc1e4d" acquired by "delete_volume" :: waited 0.021s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:50:19 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2a90fc5-7c31-4f56-ac13-9226e17da657]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:50:19 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-69024eb3-d22b-43bc-945c-abfd37013794 tempest-GroupSnapshotsTest-1929455548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4944e769-20aa-4122-9ae3-f4b20ddc1e4d {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:50:19 devstack sudo[90054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4944e769-20aa-4122-9ae3-f4b20ddc1e4d Jul 10 15:50:19 devstack sudo[90054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:50:20 devstack sudo[90054]: pam_unix(sudo:session): session closed for user root Jul 10 15:50:20 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-69024eb3-d22b-43bc-945c-abfd37013794 tempest-GroupSnapshotsTest-1929455548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4944e769-20aa-4122-9ae3-f4b20ddc1e4d" returned: 0 in 0.845s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:50:20 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-69024eb3-d22b-43bc-945c-abfd37013794 tempest-GroupSnapshotsTest-1929455548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4944e769-20aa-4122-9ae3-f4b20ddc1e4d {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:50:20 devstack sudo[90059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4944e769-20aa-4122-9ae3-f4b20ddc1e4d Jul 10 15:50:20 devstack sudo[90059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:50:20 devstack sudo[90059]: pam_unix(sudo:session): session closed for user root Jul 10 15:50:20 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-69024eb3-d22b-43bc-945c-abfd37013794 tempest-GroupSnapshotsTest-1929455548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4944e769-20aa-4122-9ae3-f4b20ddc1e4d" returned: 0 in 0.662s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:50:20 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-69024eb3-d22b-43bc-945c-abfd37013794 tempest-GroupSnapshotsTest-1929455548 None] Lock "cinder-quobyte-4944e769-20aa-4122-9ae3-f4b20ddc1e4d" released by "delete_volume" :: held 1.598s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:50:20 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-69024eb3-d22b-43bc-945c-abfd37013794 tempest-GroupSnapshotsTest-1929455548 None] Created reservations ['059a0d99-f678-42fa-9c9b-db028a6aa01e'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 15:50:20 devstack cinder-volume[87420]: WARNING cinder.db.api [None req-69024eb3-d22b-43bc-945c-abfd37013794 tempest-GroupSnapshotsTest-1929455548 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-430578504'] Jul 10 15:50:20 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-69024eb3-d22b-43bc-945c-abfd37013794 tempest-GroupSnapshotsTest-1929455548 None] Created reservations ['4f46514b-a84a-4f50-a856-3415e0d5bfd9', '13ff6560-1846-423c-ad2b-7a722efc5ec4', '3953bb6c-eba3-41b3-9b17-ad34e1dd9968', '563776f7-7bdb-4c49-8c79-0008e085bc40'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 15:50:20 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-69024eb3-d22b-43bc-945c-abfd37013794 tempest-GroupSnapshotsTest-1929455548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:50:20 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-69024eb3-d22b-43bc-945c-abfd37013794 tempest-GroupSnapshotsTest-1929455548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:50:20 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-69024eb3-d22b-43bc-945c-abfd37013794 tempest-GroupSnapshotsTest-1929455548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:50:20 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-69024eb3-d22b-43bc-945c-abfd37013794 tempest-GroupSnapshotsTest-1929455548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:50:20 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-69024eb3-d22b-43bc-945c-abfd37013794 tempest-GroupSnapshotsTest-1929455548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:50:20 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-69024eb3-d22b-43bc-945c-abfd37013794 tempest-GroupSnapshotsTest-1929455548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:50:20 devstack sudo[90062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 15:50:20 devstack sudo[90062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:50:21 devstack sudo[90062]: pam_unix(sudo:session): session closed for user root Jul 10 15:50:21 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-69024eb3-d22b-43bc-945c-abfd37013794 tempest-GroupSnapshotsTest-1929455548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.787s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:50:21 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-69024eb3-d22b-43bc-945c-abfd37013794 tempest-GroupSnapshotsTest-1929455548 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 15:50:21 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-69024eb3-d22b-43bc-945c-abfd37013794 tempest-GroupSnapshotsTest-1929455548 None] Delete group completed successfully. Jul 10 15:50:22 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-963e57fa-a02d-4097-bc94-6112cfd521ba tempest-GroupSnapshotsTest-1929455548 None] Group tempest-GroupSnapshotsTest-Group-1018796198: creating Jul 10 15:50:22 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-963e57fa-a02d-4097-bc94-6112cfd521ba tempest-GroupSnapshotsTest-1929455548 None] Group tempest-GroupSnapshotsTest-Group-1018796198: created successfully Jul 10 15:50:22 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-963e57fa-a02d-4097-bc94-6112cfd521ba tempest-GroupSnapshotsTest-1929455548 None] Create group completed successfully. Jul 10 15:50:24 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-8835b9e8-e426-4afe-9ed1-47be89f557e2 tempest-GroupSnapshotsTest-1929455548 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 15:50:24 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-8835b9e8-e426-4afe-9ed1-47be89f557e2 tempest-GroupSnapshotsTest-1929455548 None] Flow 'volume_create_manager' (fc8fc091-ebd7-485a-8b41-c7628ade0a3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:50:24 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-8835b9e8-e426-4afe-9ed1-47be89f557e2 tempest-GroupSnapshotsTest-1929455548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52c16af8-bdd8-4348-9afb-d8665c49f1f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:50:24 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-8835b9e8-e426-4afe-9ed1-47be89f557e2 tempest-GroupSnapshotsTest-1929455548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52c16af8-bdd8-4348-9afb-d8665c49f1f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:50:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-818275478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5932c7d7-378d-4ff8-b15b-f0b204f2deaf,host='devstack@QuobyteHD#QuobyteHD',id=ebd76c8f-eefe-470d-b175-65e28cdad708,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e411f85fbd545ba9d5af3a552fec9e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:50:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:50:24Z,use_quota=True,user_id='d71b7302462541a89453c96eb1f7de16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6669c1-95d7-4e2c-925c-ca85f60e6539),volume_type_id=8f6669c1-95d7-4e2c-925c-ca85f60e6539)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:50:24 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-8835b9e8-e426-4afe-9ed1-47be89f557e2 tempest-GroupSnapshotsTest-1929455548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff194a2d-679d-4450-9a93-5c2ed8a4666a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:50:24 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-8835b9e8-e426-4afe-9ed1-47be89f557e2 tempest-GroupSnapshotsTest-1929455548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff194a2d-679d-4450-9a93-5c2ed8a4666a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:50:24 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-8835b9e8-e426-4afe-9ed1-47be89f557e2 tempest-GroupSnapshotsTest-1929455548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c75cbafb-19f2-400d-bd18-255d37cb94b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:50:24 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-8835b9e8-e426-4afe-9ed1-47be89f557e2 tempest-GroupSnapshotsTest-1929455548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c75cbafb-19f2-400d-bd18-255d37cb94b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebd76c8f-eefe-470d-b175-65e28cdad708', 'volume_name': 'volume-ebd76c8f-eefe-470d-b175-65e28cdad708', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:50:24 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-8835b9e8-e426-4afe-9ed1-47be89f557e2 tempest-GroupSnapshotsTest-1929455548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bd3ef19-d4e3-457e-8973-78784ef7da47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:50:24 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-8835b9e8-e426-4afe-9ed1-47be89f557e2 tempest-GroupSnapshotsTest-1929455548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bd3ef19-d4e3-457e-8973-78784ef7da47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:50:24 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-8835b9e8-e426-4afe-9ed1-47be89f557e2 tempest-GroupSnapshotsTest-1929455548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (219f30e5-a6b8-4840-b0c3-9b721940cec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:50:24 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-8835b9e8-e426-4afe-9ed1-47be89f557e2 tempest-GroupSnapshotsTest-1929455548 None] Volume ebd76c8f-eefe-470d-b175-65e28cdad708: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebd76c8f-eefe-470d-b175-65e28cdad708', 'volume_size': 1} Jul 10 15:50:24 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-8835b9e8-e426-4afe-9ed1-47be89f557e2 tempest-GroupSnapshotsTest-1929455548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:50:24 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-8835b9e8-e426-4afe-9ed1-47be89f557e2 tempest-GroupSnapshotsTest-1929455548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:50:24 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-8835b9e8-e426-4afe-9ed1-47be89f557e2 tempest-GroupSnapshotsTest-1929455548 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5932c7d7-378d-4ff8-b15b-f0b204f2deaf,created_at=2026-07-10T13:50:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-818275478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5932c7d7-378d-4ff8-b15b-f0b204f2deaf,host='devstack@QuobyteHD#QuobyteHD',id=ebd76c8f-eefe-470d-b175-65e28cdad708,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e411f85fbd545ba9d5af3a552fec9e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:50:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:50:24Z,use_quota=True,user_id='d71b7302462541a89453c96eb1f7de16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6669c1-95d7-4e2c-925c-ca85f60e6539),volume_type_id=8f6669c1-95d7-4e2c-925c-ca85f60e6539)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 15:50:24 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-8835b9e8-e426-4afe-9ed1-47be89f557e2 tempest-GroupSnapshotsTest-1929455548 None] Creating volume ebd76c8f-eefe-470d-b175-65e28cdad708 {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 15:50:24 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-8835b9e8-e426-4afe-9ed1-47be89f557e2 tempest-GroupSnapshotsTest-1929455548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:50:24 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-8835b9e8-e426-4afe-9ed1-47be89f557e2 tempest-GroupSnapshotsTest-1929455548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:50:24 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-8835b9e8-e426-4afe-9ed1-47be89f557e2 tempest-GroupSnapshotsTest-1929455548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:50:24 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-8835b9e8-e426-4afe-9ed1-47be89f557e2 tempest-GroupSnapshotsTest-1929455548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:50:24 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-8835b9e8-e426-4afe-9ed1-47be89f557e2 tempest-GroupSnapshotsTest-1929455548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:50:24 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-8835b9e8-e426-4afe-9ed1-47be89f557e2 tempest-GroupSnapshotsTest-1929455548 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 15:50:24 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-8835b9e8-e426-4afe-9ed1-47be89f557e2 tempest-GroupSnapshotsTest-1929455548 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 15:50:24 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8835b9e8-e426-4afe-9ed1-47be89f557e2 tempest-GroupSnapshotsTest-1929455548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ebd76c8f-eefe-470d-b175-65e28cdad708 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:50:24 devstack sudo[90080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ebd76c8f-eefe-470d-b175-65e28cdad708 1073741824 Jul 10 15:50:24 devstack sudo[90080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:50:25 devstack sudo[90080]: pam_unix(sudo:session): session closed for user root Jul 10 15:50:25 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8835b9e8-e426-4afe-9ed1-47be89f557e2 tempest-GroupSnapshotsTest-1929455548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ebd76c8f-eefe-470d-b175-65e28cdad708 1073741824" returned: 0 in 1.028s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:50:25 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8835b9e8-e426-4afe-9ed1-47be89f557e2 tempest-GroupSnapshotsTest-1929455548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ebd76c8f-eefe-470d-b175-65e28cdad708 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:50:25 devstack sudo[90124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ebd76c8f-eefe-470d-b175-65e28cdad708 Jul 10 15:50:25 devstack sudo[90124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:50:26 devstack sudo[90124]: pam_unix(sudo:session): session closed for user root Jul 10 15:50:26 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8835b9e8-e426-4afe-9ed1-47be89f557e2 tempest-GroupSnapshotsTest-1929455548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ebd76c8f-eefe-470d-b175-65e28cdad708" returned: 0 in 0.731s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:50:26 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-8835b9e8-e426-4afe-9ed1-47be89f557e2 tempest-GroupSnapshotsTest-1929455548 None] <== create_volume: return (1828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 15:50:26 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-8835b9e8-e426-4afe-9ed1-47be89f557e2 tempest-GroupSnapshotsTest-1929455548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.830s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:50:26 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-8835b9e8-e426-4afe-9ed1-47be89f557e2 tempest-GroupSnapshotsTest-1929455548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (219f30e5-a6b8-4840-b0c3-9b721940cec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebd76c8f-eefe-470d-b175-65e28cdad708', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:50:26 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-8835b9e8-e426-4afe-9ed1-47be89f557e2 tempest-GroupSnapshotsTest-1929455548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c0d796f-a2cb-4cbf-a2b8-4ed044e4f300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:50:26 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-8835b9e8-e426-4afe-9ed1-47be89f557e2 tempest-GroupSnapshotsTest-1929455548 None] Volume volume-ebd76c8f-eefe-470d-b175-65e28cdad708 (ebd76c8f-eefe-470d-b175-65e28cdad708): created successfully Jul 10 15:50:26 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-8835b9e8-e426-4afe-9ed1-47be89f557e2 tempest-GroupSnapshotsTest-1929455548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c0d796f-a2cb-4cbf-a2b8-4ed044e4f300) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:50:26 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-8835b9e8-e426-4afe-9ed1-47be89f557e2 tempest-GroupSnapshotsTest-1929455548 None] Flow 'volume_create_manager' (fc8fc091-ebd7-485a-8b41-c7628ade0a3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:50:26 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-8835b9e8-e426-4afe-9ed1-47be89f557e2 tempest-GroupSnapshotsTest-1929455548 None] Created volume successfully. Jul 10 15:50:27 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-b73f4c73-230a-4d03-bc99-e75dee33538a tempest-GroupSnapshotsTest-1929455548 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 15:50:27 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b73f4c73-230a-4d03-bc99-e75dee33538a tempest-GroupSnapshotsTest-1929455548 None] Flow 'volume_create_manager' (e42cfa73-ce63-4e14-a108-9b25cd4941fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:50:27 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b73f4c73-230a-4d03-bc99-e75dee33538a tempest-GroupSnapshotsTest-1929455548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81d2453c-8724-4900-9b17-79617f771266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:50:27 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b73f4c73-230a-4d03-bc99-e75dee33538a tempest-GroupSnapshotsTest-1929455548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81d2453c-8724-4900-9b17-79617f771266) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:50:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1515664277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5932c7d7-378d-4ff8-b15b-f0b204f2deaf,host='devstack@QuobyteHD#QuobyteHD',id=22160be8-c693-4423-b9b3-80ebc07989d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e411f85fbd545ba9d5af3a552fec9e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:50:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:50:27Z,use_quota=True,user_id='d71b7302462541a89453c96eb1f7de16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6669c1-95d7-4e2c-925c-ca85f60e6539),volume_type_id=8f6669c1-95d7-4e2c-925c-ca85f60e6539)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:50:27 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b73f4c73-230a-4d03-bc99-e75dee33538a tempest-GroupSnapshotsTest-1929455548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dc285d5-42c4-4837-8755-237e564f4861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:50:27 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b73f4c73-230a-4d03-bc99-e75dee33538a tempest-GroupSnapshotsTest-1929455548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dc285d5-42c4-4837-8755-237e564f4861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:50:27 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b73f4c73-230a-4d03-bc99-e75dee33538a tempest-GroupSnapshotsTest-1929455548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a80c7217-86dc-428b-8ef2-68d9973c5dac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:50:27 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b73f4c73-230a-4d03-bc99-e75dee33538a tempest-GroupSnapshotsTest-1929455548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a80c7217-86dc-428b-8ef2-68d9973c5dac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22160be8-c693-4423-b9b3-80ebc07989d8', 'volume_name': 'volume-22160be8-c693-4423-b9b3-80ebc07989d8', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:50:27 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b73f4c73-230a-4d03-bc99-e75dee33538a tempest-GroupSnapshotsTest-1929455548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49e5377d-9eba-4da9-a0b9-9e371372f24c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:50:27 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b73f4c73-230a-4d03-bc99-e75dee33538a tempest-GroupSnapshotsTest-1929455548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49e5377d-9eba-4da9-a0b9-9e371372f24c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:50:27 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b73f4c73-230a-4d03-bc99-e75dee33538a tempest-GroupSnapshotsTest-1929455548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bdcb4d5-5307-4f8e-a88a-c8e86b887af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:50:27 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-b73f4c73-230a-4d03-bc99-e75dee33538a tempest-GroupSnapshotsTest-1929455548 None] Volume 22160be8-c693-4423-b9b3-80ebc07989d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22160be8-c693-4423-b9b3-80ebc07989d8', 'volume_size': 1} Jul 10 15:50:27 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-b73f4c73-230a-4d03-bc99-e75dee33538a tempest-GroupSnapshotsTest-1929455548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:50:27 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-b73f4c73-230a-4d03-bc99-e75dee33538a tempest-GroupSnapshotsTest-1929455548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:50:27 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-b73f4c73-230a-4d03-bc99-e75dee33538a tempest-GroupSnapshotsTest-1929455548 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5932c7d7-378d-4ff8-b15b-f0b204f2deaf,created_at=2026-07-10T13:50:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1515664277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5932c7d7-378d-4ff8-b15b-f0b204f2deaf,host='devstack@QuobyteHD#QuobyteHD',id=22160be8-c693-4423-b9b3-80ebc07989d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e411f85fbd545ba9d5af3a552fec9e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:50:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:50:27Z,use_quota=True,user_id='d71b7302462541a89453c96eb1f7de16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6669c1-95d7-4e2c-925c-ca85f60e6539),volume_type_id=8f6669c1-95d7-4e2c-925c-ca85f60e6539)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 15:50:27 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-b73f4c73-230a-4d03-bc99-e75dee33538a tempest-GroupSnapshotsTest-1929455548 None] Creating volume 22160be8-c693-4423-b9b3-80ebc07989d8 {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 15:50:27 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-b73f4c73-230a-4d03-bc99-e75dee33538a tempest-GroupSnapshotsTest-1929455548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:50:27 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-b73f4c73-230a-4d03-bc99-e75dee33538a tempest-GroupSnapshotsTest-1929455548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:50:27 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-b73f4c73-230a-4d03-bc99-e75dee33538a tempest-GroupSnapshotsTest-1929455548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:50:27 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-b73f4c73-230a-4d03-bc99-e75dee33538a tempest-GroupSnapshotsTest-1929455548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:50:27 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-b73f4c73-230a-4d03-bc99-e75dee33538a tempest-GroupSnapshotsTest-1929455548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:50:27 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-b73f4c73-230a-4d03-bc99-e75dee33538a tempest-GroupSnapshotsTest-1929455548 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 15:50:27 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-b73f4c73-230a-4d03-bc99-e75dee33538a tempest-GroupSnapshotsTest-1929455548 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 15:50:27 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-b73f4c73-230a-4d03-bc99-e75dee33538a tempest-GroupSnapshotsTest-1929455548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-22160be8-c693-4423-b9b3-80ebc07989d8 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:50:27 devstack sudo[90127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-22160be8-c693-4423-b9b3-80ebc07989d8 1073741824 Jul 10 15:50:27 devstack sudo[90127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:50:28 devstack sudo[90127]: pam_unix(sudo:session): session closed for user root Jul 10 15:50:28 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-b73f4c73-230a-4d03-bc99-e75dee33538a tempest-GroupSnapshotsTest-1929455548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-22160be8-c693-4423-b9b3-80ebc07989d8 1073741824" returned: 0 in 0.917s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:50:28 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-b73f4c73-230a-4d03-bc99-e75dee33538a tempest-GroupSnapshotsTest-1929455548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-22160be8-c693-4423-b9b3-80ebc07989d8 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:50:28 devstack sudo[90133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-22160be8-c693-4423-b9b3-80ebc07989d8 Jul 10 15:50:28 devstack sudo[90133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:50:28 devstack sudo[90133]: pam_unix(sudo:session): session closed for user root Jul 10 15:50:28 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-b73f4c73-230a-4d03-bc99-e75dee33538a tempest-GroupSnapshotsTest-1929455548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-22160be8-c693-4423-b9b3-80ebc07989d8" returned: 0 in 0.673s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:50:28 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-b73f4c73-230a-4d03-bc99-e75dee33538a tempest-GroupSnapshotsTest-1929455548 None] <== create_volume: return (1662ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 15:50:28 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-b73f4c73-230a-4d03-bc99-e75dee33538a tempest-GroupSnapshotsTest-1929455548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.665s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:50:28 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b73f4c73-230a-4d03-bc99-e75dee33538a tempest-GroupSnapshotsTest-1929455548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bdcb4d5-5307-4f8e-a88a-c8e86b887af8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22160be8-c693-4423-b9b3-80ebc07989d8', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:50:28 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b73f4c73-230a-4d03-bc99-e75dee33538a tempest-GroupSnapshotsTest-1929455548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (352bb310-f319-4066-8550-7f7ea3136f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:50:28 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-b73f4c73-230a-4d03-bc99-e75dee33538a tempest-GroupSnapshotsTest-1929455548 None] Volume volume-22160be8-c693-4423-b9b3-80ebc07989d8 (22160be8-c693-4423-b9b3-80ebc07989d8): created successfully Jul 10 15:50:28 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b73f4c73-230a-4d03-bc99-e75dee33538a tempest-GroupSnapshotsTest-1929455548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (352bb310-f319-4066-8550-7f7ea3136f6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:50:28 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b73f4c73-230a-4d03-bc99-e75dee33538a tempest-GroupSnapshotsTest-1929455548 None] Flow 'volume_create_manager' (e42cfa73-ce63-4e14-a108-9b25cd4941fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:50:28 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-b73f4c73-230a-4d03-bc99-e75dee33538a tempest-GroupSnapshotsTest-1929455548 None] Created volume successfully. Jul 10 15:50:29 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-a47f5819-1a39-4ee4-b324-70614b0917fe tempest-GroupSnapshotsTest-1929455548 None] Update group completed successfully. Jul 10 15:50:30 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f33c967-6398-41b3-8759-704938f919c1 tempest-AttachVolumeShelveTestJSON-1184417620 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 15:50:30 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-3f33c967-6398-41b3-8759-704938f919c1 tempest-AttachVolumeShelveTestJSON-1184417620 None] Flow 'volume_create_manager' (0179edc7-c216-484a-81ae-2d968108b3bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:50:30 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-3f33c967-6398-41b3-8759-704938f919c1 tempest-AttachVolumeShelveTestJSON-1184417620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c38b7bb-1e1e-4308-af35-3ad2345c2920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:50:30 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-3f33c967-6398-41b3-8759-704938f919c1 tempest-AttachVolumeShelveTestJSON-1184417620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c38b7bb-1e1e-4308-af35-3ad2345c2920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:50:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1320167587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=696fc062-8f81-4dca-bdb4-350927f10aa5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d71f15191ba43d980e0f4614dda959f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:50:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:50:31Z,use_quota=True,user_id='d0b51eebca5844eea0661460f2823927',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:50:30 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-3f33c967-6398-41b3-8759-704938f919c1 tempest-AttachVolumeShelveTestJSON-1184417620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bed898a-09ba-4713-aa4f-c10634e355c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:50:30 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-3f33c967-6398-41b3-8759-704938f919c1 tempest-AttachVolumeShelveTestJSON-1184417620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bed898a-09ba-4713-aa4f-c10634e355c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:50:30 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-3f33c967-6398-41b3-8759-704938f919c1 tempest-AttachVolumeShelveTestJSON-1184417620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58813958-20c1-4c89-8b03-1d9c0666a144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:50:30 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-3f33c967-6398-41b3-8759-704938f919c1 tempest-AttachVolumeShelveTestJSON-1184417620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58813958-20c1-4c89-8b03-1d9c0666a144) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '696fc062-8f81-4dca-bdb4-350927f10aa5', 'volume_name': 'volume-696fc062-8f81-4dca-bdb4-350927f10aa5', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:50:30 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-3f33c967-6398-41b3-8759-704938f919c1 tempest-AttachVolumeShelveTestJSON-1184417620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f51e0888-cc9f-4fef-8fdd-cffb483ae060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:50:30 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-3f33c967-6398-41b3-8759-704938f919c1 tempest-AttachVolumeShelveTestJSON-1184417620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f51e0888-cc9f-4fef-8fdd-cffb483ae060) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:50:30 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-3f33c967-6398-41b3-8759-704938f919c1 tempest-AttachVolumeShelveTestJSON-1184417620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (312b1239-628c-4ebb-a81d-1382f4286ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:50:30 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-3f33c967-6398-41b3-8759-704938f919c1 tempest-AttachVolumeShelveTestJSON-1184417620 None] Volume 696fc062-8f81-4dca-bdb4-350927f10aa5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-696fc062-8f81-4dca-bdb4-350927f10aa5', 'volume_size': 1} Jul 10 15:50:30 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-3f33c967-6398-41b3-8759-704938f919c1 tempest-AttachVolumeShelveTestJSON-1184417620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:50:30 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-3f33c967-6398-41b3-8759-704938f919c1 tempest-AttachVolumeShelveTestJSON-1184417620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:50:30 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-3f33c967-6398-41b3-8759-704938f919c1 tempest-AttachVolumeShelveTestJSON-1184417620 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:50:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1320167587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=696fc062-8f81-4dca-bdb4-350927f10aa5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d71f15191ba43d980e0f4614dda959f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:50:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:50:31Z,use_quota=True,user_id='d0b51eebca5844eea0661460f2823927',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 15:50:30 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-3f33c967-6398-41b3-8759-704938f919c1 tempest-AttachVolumeShelveTestJSON-1184417620 None] Creating volume 696fc062-8f81-4dca-bdb4-350927f10aa5 {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 15:50:30 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-3f33c967-6398-41b3-8759-704938f919c1 tempest-AttachVolumeShelveTestJSON-1184417620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:50:30 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-3f33c967-6398-41b3-8759-704938f919c1 tempest-AttachVolumeShelveTestJSON-1184417620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:50:30 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-3f33c967-6398-41b3-8759-704938f919c1 tempest-AttachVolumeShelveTestJSON-1184417620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:50:30 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-3f33c967-6398-41b3-8759-704938f919c1 tempest-AttachVolumeShelveTestJSON-1184417620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:50:30 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-3f33c967-6398-41b3-8759-704938f919c1 tempest-AttachVolumeShelveTestJSON-1184417620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:50:30 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-3f33c967-6398-41b3-8759-704938f919c1 tempest-AttachVolumeShelveTestJSON-1184417620 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 15:50:30 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-3f33c967-6398-41b3-8759-704938f919c1 tempest-AttachVolumeShelveTestJSON-1184417620 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 15:50:30 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-3f33c967-6398-41b3-8759-704938f919c1 tempest-AttachVolumeShelveTestJSON-1184417620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-696fc062-8f81-4dca-bdb4-350927f10aa5 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:50:30 devstack sudo[90138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-696fc062-8f81-4dca-bdb4-350927f10aa5 1073741824 Jul 10 15:50:30 devstack sudo[90138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:50:31 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-0ee0bf51-a63f-4995-b741-df3645935d98 tempest-GroupSnapshotsTest-1929455548 None] Update group completed successfully. Jul 10 15:50:31 devstack sudo[90138]: pam_unix(sudo:session): session closed for user root Jul 10 15:50:31 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-3f33c967-6398-41b3-8759-704938f919c1 tempest-AttachVolumeShelveTestJSON-1184417620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-696fc062-8f81-4dca-bdb4-350927f10aa5 1073741824" returned: 0 in 0.979s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:50:31 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-3f33c967-6398-41b3-8759-704938f919c1 tempest-AttachVolumeShelveTestJSON-1184417620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-696fc062-8f81-4dca-bdb4-350927f10aa5 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:50:31 devstack sudo[90144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-696fc062-8f81-4dca-bdb4-350927f10aa5 Jul 10 15:50:31 devstack sudo[90144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:50:32 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-db4d573e-b914-4478-a1c4-51dc6acdc877 tempest-GroupSnapshotsTest-1929455548 None] Update group completed successfully. Jul 10 15:50:32 devstack sudo[90144]: pam_unix(sudo:session): session closed for user root Jul 10 15:50:32 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-3f33c967-6398-41b3-8759-704938f919c1 tempest-AttachVolumeShelveTestJSON-1184417620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-696fc062-8f81-4dca-bdb4-350927f10aa5" returned: 0 in 0.670s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:50:32 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-3f33c967-6398-41b3-8759-704938f919c1 tempest-AttachVolumeShelveTestJSON-1184417620 None] <== create_volume: return (1703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 15:50:32 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-3f33c967-6398-41b3-8759-704938f919c1 tempest-AttachVolumeShelveTestJSON-1184417620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.706s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:50:32 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-3f33c967-6398-41b3-8759-704938f919c1 tempest-AttachVolumeShelveTestJSON-1184417620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (312b1239-628c-4ebb-a81d-1382f4286ea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-696fc062-8f81-4dca-bdb4-350927f10aa5', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:50:32 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-3f33c967-6398-41b3-8759-704938f919c1 tempest-AttachVolumeShelveTestJSON-1184417620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7b730d0-bf3f-4ade-972d-f75f21c7ab2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:50:32 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-3f33c967-6398-41b3-8759-704938f919c1 tempest-AttachVolumeShelveTestJSON-1184417620 None] Volume volume-696fc062-8f81-4dca-bdb4-350927f10aa5 (696fc062-8f81-4dca-bdb4-350927f10aa5): created successfully Jul 10 15:50:32 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-3f33c967-6398-41b3-8759-704938f919c1 tempest-AttachVolumeShelveTestJSON-1184417620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7b730d0-bf3f-4ade-972d-f75f21c7ab2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:50:32 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-3f33c967-6398-41b3-8759-704938f919c1 tempest-AttachVolumeShelveTestJSON-1184417620 None] Flow 'volume_create_manager' (0179edc7-c216-484a-81ae-2d968108b3bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:50:32 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-3f33c967-6398-41b3-8759-704938f919c1 tempest-AttachVolumeShelveTestJSON-1184417620 None] Created volume successfully. Jul 10 15:50:33 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-ace2c4ab-ff9b-4247-bc2f-1433a68d83c7 tempest-GroupSnapshotsTest-1929455548 None] Update group completed successfully. Jul 10 15:50:34 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-61207c7d-b7a3-418a-9da6-7dd339c75e80 tempest-GroupSnapshotsTest-1929455548 None] GroupSnapshot 84f56a04-aeb2-4fb8-a4aa-8245cfd5a328: creating. Jul 10 15:50:34 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-61207c7d-b7a3-418a-9da6-7dd339c75e80 tempest-GroupSnapshotsTest-1929455548 None] Group snapshot 84f56a04-aeb2-4fb8-a4aa-8245cfd5a328: creating. {{(pid=87420) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 10 15:50:34 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-61207c7d-b7a3-418a-9da6-7dd339c75e80 tempest-GroupSnapshotsTest-1929455548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:50:34 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-61207c7d-b7a3-418a-9da6-7dd339c75e80 tempest-GroupSnapshotsTest-1929455548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:50:34 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-61207c7d-b7a3-418a-9da6-7dd339c75e80 tempest-GroupSnapshotsTest-1929455548 None] Creating offline snapshot d63fdf7b-ad07-4a00-9d27-f1c26a70d441 of volume 22160be8-c693-4423-b9b3-80ebc07989d8 {{(pid=87420) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 15:50:35 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[54dce018-f5c6-4748-9ea7-329d8901a7fd]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:50:35 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-61207c7d-b7a3-418a-9da6-7dd339c75e80 tempest-GroupSnapshotsTest-1929455548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-22160be8-c693-4423-b9b3-80ebc07989d8 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:50:35 devstack sudo[90156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-22160be8-c693-4423-b9b3-80ebc07989d8 Jul 10 15:50:35 devstack sudo[90156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:50:35 devstack sudo[90156]: pam_unix(sudo:session): session closed for user root Jul 10 15:50:35 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-61207c7d-b7a3-418a-9da6-7dd339c75e80 tempest-GroupSnapshotsTest-1929455548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-22160be8-c693-4423-b9b3-80ebc07989d8" returned: 0 in 0.827s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:50:35 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-61207c7d-b7a3-418a-9da6-7dd339c75e80 tempest-GroupSnapshotsTest-1929455548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-22160be8-c693-4423-b9b3-80ebc07989d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-22160be8-c693-4423-b9b3-80ebc07989d8.d63fdf7b-ad07-4a00-9d27-f1c26a70d441 1G {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:50:35 devstack sudo[90165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-22160be8-c693-4423-b9b3-80ebc07989d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-22160be8-c693-4423-b9b3-80ebc07989d8.d63fdf7b-ad07-4a00-9d27-f1c26a70d441 1G Jul 10 15:50:35 devstack sudo[90165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:50:36 devstack sudo[90165]: pam_unix(sudo:session): session closed for user root Jul 10 15:50:36 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-61207c7d-b7a3-418a-9da6-7dd339c75e80 tempest-GroupSnapshotsTest-1929455548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-22160be8-c693-4423-b9b3-80ebc07989d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-22160be8-c693-4423-b9b3-80ebc07989d8.d63fdf7b-ad07-4a00-9d27-f1c26a70d441 1G" returned: 0 in 0.907s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:50:36 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-61207c7d-b7a3-418a-9da6-7dd339c75e80 tempest-GroupSnapshotsTest-1929455548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22160be8-c693-4423-b9b3-80ebc07989d8 -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-22160be8-c693-4423-b9b3-80ebc07989d8.d63fdf7b-ad07-4a00-9d27-f1c26a70d441 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:50:36 devstack sudo[90175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22160be8-c693-4423-b9b3-80ebc07989d8 -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-22160be8-c693-4423-b9b3-80ebc07989d8.d63fdf7b-ad07-4a00-9d27-f1c26a70d441 Jul 10 15:50:36 devstack sudo[90175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:50:37 devstack sudo[90175]: pam_unix(sudo:session): session closed for user root Jul 10 15:50:37 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-61207c7d-b7a3-418a-9da6-7dd339c75e80 tempest-GroupSnapshotsTest-1929455548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22160be8-c693-4423-b9b3-80ebc07989d8 -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-22160be8-c693-4423-b9b3-80ebc07989d8.d63fdf7b-ad07-4a00-9d27-f1c26a70d441" returned: 0 in 0.799s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:50:37 devstack cinder-volume[87420]: WARNING cinder.volume.drivers.remotefs [None req-61207c7d-b7a3-418a-9da6-7dd339c75e80 tempest-GroupSnapshotsTest-1929455548 None] /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-22160be8-c693-4423-b9b3-80ebc07989d8.d63fdf7b-ad07-4a00-9d27-f1c26a70d441 is being set with open permissions: ugo+rw: NotImplementedError Jul 10 15:50:37 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-61207c7d-b7a3-418a-9da6-7dd339c75e80 tempest-GroupSnapshotsTest-1929455548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-22160be8-c693-4423-b9b3-80ebc07989d8.d63fdf7b-ad07-4a00-9d27-f1c26a70d441 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:50:37 devstack sudo[90181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-22160be8-c693-4423-b9b3-80ebc07989d8.d63fdf7b-ad07-4a00-9d27-f1c26a70d441 Jul 10 15:50:37 devstack sudo[90181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:50:38 devstack sudo[90181]: pam_unix(sudo:session): session closed for user root Jul 10 15:50:38 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-61207c7d-b7a3-418a-9da6-7dd339c75e80 tempest-GroupSnapshotsTest-1929455548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-22160be8-c693-4423-b9b3-80ebc07989d8.d63fdf7b-ad07-4a00-9d27-f1c26a70d441" returned: 0 in 0.992s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:50:38 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-61207c7d-b7a3-418a-9da6-7dd339c75e80 tempest-GroupSnapshotsTest-1929455548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-22160be8-c693-4423-b9b3-80ebc07989d8.info {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:50:38 devstack sudo[90191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-22160be8-c693-4423-b9b3-80ebc07989d8.info Jul 10 15:50:38 devstack sudo[90191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:50:39 devstack sudo[90191]: pam_unix(sudo:session): session closed for user root Jul 10 15:50:39 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-61207c7d-b7a3-418a-9da6-7dd339c75e80 tempest-GroupSnapshotsTest-1929455548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-22160be8-c693-4423-b9b3-80ebc07989d8.info" returned: 0 in 0.735s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:50:39 devstack cinder-volume[87420]: WARNING cinder.volume.drivers.remotefs [None req-61207c7d-b7a3-418a-9da6-7dd339c75e80 tempest-GroupSnapshotsTest-1929455548 None] /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-22160be8-c693-4423-b9b3-80ebc07989d8.info is being set with open permissions: ugo+rw: NotImplementedError Jul 10 15:50:39 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-61207c7d-b7a3-418a-9da6-7dd339c75e80 tempest-GroupSnapshotsTest-1929455548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-22160be8-c693-4423-b9b3-80ebc07989d8.info {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:50:39 devstack sudo[90195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-22160be8-c693-4423-b9b3-80ebc07989d8.info Jul 10 15:50:39 devstack sudo[90195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:50:40 devstack sudo[90195]: pam_unix(sudo:session): session closed for user root Jul 10 15:50:40 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-61207c7d-b7a3-418a-9da6-7dd339c75e80 tempest-GroupSnapshotsTest-1929455548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-22160be8-c693-4423-b9b3-80ebc07989d8.info" returned: 0 in 0.840s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:50:40 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-61207c7d-b7a3-418a-9da6-7dd339c75e80 tempest-GroupSnapshotsTest-1929455548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.214s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:50:40 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-61207c7d-b7a3-418a-9da6-7dd339c75e80 tempest-GroupSnapshotsTest-1929455548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:50:40 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-61207c7d-b7a3-418a-9da6-7dd339c75e80 tempest-GroupSnapshotsTest-1929455548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:50:40 devstack cinder-volume[87420]: DEBUG dbcounter [-] [87420] Writing DB stats cinder:SELECT=58,cinder:INSERT=12,cinder:UPDATE=53,cinder:DELETE=1 {{(pid=87420) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 15:50:40 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-61207c7d-b7a3-418a-9da6-7dd339c75e80 tempest-GroupSnapshotsTest-1929455548 None] Creating offline snapshot ecfd425c-b1e4-4dd0-8007-c33cddf04a55 of volume ebd76c8f-eefe-470d-b175-65e28cdad708 {{(pid=87420) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 15:50:40 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[30d5d679-9fc7-45c0-8b51-15c5e69a3f54]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:50:40 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-61207c7d-b7a3-418a-9da6-7dd339c75e80 tempest-GroupSnapshotsTest-1929455548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ebd76c8f-eefe-470d-b175-65e28cdad708 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:50:40 devstack sudo[90199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ebd76c8f-eefe-470d-b175-65e28cdad708 Jul 10 15:50:40 devstack sudo[90199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:50:41 devstack sudo[90199]: pam_unix(sudo:session): session closed for user root Jul 10 15:50:41 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-61207c7d-b7a3-418a-9da6-7dd339c75e80 tempest-GroupSnapshotsTest-1929455548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ebd76c8f-eefe-470d-b175-65e28cdad708" returned: 0 in 0.861s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:50:41 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-61207c7d-b7a3-418a-9da6-7dd339c75e80 tempest-GroupSnapshotsTest-1929455548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ebd76c8f-eefe-470d-b175-65e28cdad708,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ebd76c8f-eefe-470d-b175-65e28cdad708.ecfd425c-b1e4-4dd0-8007-c33cddf04a55 1G {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:50:41 devstack sudo[90204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ebd76c8f-eefe-470d-b175-65e28cdad708,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ebd76c8f-eefe-470d-b175-65e28cdad708.ecfd425c-b1e4-4dd0-8007-c33cddf04a55 1G Jul 10 15:50:41 devstack sudo[90204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:50:42 devstack sudo[90204]: pam_unix(sudo:session): session closed for user root Jul 10 15:50:42 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-61207c7d-b7a3-418a-9da6-7dd339c75e80 tempest-GroupSnapshotsTest-1929455548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ebd76c8f-eefe-470d-b175-65e28cdad708,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ebd76c8f-eefe-470d-b175-65e28cdad708.ecfd425c-b1e4-4dd0-8007-c33cddf04a55 1G" returned: 0 in 0.972s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:50:42 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-61207c7d-b7a3-418a-9da6-7dd339c75e80 tempest-GroupSnapshotsTest-1929455548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebd76c8f-eefe-470d-b175-65e28cdad708 -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ebd76c8f-eefe-470d-b175-65e28cdad708.ecfd425c-b1e4-4dd0-8007-c33cddf04a55 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:50:42 devstack sudo[90210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebd76c8f-eefe-470d-b175-65e28cdad708 -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ebd76c8f-eefe-470d-b175-65e28cdad708.ecfd425c-b1e4-4dd0-8007-c33cddf04a55 Jul 10 15:50:42 devstack sudo[90210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:50:42 devstack sudo[90210]: pam_unix(sudo:session): session closed for user root Jul 10 15:50:42 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-61207c7d-b7a3-418a-9da6-7dd339c75e80 tempest-GroupSnapshotsTest-1929455548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebd76c8f-eefe-470d-b175-65e28cdad708 -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ebd76c8f-eefe-470d-b175-65e28cdad708.ecfd425c-b1e4-4dd0-8007-c33cddf04a55" returned: 0 in 0.799s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:50:42 devstack cinder-volume[87420]: WARNING cinder.volume.drivers.remotefs [None req-61207c7d-b7a3-418a-9da6-7dd339c75e80 tempest-GroupSnapshotsTest-1929455548 None] /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ebd76c8f-eefe-470d-b175-65e28cdad708.ecfd425c-b1e4-4dd0-8007-c33cddf04a55 is being set with open permissions: ugo+rw: NotImplementedError Jul 10 15:50:42 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-61207c7d-b7a3-418a-9da6-7dd339c75e80 tempest-GroupSnapshotsTest-1929455548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ebd76c8f-eefe-470d-b175-65e28cdad708.ecfd425c-b1e4-4dd0-8007-c33cddf04a55 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:50:42 devstack sudo[90221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ebd76c8f-eefe-470d-b175-65e28cdad708.ecfd425c-b1e4-4dd0-8007-c33cddf04a55 Jul 10 15:50:42 devstack sudo[90221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:50:43 devstack sudo[90221]: pam_unix(sudo:session): session closed for user root Jul 10 15:50:43 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-61207c7d-b7a3-418a-9da6-7dd339c75e80 tempest-GroupSnapshotsTest-1929455548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ebd76c8f-eefe-470d-b175-65e28cdad708.ecfd425c-b1e4-4dd0-8007-c33cddf04a55" returned: 0 in 1.031s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:50:43 devstack cinder-volume[87420]: DEBUG dbcounter [-] [87420] Writing DB stats cinder:UPDATE=57,cinder:SELECT=59,cinder:DELETE=4,cinder:INSERT=12 {{(pid=87420) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 15:50:43 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-61207c7d-b7a3-418a-9da6-7dd339c75e80 tempest-GroupSnapshotsTest-1929455548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ebd76c8f-eefe-470d-b175-65e28cdad708.info {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:50:43 devstack sudo[90276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ebd76c8f-eefe-470d-b175-65e28cdad708.info Jul 10 15:50:43 devstack sudo[90276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:50:44 devstack sudo[90276]: pam_unix(sudo:session): session closed for user root Jul 10 15:50:44 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-61207c7d-b7a3-418a-9da6-7dd339c75e80 tempest-GroupSnapshotsTest-1929455548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ebd76c8f-eefe-470d-b175-65e28cdad708.info" returned: 0 in 0.768s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:50:44 devstack cinder-volume[87420]: WARNING cinder.volume.drivers.remotefs [None req-61207c7d-b7a3-418a-9da6-7dd339c75e80 tempest-GroupSnapshotsTest-1929455548 None] /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ebd76c8f-eefe-470d-b175-65e28cdad708.info is being set with open permissions: ugo+rw: NotImplementedError Jul 10 15:50:44 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-61207c7d-b7a3-418a-9da6-7dd339c75e80 tempest-GroupSnapshotsTest-1929455548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ebd76c8f-eefe-470d-b175-65e28cdad708.info {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:50:44 devstack sudo[90285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ebd76c8f-eefe-470d-b175-65e28cdad708.info Jul 10 15:50:44 devstack sudo[90285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:50:45 devstack sudo[90285]: pam_unix(sudo:session): session closed for user root Jul 10 15:50:45 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-61207c7d-b7a3-418a-9da6-7dd339c75e80 tempest-GroupSnapshotsTest-1929455548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ebd76c8f-eefe-470d-b175-65e28cdad708.info" returned: 0 in 0.643s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:50:45 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-61207c7d-b7a3-418a-9da6-7dd339c75e80 tempest-GroupSnapshotsTest-1929455548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.208s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:50:45 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-61207c7d-b7a3-418a-9da6-7dd339c75e80 tempest-GroupSnapshotsTest-1929455548 None] group_snapshot 84f56a04-aeb2-4fb8-a4aa-8245cfd5a328: created successfully Jul 10 15:50:46 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-93e9cedb-94df-4ed6-8295-5d025ded4bf1 tempest-GroupSnapshotsTest-1929455548 None] group_snapshot 84f56a04-aeb2-4fb8-a4aa-8245cfd5a328: deleting Jul 10 15:50:46 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-93e9cedb-94df-4ed6-8295-5d025ded4bf1 tempest-GroupSnapshotsTest-1929455548 None] group_snapshot 84f56a04-aeb2-4fb8-a4aa-8245cfd5a328: deleting {{(pid=87420) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 10 15:50:46 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-93e9cedb-94df-4ed6-8295-5d025ded4bf1 tempest-GroupSnapshotsTest-1929455548 None] Acquiring lock "cinder-quobyte-22160be8-c693-4423-b9b3-80ebc07989d8" by "delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:50:46 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-93e9cedb-94df-4ed6-8295-5d025ded4bf1 tempest-GroupSnapshotsTest-1929455548 None] Lock "cinder-quobyte-22160be8-c693-4423-b9b3-80ebc07989d8" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:50:46 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-93e9cedb-94df-4ed6-8295-5d025ded4bf1 tempest-GroupSnapshotsTest-1929455548 None] Acquiring lock "cinder-quobyte-d63fdf7b-ad07-4a00-9d27-f1c26a70d441" by "_delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:50:46 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-93e9cedb-94df-4ed6-8295-5d025ded4bf1 tempest-GroupSnapshotsTest-1929455548 None] Lock "cinder-quobyte-d63fdf7b-ad07-4a00-9d27-f1c26a70d441" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:50:46 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-93e9cedb-94df-4ed6-8295-5d025ded4bf1 tempest-GroupSnapshotsTest-1929455548 None] Deleting offline snapshot d63fdf7b-ad07-4a00-9d27-f1c26a70d441 of volume 22160be8-c693-4423-b9b3-80ebc07989d8 {{(pid=87420) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 15:50:46 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-93e9cedb-94df-4ed6-8295-5d025ded4bf1 tempest-GroupSnapshotsTest-1929455548 None] snapshot_file for this snap is: volume-22160be8-c693-4423-b9b3-80ebc07989d8.d63fdf7b-ad07-4a00-9d27-f1c26a70d441 {{(pid=87420) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 15:50:46 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[b600f092-0e77-4e80-8143-a9f1f6479b23]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:50:46 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-93e9cedb-94df-4ed6-8295-5d025ded4bf1 tempest-GroupSnapshotsTest-1929455548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-22160be8-c693-4423-b9b3-80ebc07989d8.d63fdf7b-ad07-4a00-9d27-f1c26a70d441 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:50:47 devstack sudo[90307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-22160be8-c693-4423-b9b3-80ebc07989d8.d63fdf7b-ad07-4a00-9d27-f1c26a70d441 Jul 10 15:50:47 devstack sudo[90307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:50:47 devstack sudo[90307]: pam_unix(sudo:session): session closed for user root Jul 10 15:50:47 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-93e9cedb-94df-4ed6-8295-5d025ded4bf1 tempest-GroupSnapshotsTest-1929455548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-22160be8-c693-4423-b9b3-80ebc07989d8.d63fdf7b-ad07-4a00-9d27-f1c26a70d441" returned: 0 in 0.843s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:50:47 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-93e9cedb-94df-4ed6-8295-5d025ded4bf1 tempest-GroupSnapshotsTest-1929455548 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-22160be8-c693-4423-b9b3-80ebc07989d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87420) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 15:50:47 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[39e52f2a-63b3-4f0b-8004-2ced408c1c33]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:50:47 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-93e9cedb-94df-4ed6-8295-5d025ded4bf1 tempest-GroupSnapshotsTest-1929455548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-22160be8-c693-4423-b9b3-80ebc07989d8 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:50:47 devstack sudo[90317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-22160be8-c693-4423-b9b3-80ebc07989d8 Jul 10 15:50:47 devstack sudo[90317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:50:48 devstack sudo[90317]: pam_unix(sudo:session): session closed for user root Jul 10 15:50:48 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-93e9cedb-94df-4ed6-8295-5d025ded4bf1 tempest-GroupSnapshotsTest-1929455548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-22160be8-c693-4423-b9b3-80ebc07989d8" returned: 0 in 0.923s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:50:48 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-93e9cedb-94df-4ed6-8295-5d025ded4bf1 tempest-GroupSnapshotsTest-1929455548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-22160be8-c693-4423-b9b3-80ebc07989d8.d63fdf7b-ad07-4a00-9d27-f1c26a70d441 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:50:48 devstack sudo[90322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-22160be8-c693-4423-b9b3-80ebc07989d8.d63fdf7b-ad07-4a00-9d27-f1c26a70d441 Jul 10 15:50:48 devstack sudo[90322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:50:49 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [req-d098d611-a0cb-472a-8289-c3c8307f74dc req-4728c95e-e140-4e9b-acc7-06b5740773a8 tempest-AttachVolumeShelveTestJSON-1184417620 None] No connector for attachment 38663779-192b-472d-a36e-19aee2b29a0f; skipping storage backend terminate_connection call. {{(pid=87420) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 10 15:50:49 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [req-d098d611-a0cb-472a-8289-c3c8307f74dc req-4728c95e-e140-4e9b-acc7-06b5740773a8 tempest-AttachVolumeShelveTestJSON-1184417620 None] Deleting attachment 38663779-192b-472d-a36e-19aee2b29a0f. {{(pid=87420) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 15:50:49 devstack sudo[90322]: pam_unix(sudo:session): session closed for user root Jul 10 15:50:49 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-93e9cedb-94df-4ed6-8295-5d025ded4bf1 tempest-GroupSnapshotsTest-1929455548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-22160be8-c693-4423-b9b3-80ebc07989d8.d63fdf7b-ad07-4a00-9d27-f1c26a70d441" returned: 0 in 1.220s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:50:49 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-93e9cedb-94df-4ed6-8295-5d025ded4bf1 tempest-GroupSnapshotsTest-1929455548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-22160be8-c693-4423-b9b3-80ebc07989d8.d63fdf7b-ad07-4a00-9d27-f1c26a70d441 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:50:50 devstack sudo[90340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-22160be8-c693-4423-b9b3-80ebc07989d8.d63fdf7b-ad07-4a00-9d27-f1c26a70d441 Jul 10 15:50:50 devstack sudo[90340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:50:50 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [req-0681d537-f2b6-473b-84d9-46946dd84745 req-c9fedff0-b5d5-428e-b34b-dfa4c770fce7 tempest-TaggedAttachmentsTest-1197600787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:50:50 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [req-0681d537-f2b6-473b-84d9-46946dd84745 req-c9fedff0-b5d5-428e-b34b-dfa4c770fce7 tempest-TaggedAttachmentsTest-1197600787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:50:50 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab623a76-7d2d-4970-bfd2-954829af3db3]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:50:50 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [req-0681d537-f2b6-473b-84d9-46946dd84745 req-c9fedff0-b5d5-428e-b34b-dfa4c770fce7 tempest-TaggedAttachmentsTest-1197600787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-27f25116-9e7b-4fc4-b271-b9079a07c1a7 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:50:50 devstack sudo[90356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-27f25116-9e7b-4fc4-b271-b9079a07c1a7 Jul 10 15:50:50 devstack sudo[90356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:50:50 devstack sudo[90340]: pam_unix(sudo:session): session closed for user root Jul 10 15:50:50 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-93e9cedb-94df-4ed6-8295-5d025ded4bf1 tempest-GroupSnapshotsTest-1929455548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-22160be8-c693-4423-b9b3-80ebc07989d8.d63fdf7b-ad07-4a00-9d27-f1c26a70d441" returned: 0 in 0.744s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:50:50 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-93e9cedb-94df-4ed6-8295-5d025ded4bf1 tempest-GroupSnapshotsTest-1929455548 None] Lock "cinder-quobyte-d63fdf7b-ad07-4a00-9d27-f1c26a70d441" released by "_delete_snapshot" :: held 3.922s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:50:50 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-93e9cedb-94df-4ed6-8295-5d025ded4bf1 tempest-GroupSnapshotsTest-1929455548 None] Lock "cinder-quobyte-22160be8-c693-4423-b9b3-80ebc07989d8" released by "delete_snapshot" :: held 3.966s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:50:50 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-93e9cedb-94df-4ed6-8295-5d025ded4bf1 tempest-GroupSnapshotsTest-1929455548 None] Acquiring lock "cinder-quobyte-ebd76c8f-eefe-470d-b175-65e28cdad708" by "delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:50:50 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-93e9cedb-94df-4ed6-8295-5d025ded4bf1 tempest-GroupSnapshotsTest-1929455548 None] Lock "cinder-quobyte-ebd76c8f-eefe-470d-b175-65e28cdad708" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:50:50 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-93e9cedb-94df-4ed6-8295-5d025ded4bf1 tempest-GroupSnapshotsTest-1929455548 None] Acquiring lock "cinder-quobyte-ecfd425c-b1e4-4dd0-8007-c33cddf04a55" by "_delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:50:50 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-93e9cedb-94df-4ed6-8295-5d025ded4bf1 tempest-GroupSnapshotsTest-1929455548 None] Lock "cinder-quobyte-ecfd425c-b1e4-4dd0-8007-c33cddf04a55" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:50:50 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-93e9cedb-94df-4ed6-8295-5d025ded4bf1 tempest-GroupSnapshotsTest-1929455548 None] Deleting offline snapshot ecfd425c-b1e4-4dd0-8007-c33cddf04a55 of volume ebd76c8f-eefe-470d-b175-65e28cdad708 {{(pid=87420) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 15:50:50 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-93e9cedb-94df-4ed6-8295-5d025ded4bf1 tempest-GroupSnapshotsTest-1929455548 None] snapshot_file for this snap is: volume-ebd76c8f-eefe-470d-b175-65e28cdad708.ecfd425c-b1e4-4dd0-8007-c33cddf04a55 {{(pid=87420) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 15:50:50 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[aadcedd3-2332-4386-9bde-70d8f3c29b5e]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:50:50 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-93e9cedb-94df-4ed6-8295-5d025ded4bf1 tempest-GroupSnapshotsTest-1929455548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ebd76c8f-eefe-470d-b175-65e28cdad708.ecfd425c-b1e4-4dd0-8007-c33cddf04a55 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:50:51 devstack sudo[90360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ebd76c8f-eefe-470d-b175-65e28cdad708.ecfd425c-b1e4-4dd0-8007-c33cddf04a55 Jul 10 15:50:51 devstack sudo[90360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:50:51 devstack sudo[90356]: pam_unix(sudo:session): session closed for user root Jul 10 15:50:51 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [req-0681d537-f2b6-473b-84d9-46946dd84745 req-c9fedff0-b5d5-428e-b34b-dfa4c770fce7 tempest-TaggedAttachmentsTest-1197600787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-27f25116-9e7b-4fc4-b271-b9079a07c1a7" returned: 0 in 1.016s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:50:51 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [req-0681d537-f2b6-473b-84d9-46946dd84745 req-c9fedff0-b5d5-428e-b34b-dfa4c770fce7 tempest-TaggedAttachmentsTest-1197600787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.042s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:50:51 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [req-0681d537-f2b6-473b-84d9-46946dd84745 req-c9fedff0-b5d5-428e-b34b-dfa4c770fce7 tempest-TaggedAttachmentsTest-1197600787 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80', 'name': 'volume-27f25116-9e7b-4fc4-b271-b9079a07c1a7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '34937b04-d7a0-4871-b371-f9fd77b851cf', 'enforce_multipath': True} {{(pid=87420) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 15:50:51 devstack cinder-volume[87420]: INFO cinder.volume.manager [req-0681d537-f2b6-473b-84d9-46946dd84745 req-c9fedff0-b5d5-428e-b34b-dfa4c770fce7 tempest-TaggedAttachmentsTest-1197600787 None] attachment_update completed successfully. Jul 10 15:50:51 devstack sudo[90360]: pam_unix(sudo:session): session closed for user root Jul 10 15:50:51 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-93e9cedb-94df-4ed6-8295-5d025ded4bf1 tempest-GroupSnapshotsTest-1929455548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ebd76c8f-eefe-470d-b175-65e28cdad708.ecfd425c-b1e4-4dd0-8007-c33cddf04a55" returned: 0 in 1.010s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:50:51 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-93e9cedb-94df-4ed6-8295-5d025ded4bf1 tempest-GroupSnapshotsTest-1929455548 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ebd76c8f-eefe-470d-b175-65e28cdad708(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87420) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 15:50:52 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[db96a20c-c74e-4981-9dc2-d7b77b20313d]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:50:52 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-93e9cedb-94df-4ed6-8295-5d025ded4bf1 tempest-GroupSnapshotsTest-1929455548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ebd76c8f-eefe-470d-b175-65e28cdad708 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:50:52 devstack sudo[90436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ebd76c8f-eefe-470d-b175-65e28cdad708 Jul 10 15:50:52 devstack sudo[90436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:50:52 devstack sudo[90436]: pam_unix(sudo:session): session closed for user root Jul 10 15:50:52 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-93e9cedb-94df-4ed6-8295-5d025ded4bf1 tempest-GroupSnapshotsTest-1929455548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ebd76c8f-eefe-470d-b175-65e28cdad708" returned: 0 in 0.905s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:50:52 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-93e9cedb-94df-4ed6-8295-5d025ded4bf1 tempest-GroupSnapshotsTest-1929455548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ebd76c8f-eefe-470d-b175-65e28cdad708.ecfd425c-b1e4-4dd0-8007-c33cddf04a55 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:50:52 devstack sudo[90760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ebd76c8f-eefe-470d-b175-65e28cdad708.ecfd425c-b1e4-4dd0-8007-c33cddf04a55 Jul 10 15:50:52 devstack sudo[90760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:50:53 devstack sudo[90760]: pam_unix(sudo:session): session closed for user root Jul 10 15:50:53 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-93e9cedb-94df-4ed6-8295-5d025ded4bf1 tempest-GroupSnapshotsTest-1929455548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ebd76c8f-eefe-470d-b175-65e28cdad708.ecfd425c-b1e4-4dd0-8007-c33cddf04a55" returned: 0 in 0.920s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:50:53 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-93e9cedb-94df-4ed6-8295-5d025ded4bf1 tempest-GroupSnapshotsTest-1929455548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ebd76c8f-eefe-470d-b175-65e28cdad708.ecfd425c-b1e4-4dd0-8007-c33cddf04a55 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:50:53 devstack sudo[90795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ebd76c8f-eefe-470d-b175-65e28cdad708.ecfd425c-b1e4-4dd0-8007-c33cddf04a55 Jul 10 15:50:53 devstack sudo[90795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:50:54 devstack sudo[90795]: pam_unix(sudo:session): session closed for user root Jul 10 15:50:54 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-93e9cedb-94df-4ed6-8295-5d025ded4bf1 tempest-GroupSnapshotsTest-1929455548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ebd76c8f-eefe-470d-b175-65e28cdad708.ecfd425c-b1e4-4dd0-8007-c33cddf04a55" returned: 0 in 0.797s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:50:54 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-93e9cedb-94df-4ed6-8295-5d025ded4bf1 tempest-GroupSnapshotsTest-1929455548 None] Lock "cinder-quobyte-ecfd425c-b1e4-4dd0-8007-c33cddf04a55" released by "_delete_snapshot" :: held 3.765s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:50:54 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-93e9cedb-94df-4ed6-8295-5d025ded4bf1 tempest-GroupSnapshotsTest-1929455548 None] Lock "cinder-quobyte-ebd76c8f-eefe-470d-b175-65e28cdad708" released by "delete_snapshot" :: held 3.804s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:50:54 devstack cinder-volume[87420]: WARNING cinder.quota [None req-93e9cedb-94df-4ed6-8295-5d025ded4bf1 tempest-GroupSnapshotsTest-1929455548 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1771706465 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1771706465, it is now deprecated. Please use the default quota class for default quota. Jul 10 15:50:54 devstack cinder-volume[87420]: WARNING cinder.quota [None req-93e9cedb-94df-4ed6-8295-5d025ded4bf1 tempest-GroupSnapshotsTest-1929455548 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1771706465 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1771706465, it is now deprecated. Please use the default quota class for default quota. Jul 10 15:50:54 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-93e9cedb-94df-4ed6-8295-5d025ded4bf1 tempest-GroupSnapshotsTest-1929455548 None] Created reservations ['e94e4764-b918-431d-9ede-f9f5a9dee253', '64c4c56a-f34b-4172-8ab9-d856bb70a297', 'fc37ecd8-7151-4594-98be-a1e4f8359b6f', '169ed568-cfbc-465a-a68c-fef168e58abb'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 15:50:54 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-93e9cedb-94df-4ed6-8295-5d025ded4bf1 tempest-GroupSnapshotsTest-1929455548 None] Created reservations ['541ae002-c0ff-4b4a-ba73-38a3aed346a5', 'f97b767d-c000-4da6-84b5-350335dda979', '5cda4dc9-6555-4950-be39-d8bd60cfcffd', '84767560-2786-4226-b6c2-20789fed4bbd'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 15:50:54 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-93e9cedb-94df-4ed6-8295-5d025ded4bf1 tempest-GroupSnapshotsTest-1929455548 None] group_snapshot 84f56a04-aeb2-4fb8-a4aa-8245cfd5a328: deleted successfully Jul 10 15:50:56 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-cd1cac87-34a8-497f-93d2-f389943eceeb tempest-GroupSnapshotsTest-1929455548 None] Acquiring lock "cinder-quobyte-22160be8-c693-4423-b9b3-80ebc07989d8" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:50:56 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-cd1cac87-34a8-497f-93d2-f389943eceeb tempest-GroupSnapshotsTest-1929455548 None] Lock "cinder-quobyte-22160be8-c693-4423-b9b3-80ebc07989d8" acquired by "delete_volume" :: waited 0.018s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:50:56 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3e805d1-e22f-449c-a532-275bfb1478ce]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:50:56 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-cd1cac87-34a8-497f-93d2-f389943eceeb tempest-GroupSnapshotsTest-1929455548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-22160be8-c693-4423-b9b3-80ebc07989d8 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:50:56 devstack sudo[90837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-22160be8-c693-4423-b9b3-80ebc07989d8 Jul 10 15:50:56 devstack sudo[90837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:50:57 devstack sudo[90837]: pam_unix(sudo:session): session closed for user root Jul 10 15:50:57 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-cd1cac87-34a8-497f-93d2-f389943eceeb tempest-GroupSnapshotsTest-1929455548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-22160be8-c693-4423-b9b3-80ebc07989d8" returned: 0 in 0.946s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:50:57 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-cd1cac87-34a8-497f-93d2-f389943eceeb tempest-GroupSnapshotsTest-1929455548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-22160be8-c693-4423-b9b3-80ebc07989d8 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:50:57 devstack sudo[90847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-22160be8-c693-4423-b9b3-80ebc07989d8 Jul 10 15:50:57 devstack sudo[90847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:50:58 devstack sudo[90847]: pam_unix(sudo:session): session closed for user root Jul 10 15:50:58 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-cd1cac87-34a8-497f-93d2-f389943eceeb tempest-GroupSnapshotsTest-1929455548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-22160be8-c693-4423-b9b3-80ebc07989d8" returned: 0 in 1.000s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:50:58 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-cd1cac87-34a8-497f-93d2-f389943eceeb tempest-GroupSnapshotsTest-1929455548 None] Lock "cinder-quobyte-22160be8-c693-4423-b9b3-80ebc07989d8" released by "delete_volume" :: held 2.051s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:50:58 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-cd1cac87-34a8-497f-93d2-f389943eceeb tempest-GroupSnapshotsTest-1929455548 None] Acquiring lock "cinder-quobyte-ebd76c8f-eefe-470d-b175-65e28cdad708" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:50:58 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-cd1cac87-34a8-497f-93d2-f389943eceeb tempest-GroupSnapshotsTest-1929455548 None] Lock "cinder-quobyte-ebd76c8f-eefe-470d-b175-65e28cdad708" acquired by "delete_volume" :: waited 0.020s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:50:58 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dced9e2-b523-452b-9d2e-e69d544a3bab]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:50:58 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-cd1cac87-34a8-497f-93d2-f389943eceeb tempest-GroupSnapshotsTest-1929455548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ebd76c8f-eefe-470d-b175-65e28cdad708 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:50:58 devstack sudo[90851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ebd76c8f-eefe-470d-b175-65e28cdad708 Jul 10 15:50:58 devstack sudo[90851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:50:59 devstack cinder-volume[87420]: INFO cinder.volume.manager [req-37ebd9df-ea88-4524-ad1e-48489f98e64d req-24be1a1c-9c76-4d82-82a9-4fcdfd076789 tempest-TaggedAttachmentsTest-1197600787 None] Terminate volume connection completed successfully. Jul 10 15:50:59 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [req-37ebd9df-ea88-4524-ad1e-48489f98e64d req-24be1a1c-9c76-4d82-82a9-4fcdfd076789 tempest-TaggedAttachmentsTest-1197600787 None] Deleting attachment 34937b04-d7a0-4871-b371-f9fd77b851cf. {{(pid=87420) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 15:50:59 devstack sudo[90851]: pam_unix(sudo:session): session closed for user root Jul 10 15:50:59 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-cd1cac87-34a8-497f-93d2-f389943eceeb tempest-GroupSnapshotsTest-1929455548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ebd76c8f-eefe-470d-b175-65e28cdad708" returned: 0 in 1.262s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:50:59 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-cd1cac87-34a8-497f-93d2-f389943eceeb tempest-GroupSnapshotsTest-1929455548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ebd76c8f-eefe-470d-b175-65e28cdad708 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:50:59 devstack sudo[90886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ebd76c8f-eefe-470d-b175-65e28cdad708 Jul 10 15:50:59 devstack sudo[90886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:51:00 devstack sudo[90886]: pam_unix(sudo:session): session closed for user root Jul 10 15:51:00 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-cd1cac87-34a8-497f-93d2-f389943eceeb tempest-GroupSnapshotsTest-1929455548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ebd76c8f-eefe-470d-b175-65e28cdad708" returned: 0 in 1.095s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:51:00 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-cd1cac87-34a8-497f-93d2-f389943eceeb tempest-GroupSnapshotsTest-1929455548 None] Lock "cinder-quobyte-ebd76c8f-eefe-470d-b175-65e28cdad708" released by "delete_volume" :: held 2.450s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:51:00 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-cd1cac87-34a8-497f-93d2-f389943eceeb tempest-GroupSnapshotsTest-1929455548 None] Created reservations ['4c3b2950-6602-4f32-afc3-3864beee8786'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 15:51:00 devstack cinder-volume[87420]: WARNING cinder.quota [None req-cd1cac87-34a8-497f-93d2-f389943eceeb tempest-GroupSnapshotsTest-1929455548 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1771706465 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1771706465, it is now deprecated. Please use the default quota class for default quota. Jul 10 15:51:00 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-cd1cac87-34a8-497f-93d2-f389943eceeb tempest-GroupSnapshotsTest-1929455548 None] Created reservations ['466e42a5-838f-456a-8817-9353e275691e', 'add23290-8bfb-4bcf-ad18-8a919534a047', 'f5410f69-dd00-40b2-96c9-f0d78208ac14', '595c1498-6dd7-46ab-bb0f-2be09b2766ef'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 15:51:01 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-cd1cac87-34a8-497f-93d2-f389943eceeb tempest-GroupSnapshotsTest-1929455548 None] Created reservations ['76a45e59-7376-49a2-9ca9-b79a5a581381', '3f4d0108-8dac-4691-b36f-7100fbf2c6b0', '547589e5-aa16-4e69-81d3-87bcd3e1cff8', 'a9bc3ee4-c1dd-4a19-828a-303f232fad5c'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 15:51:01 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-cd1cac87-34a8-497f-93d2-f389943eceeb tempest-GroupSnapshotsTest-1929455548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:51:01 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-cd1cac87-34a8-497f-93d2-f389943eceeb tempest-GroupSnapshotsTest-1929455548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:51:01 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-cd1cac87-34a8-497f-93d2-f389943eceeb tempest-GroupSnapshotsTest-1929455548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:51:01 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-cd1cac87-34a8-497f-93d2-f389943eceeb tempest-GroupSnapshotsTest-1929455548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:51:01 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-cd1cac87-34a8-497f-93d2-f389943eceeb tempest-GroupSnapshotsTest-1929455548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:51:01 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-cd1cac87-34a8-497f-93d2-f389943eceeb tempest-GroupSnapshotsTest-1929455548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:51:01 devstack sudo[90908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 15:51:01 devstack sudo[90908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:51:02 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-39afa8c4-2d14-4ba8-aad7-344b7dd3a5aa tempest-GroupSnapshotsTest-1929455548 None] Group tempest-GroupSnapshotsTest-Group-1812739563: creating Jul 10 15:51:02 devstack sudo[90908]: pam_unix(sudo:session): session closed for user root Jul 10 15:51:02 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-cd1cac87-34a8-497f-93d2-f389943eceeb tempest-GroupSnapshotsTest-1929455548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 1.312s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:51:02 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-cd1cac87-34a8-497f-93d2-f389943eceeb tempest-GroupSnapshotsTest-1929455548 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 15:51:02 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-39afa8c4-2d14-4ba8-aad7-344b7dd3a5aa tempest-GroupSnapshotsTest-1929455548 None] Group tempest-GroupSnapshotsTest-Group-1812739563: created successfully Jul 10 15:51:02 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-cd1cac87-34a8-497f-93d2-f389943eceeb tempest-GroupSnapshotsTest-1929455548 None] Delete group completed successfully. Jul 10 15:51:02 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-39afa8c4-2d14-4ba8-aad7-344b7dd3a5aa tempest-GroupSnapshotsTest-1929455548 None] Create group completed successfully. Jul 10 15:51:04 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdd8df55-227a-4247-884d-719bfdc90c1d tempest-GroupSnapshotsTest-1929455548 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 15:51:05 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-cdd8df55-227a-4247-884d-719bfdc90c1d tempest-GroupSnapshotsTest-1929455548 None] Flow 'volume_create_manager' (8b799319-b7f4-453b-895b-15302f52b06a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:51:05 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-cdd8df55-227a-4247-884d-719bfdc90c1d tempest-GroupSnapshotsTest-1929455548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8dfc708-239c-498d-a381-2d9d5ff79b00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:51:05 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-cdd8df55-227a-4247-884d-719bfdc90c1d tempest-GroupSnapshotsTest-1929455548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8dfc708-239c-498d-a381-2d9d5ff79b00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:51:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1739038855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c2928304-5840-4b1c-b0ff-6f97e1f3da75,host='devstack@QuobyteHD#QuobyteHD',id=cf2ee8e3-5f45-4457-add4-07f1d936cd15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e411f85fbd545ba9d5af3a552fec9e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:51:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:51:05Z,use_quota=True,user_id='d71b7302462541a89453c96eb1f7de16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd359bd7-b793-4f82-bf66-cde3a7e519d6),volume_type_id=bd359bd7-b793-4f82-bf66-cde3a7e519d6)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:51:05 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-cdd8df55-227a-4247-884d-719bfdc90c1d tempest-GroupSnapshotsTest-1929455548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8521cc47-d1de-4406-8568-3f8dd00e49db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:51:05 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-cdd8df55-227a-4247-884d-719bfdc90c1d tempest-GroupSnapshotsTest-1929455548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8521cc47-d1de-4406-8568-3f8dd00e49db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:51:05 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-cdd8df55-227a-4247-884d-719bfdc90c1d tempest-GroupSnapshotsTest-1929455548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82f6613b-6d0f-490c-be9d-ecf66ad81f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:51:05 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-cdd8df55-227a-4247-884d-719bfdc90c1d tempest-GroupSnapshotsTest-1929455548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82f6613b-6d0f-490c-be9d-ecf66ad81f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf2ee8e3-5f45-4457-add4-07f1d936cd15', 'volume_name': 'volume-cf2ee8e3-5f45-4457-add4-07f1d936cd15', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:51:05 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-cdd8df55-227a-4247-884d-719bfdc90c1d tempest-GroupSnapshotsTest-1929455548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5434464-9650-4b8a-84a6-9ff8887527e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:51:05 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-cdd8df55-227a-4247-884d-719bfdc90c1d tempest-GroupSnapshotsTest-1929455548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5434464-9650-4b8a-84a6-9ff8887527e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:51:05 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-cdd8df55-227a-4247-884d-719bfdc90c1d tempest-GroupSnapshotsTest-1929455548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c577618-1798-4b81-b212-c3e80697adde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:51:05 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-cdd8df55-227a-4247-884d-719bfdc90c1d tempest-GroupSnapshotsTest-1929455548 None] Volume cf2ee8e3-5f45-4457-add4-07f1d936cd15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf2ee8e3-5f45-4457-add4-07f1d936cd15', 'volume_size': 1} Jul 10 15:51:05 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-cdd8df55-227a-4247-884d-719bfdc90c1d tempest-GroupSnapshotsTest-1929455548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:51:05 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-cdd8df55-227a-4247-884d-719bfdc90c1d tempest-GroupSnapshotsTest-1929455548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:51:05 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-cdd8df55-227a-4247-884d-719bfdc90c1d tempest-GroupSnapshotsTest-1929455548 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c2928304-5840-4b1c-b0ff-6f97e1f3da75,created_at=2026-07-10T13:51:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1739038855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c2928304-5840-4b1c-b0ff-6f97e1f3da75,host='devstack@QuobyteHD#QuobyteHD',id=cf2ee8e3-5f45-4457-add4-07f1d936cd15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e411f85fbd545ba9d5af3a552fec9e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:51:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:51:05Z,use_quota=True,user_id='d71b7302462541a89453c96eb1f7de16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd359bd7-b793-4f82-bf66-cde3a7e519d6),volume_type_id=bd359bd7-b793-4f82-bf66-cde3a7e519d6)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 15:51:05 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-cdd8df55-227a-4247-884d-719bfdc90c1d tempest-GroupSnapshotsTest-1929455548 None] Creating volume cf2ee8e3-5f45-4457-add4-07f1d936cd15 {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 15:51:05 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-cdd8df55-227a-4247-884d-719bfdc90c1d tempest-GroupSnapshotsTest-1929455548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:51:05 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-cdd8df55-227a-4247-884d-719bfdc90c1d tempest-GroupSnapshotsTest-1929455548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:51:05 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-cdd8df55-227a-4247-884d-719bfdc90c1d tempest-GroupSnapshotsTest-1929455548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:51:05 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-cdd8df55-227a-4247-884d-719bfdc90c1d tempest-GroupSnapshotsTest-1929455548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:51:05 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-cdd8df55-227a-4247-884d-719bfdc90c1d tempest-GroupSnapshotsTest-1929455548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:51:05 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-cdd8df55-227a-4247-884d-719bfdc90c1d tempest-GroupSnapshotsTest-1929455548 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 15:51:05 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-cdd8df55-227a-4247-884d-719bfdc90c1d tempest-GroupSnapshotsTest-1929455548 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 15:51:05 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-cdd8df55-227a-4247-884d-719bfdc90c1d tempest-GroupSnapshotsTest-1929455548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-cf2ee8e3-5f45-4457-add4-07f1d936cd15 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:51:05 devstack sudo[90934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-cf2ee8e3-5f45-4457-add4-07f1d936cd15 1073741824 Jul 10 15:51:05 devstack sudo[90934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:51:06 devstack sudo[90934]: pam_unix(sudo:session): session closed for user root Jul 10 15:51:06 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-cdd8df55-227a-4247-884d-719bfdc90c1d tempest-GroupSnapshotsTest-1929455548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-cf2ee8e3-5f45-4457-add4-07f1d936cd15 1073741824" returned: 0 in 1.095s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:51:06 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-cdd8df55-227a-4247-884d-719bfdc90c1d tempest-GroupSnapshotsTest-1929455548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-cf2ee8e3-5f45-4457-add4-07f1d936cd15 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:51:06 devstack sudo[90959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-cf2ee8e3-5f45-4457-add4-07f1d936cd15 Jul 10 15:51:06 devstack sudo[90959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:51:07 devstack sudo[90959]: pam_unix(sudo:session): session closed for user root Jul 10 15:51:07 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-cdd8df55-227a-4247-884d-719bfdc90c1d tempest-GroupSnapshotsTest-1929455548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-cf2ee8e3-5f45-4457-add4-07f1d936cd15" returned: 0 in 0.848s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:51:07 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-cdd8df55-227a-4247-884d-719bfdc90c1d tempest-GroupSnapshotsTest-1929455548 None] <== create_volume: return (2009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 15:51:07 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-cdd8df55-227a-4247-884d-719bfdc90c1d tempest-GroupSnapshotsTest-1929455548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.013s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:51:07 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-cdd8df55-227a-4247-884d-719bfdc90c1d tempest-GroupSnapshotsTest-1929455548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c577618-1798-4b81-b212-c3e80697adde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf2ee8e3-5f45-4457-add4-07f1d936cd15', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:51:07 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-cdd8df55-227a-4247-884d-719bfdc90c1d tempest-GroupSnapshotsTest-1929455548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0d5302f-855a-457d-8047-9383dc80902f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:51:07 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-cdd8df55-227a-4247-884d-719bfdc90c1d tempest-GroupSnapshotsTest-1929455548 None] Volume volume-cf2ee8e3-5f45-4457-add4-07f1d936cd15 (cf2ee8e3-5f45-4457-add4-07f1d936cd15): created successfully Jul 10 15:51:07 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-cdd8df55-227a-4247-884d-719bfdc90c1d tempest-GroupSnapshotsTest-1929455548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0d5302f-855a-457d-8047-9383dc80902f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:51:07 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-cdd8df55-227a-4247-884d-719bfdc90c1d tempest-GroupSnapshotsTest-1929455548 None] Flow 'volume_create_manager' (8b799319-b7f4-453b-895b-15302f52b06a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:51:07 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-cdd8df55-227a-4247-884d-719bfdc90c1d tempest-GroupSnapshotsTest-1929455548 None] Created volume successfully. Jul 10 15:51:07 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-c377b00f-a976-427a-b5da-ff2b997f95f0 tempest-GroupSnapshotsTest-1929455548 None] GroupSnapshot 92aa1f2b-d285-4880-9d45-525a2778d7d9: creating. Jul 10 15:51:07 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c377b00f-a976-427a-b5da-ff2b997f95f0 tempest-GroupSnapshotsTest-1929455548 None] Group snapshot 92aa1f2b-d285-4880-9d45-525a2778d7d9: creating. {{(pid=87420) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 10 15:51:07 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-c377b00f-a976-427a-b5da-ff2b997f95f0 tempest-GroupSnapshotsTest-1929455548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:51:07 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-c377b00f-a976-427a-b5da-ff2b997f95f0 tempest-GroupSnapshotsTest-1929455548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:51:07 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-c377b00f-a976-427a-b5da-ff2b997f95f0 tempest-GroupSnapshotsTest-1929455548 None] Creating offline snapshot c7c20490-3c87-447e-be1c-a1f667bd72a0 of volume cf2ee8e3-5f45-4457-add4-07f1d936cd15 {{(pid=87420) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 15:51:07 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[74aee512-a767-4acd-ba1f-0a70d5ef9e0a]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:51:07 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c377b00f-a976-427a-b5da-ff2b997f95f0 tempest-GroupSnapshotsTest-1929455548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-cf2ee8e3-5f45-4457-add4-07f1d936cd15 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:51:08 devstack sudo[90978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-cf2ee8e3-5f45-4457-add4-07f1d936cd15 Jul 10 15:51:08 devstack sudo[90978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:51:08 devstack sudo[90978]: pam_unix(sudo:session): session closed for user root Jul 10 15:51:08 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c377b00f-a976-427a-b5da-ff2b997f95f0 tempest-GroupSnapshotsTest-1929455548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-cf2ee8e3-5f45-4457-add4-07f1d936cd15" returned: 0 in 0.962s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:51:08 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c377b00f-a976-427a-b5da-ff2b997f95f0 tempest-GroupSnapshotsTest-1929455548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-cf2ee8e3-5f45-4457-add4-07f1d936cd15,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-cf2ee8e3-5f45-4457-add4-07f1d936cd15.c7c20490-3c87-447e-be1c-a1f667bd72a0 1G {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:51:08 devstack sudo[91004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-cf2ee8e3-5f45-4457-add4-07f1d936cd15,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-cf2ee8e3-5f45-4457-add4-07f1d936cd15.c7c20490-3c87-447e-be1c-a1f667bd72a0 1G Jul 10 15:51:08 devstack sudo[91004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:51:09 devstack sudo[91004]: pam_unix(sudo:session): session closed for user root Jul 10 15:51:09 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c377b00f-a976-427a-b5da-ff2b997f95f0 tempest-GroupSnapshotsTest-1929455548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-cf2ee8e3-5f45-4457-add4-07f1d936cd15,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-cf2ee8e3-5f45-4457-add4-07f1d936cd15.c7c20490-3c87-447e-be1c-a1f667bd72a0 1G" returned: 0 in 0.841s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:51:09 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c377b00f-a976-427a-b5da-ff2b997f95f0 tempest-GroupSnapshotsTest-1929455548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf2ee8e3-5f45-4457-add4-07f1d936cd15 -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-cf2ee8e3-5f45-4457-add4-07f1d936cd15.c7c20490-3c87-447e-be1c-a1f667bd72a0 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:51:09 devstack sudo[91010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf2ee8e3-5f45-4457-add4-07f1d936cd15 -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-cf2ee8e3-5f45-4457-add4-07f1d936cd15.c7c20490-3c87-447e-be1c-a1f667bd72a0 Jul 10 15:51:09 devstack sudo[91010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:51:10 devstack sudo[91010]: pam_unix(sudo:session): session closed for user root Jul 10 15:51:10 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c377b00f-a976-427a-b5da-ff2b997f95f0 tempest-GroupSnapshotsTest-1929455548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf2ee8e3-5f45-4457-add4-07f1d936cd15 -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-cf2ee8e3-5f45-4457-add4-07f1d936cd15.c7c20490-3c87-447e-be1c-a1f667bd72a0" returned: 0 in 0.672s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:51:10 devstack cinder-volume[87420]: WARNING cinder.volume.drivers.remotefs [None req-c377b00f-a976-427a-b5da-ff2b997f95f0 tempest-GroupSnapshotsTest-1929455548 None] /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-cf2ee8e3-5f45-4457-add4-07f1d936cd15.c7c20490-3c87-447e-be1c-a1f667bd72a0 is being set with open permissions: ugo+rw: NotImplementedError Jul 10 15:51:10 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c377b00f-a976-427a-b5da-ff2b997f95f0 tempest-GroupSnapshotsTest-1929455548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-cf2ee8e3-5f45-4457-add4-07f1d936cd15.c7c20490-3c87-447e-be1c-a1f667bd72a0 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:51:10 devstack sudo[91022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-cf2ee8e3-5f45-4457-add4-07f1d936cd15.c7c20490-3c87-447e-be1c-a1f667bd72a0 Jul 10 15:51:10 devstack sudo[91022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:51:11 devstack sudo[91022]: pam_unix(sudo:session): session closed for user root Jul 10 15:51:11 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c377b00f-a976-427a-b5da-ff2b997f95f0 tempest-GroupSnapshotsTest-1929455548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-cf2ee8e3-5f45-4457-add4-07f1d936cd15.c7c20490-3c87-447e-be1c-a1f667bd72a0" returned: 0 in 0.989s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:51:11 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c377b00f-a976-427a-b5da-ff2b997f95f0 tempest-GroupSnapshotsTest-1929455548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-cf2ee8e3-5f45-4457-add4-07f1d936cd15.info {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:51:11 devstack sudo[91082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-cf2ee8e3-5f45-4457-add4-07f1d936cd15.info Jul 10 15:51:11 devstack sudo[91082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:51:12 devstack sudo[91082]: pam_unix(sudo:session): session closed for user root Jul 10 15:51:12 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c377b00f-a976-427a-b5da-ff2b997f95f0 tempest-GroupSnapshotsTest-1929455548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-cf2ee8e3-5f45-4457-add4-07f1d936cd15.info" returned: 0 in 0.759s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:51:12 devstack cinder-volume[87420]: WARNING cinder.volume.drivers.remotefs [None req-c377b00f-a976-427a-b5da-ff2b997f95f0 tempest-GroupSnapshotsTest-1929455548 None] /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-cf2ee8e3-5f45-4457-add4-07f1d936cd15.info is being set with open permissions: ugo+rw: NotImplementedError Jul 10 15:51:12 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c377b00f-a976-427a-b5da-ff2b997f95f0 tempest-GroupSnapshotsTest-1929455548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-cf2ee8e3-5f45-4457-add4-07f1d936cd15.info {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:51:12 devstack sudo[91095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-cf2ee8e3-5f45-4457-add4-07f1d936cd15.info Jul 10 15:51:12 devstack sudo[91095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:51:12 devstack sudo[91095]: pam_unix(sudo:session): session closed for user root Jul 10 15:51:12 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c377b00f-a976-427a-b5da-ff2b997f95f0 tempest-GroupSnapshotsTest-1929455548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-cf2ee8e3-5f45-4457-add4-07f1d936cd15.info" returned: 0 in 0.742s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:51:12 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-c377b00f-a976-427a-b5da-ff2b997f95f0 tempest-GroupSnapshotsTest-1929455548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.063s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:51:12 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-c377b00f-a976-427a-b5da-ff2b997f95f0 tempest-GroupSnapshotsTest-1929455548 None] group_snapshot 92aa1f2b-d285-4880-9d45-525a2778d7d9: created successfully Jul 10 15:51:13 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-743b0dc5-cee6-46ce-ac29-887b4152c8a7 tempest-GroupSnapshotsTest-1929455548 None] group_snapshot 92aa1f2b-d285-4880-9d45-525a2778d7d9: deleting Jul 10 15:51:13 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-743b0dc5-cee6-46ce-ac29-887b4152c8a7 tempest-GroupSnapshotsTest-1929455548 None] group_snapshot 92aa1f2b-d285-4880-9d45-525a2778d7d9: deleting {{(pid=87420) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 10 15:51:13 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-743b0dc5-cee6-46ce-ac29-887b4152c8a7 tempest-GroupSnapshotsTest-1929455548 None] Acquiring lock "cinder-quobyte-cf2ee8e3-5f45-4457-add4-07f1d936cd15" by "delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:51:13 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-743b0dc5-cee6-46ce-ac29-887b4152c8a7 tempest-GroupSnapshotsTest-1929455548 None] Lock "cinder-quobyte-cf2ee8e3-5f45-4457-add4-07f1d936cd15" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:51:13 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-743b0dc5-cee6-46ce-ac29-887b4152c8a7 tempest-GroupSnapshotsTest-1929455548 None] Acquiring lock "cinder-quobyte-c7c20490-3c87-447e-be1c-a1f667bd72a0" by "_delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:51:13 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-743b0dc5-cee6-46ce-ac29-887b4152c8a7 tempest-GroupSnapshotsTest-1929455548 None] Lock "cinder-quobyte-c7c20490-3c87-447e-be1c-a1f667bd72a0" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:51:13 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-743b0dc5-cee6-46ce-ac29-887b4152c8a7 tempest-GroupSnapshotsTest-1929455548 None] Deleting offline snapshot c7c20490-3c87-447e-be1c-a1f667bd72a0 of volume cf2ee8e3-5f45-4457-add4-07f1d936cd15 {{(pid=87420) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 15:51:13 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-743b0dc5-cee6-46ce-ac29-887b4152c8a7 tempest-GroupSnapshotsTest-1929455548 None] snapshot_file for this snap is: volume-cf2ee8e3-5f45-4457-add4-07f1d936cd15.c7c20490-3c87-447e-be1c-a1f667bd72a0 {{(pid=87420) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 15:51:13 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e2ff864-679b-49b1-9c28-fc27d28c798d]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:51:13 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-743b0dc5-cee6-46ce-ac29-887b4152c8a7 tempest-GroupSnapshotsTest-1929455548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-cf2ee8e3-5f45-4457-add4-07f1d936cd15.c7c20490-3c87-447e-be1c-a1f667bd72a0 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:51:13 devstack sudo[91124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-cf2ee8e3-5f45-4457-add4-07f1d936cd15.c7c20490-3c87-447e-be1c-a1f667bd72a0 Jul 10 15:51:13 devstack sudo[91124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:51:14 devstack sudo[91124]: pam_unix(sudo:session): session closed for user root Jul 10 15:51:14 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-743b0dc5-cee6-46ce-ac29-887b4152c8a7 tempest-GroupSnapshotsTest-1929455548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-cf2ee8e3-5f45-4457-add4-07f1d936cd15.c7c20490-3c87-447e-be1c-a1f667bd72a0" returned: 0 in 0.985s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:51:14 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-743b0dc5-cee6-46ce-ac29-887b4152c8a7 tempest-GroupSnapshotsTest-1929455548 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf2ee8e3-5f45-4457-add4-07f1d936cd15(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87420) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 15:51:14 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bb2a785-e781-4948-b022-15efc32d0a81]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:51:14 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-743b0dc5-cee6-46ce-ac29-887b4152c8a7 tempest-GroupSnapshotsTest-1929455548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-cf2ee8e3-5f45-4457-add4-07f1d936cd15 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:51:14 devstack sudo[91132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-cf2ee8e3-5f45-4457-add4-07f1d936cd15 Jul 10 15:51:14 devstack sudo[91132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:51:15 devstack sudo[91132]: pam_unix(sudo:session): session closed for user root Jul 10 15:51:15 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-743b0dc5-cee6-46ce-ac29-887b4152c8a7 tempest-GroupSnapshotsTest-1929455548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-cf2ee8e3-5f45-4457-add4-07f1d936cd15" returned: 0 in 0.937s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:51:15 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-743b0dc5-cee6-46ce-ac29-887b4152c8a7 tempest-GroupSnapshotsTest-1929455548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-cf2ee8e3-5f45-4457-add4-07f1d936cd15.c7c20490-3c87-447e-be1c-a1f667bd72a0 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:51:15 devstack sudo[91138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-cf2ee8e3-5f45-4457-add4-07f1d936cd15.c7c20490-3c87-447e-be1c-a1f667bd72a0 Jul 10 15:51:15 devstack sudo[91138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:51:16 devstack sudo[91138]: pam_unix(sudo:session): session closed for user root Jul 10 15:51:16 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-743b0dc5-cee6-46ce-ac29-887b4152c8a7 tempest-GroupSnapshotsTest-1929455548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-cf2ee8e3-5f45-4457-add4-07f1d936cd15.c7c20490-3c87-447e-be1c-a1f667bd72a0" returned: 0 in 0.847s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:51:16 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-743b0dc5-cee6-46ce-ac29-887b4152c8a7 tempest-GroupSnapshotsTest-1929455548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-cf2ee8e3-5f45-4457-add4-07f1d936cd15.c7c20490-3c87-447e-be1c-a1f667bd72a0 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:51:16 devstack sudo[91143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-cf2ee8e3-5f45-4457-add4-07f1d936cd15.c7c20490-3c87-447e-be1c-a1f667bd72a0 Jul 10 15:51:16 devstack sudo[91143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:51:16 devstack sudo[91143]: pam_unix(sudo:session): session closed for user root Jul 10 15:51:16 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-743b0dc5-cee6-46ce-ac29-887b4152c8a7 tempest-GroupSnapshotsTest-1929455548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-cf2ee8e3-5f45-4457-add4-07f1d936cd15.c7c20490-3c87-447e-be1c-a1f667bd72a0" returned: 0 in 0.674s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:51:17 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-743b0dc5-cee6-46ce-ac29-887b4152c8a7 tempest-GroupSnapshotsTest-1929455548 None] Lock "cinder-quobyte-c7c20490-3c87-447e-be1c-a1f667bd72a0" released by "_delete_snapshot" :: held 3.593s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:51:17 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-743b0dc5-cee6-46ce-ac29-887b4152c8a7 tempest-GroupSnapshotsTest-1929455548 None] Lock "cinder-quobyte-cf2ee8e3-5f45-4457-add4-07f1d936cd15" released by "delete_snapshot" :: held 3.618s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:51:17 devstack cinder-volume[87420]: WARNING cinder.quota [None req-743b0dc5-cee6-46ce-ac29-887b4152c8a7 tempest-GroupSnapshotsTest-1929455548 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2099399933 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2099399933, it is now deprecated. Please use the default quota class for default quota. Jul 10 15:51:17 devstack cinder-volume[87420]: WARNING cinder.quota [None req-743b0dc5-cee6-46ce-ac29-887b4152c8a7 tempest-GroupSnapshotsTest-1929455548 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2099399933 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2099399933, it is now deprecated. Please use the default quota class for default quota. Jul 10 15:51:17 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-743b0dc5-cee6-46ce-ac29-887b4152c8a7 tempest-GroupSnapshotsTest-1929455548 None] Created reservations ['38f056df-3124-495d-a548-6a86334013d9', 'b191f785-5bdb-4b2d-a955-23ca005f8ef4', '2d95d1aa-433e-4493-9941-f633d556dfcc', '16bace45-de65-4ceb-8223-7b8db934e09e'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 15:51:17 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-743b0dc5-cee6-46ce-ac29-887b4152c8a7 tempest-GroupSnapshotsTest-1929455548 None] group_snapshot 92aa1f2b-d285-4880-9d45-525a2778d7d9: deleted successfully Jul 10 15:51:17 devstack cinder-volume[87420]: DEBUG oslo_service.periodic_task [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87420) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 15:51:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:51:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:51:17 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:51:17 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:51:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:51:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:51:17 devstack sudo[91147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 15:51:17 devstack sudo[91147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:51:18 devstack sudo[91147]: pam_unix(sudo:session): session closed for user root Jul 10 15:51:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.697s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:51:18 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 15:51:18 devstack cinder-volume[87420]: DEBUG oslo_service.periodic_task [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Running periodic task VolumeManager._thread_info {{(pid=87420) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 15:51:18 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] thread count: 8 {{(pid=87420) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 15:51:18 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] thread info: [<_MainThread(MainThread, started 133639250378880)>, , , , , , , ] {{(pid=87420) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 15:51:18 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-e397582b-77b5-4ec5-9c20-021a77358842 tempest-GroupSnapshotsTest-1929455548 None] Acquiring lock "cinder-quobyte-cf2ee8e3-5f45-4457-add4-07f1d936cd15" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:51:18 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-e397582b-77b5-4ec5-9c20-021a77358842 tempest-GroupSnapshotsTest-1929455548 None] Lock "cinder-quobyte-cf2ee8e3-5f45-4457-add4-07f1d936cd15" acquired by "delete_volume" :: waited 0.027s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:51:18 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3f3d1f9-fea5-476e-b6f6-a2d01f37b563]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:51:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-e397582b-77b5-4ec5-9c20-021a77358842 tempest-GroupSnapshotsTest-1929455548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-cf2ee8e3-5f45-4457-add4-07f1d936cd15 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:51:18 devstack sudo[91150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-cf2ee8e3-5f45-4457-add4-07f1d936cd15 Jul 10 15:51:18 devstack sudo[91150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:51:19 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-8e36bb3f-e15a-4937-9b00-b5e910455917 tempest-TaggedAttachmentsTest-1197600787 None] Acquiring lock "cinder-27f25116-9e7b-4fc4-b271-b9079a07c1a7-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:51:19 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-8e36bb3f-e15a-4937-9b00-b5e910455917 tempest-TaggedAttachmentsTest-1197600787 None] Lock "cinder-27f25116-9e7b-4fc4-b271-b9079a07c1a7-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:51:19 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-8e36bb3f-e15a-4937-9b00-b5e910455917 tempest-TaggedAttachmentsTest-1197600787 None] Acquiring lock "cinder-quobyte-27f25116-9e7b-4fc4-b271-b9079a07c1a7" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:51:19 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-8e36bb3f-e15a-4937-9b00-b5e910455917 tempest-TaggedAttachmentsTest-1197600787 None] Lock "cinder-quobyte-27f25116-9e7b-4fc4-b271-b9079a07c1a7" acquired by "delete_volume" :: waited 0.023s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:51:19 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0f5379d-1457-41dd-93ea-f3e25192e0c7]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:51:19 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8e36bb3f-e15a-4937-9b00-b5e910455917 tempest-TaggedAttachmentsTest-1197600787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-27f25116-9e7b-4fc4-b271-b9079a07c1a7 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:51:19 devstack sudo[91150]: pam_unix(sudo:session): session closed for user root Jul 10 15:51:19 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-e397582b-77b5-4ec5-9c20-021a77358842 tempest-GroupSnapshotsTest-1929455548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-cf2ee8e3-5f45-4457-add4-07f1d936cd15" returned: 0 in 0.980s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:51:19 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-e397582b-77b5-4ec5-9c20-021a77358842 tempest-GroupSnapshotsTest-1929455548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-cf2ee8e3-5f45-4457-add4-07f1d936cd15 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:51:19 devstack sudo[91156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-27f25116-9e7b-4fc4-b271-b9079a07c1a7 Jul 10 15:51:19 devstack sudo[91156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:51:19 devstack sudo[91159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-cf2ee8e3-5f45-4457-add4-07f1d936cd15 Jul 10 15:51:19 devstack sudo[91159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:51:19 devstack sudo[91156]: pam_unix(sudo:session): session closed for user root Jul 10 15:51:19 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8e36bb3f-e15a-4937-9b00-b5e910455917 tempest-TaggedAttachmentsTest-1197600787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-27f25116-9e7b-4fc4-b271-b9079a07c1a7" returned: 0 in 0.793s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:51:19 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8e36bb3f-e15a-4937-9b00-b5e910455917 tempest-TaggedAttachmentsTest-1197600787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-27f25116-9e7b-4fc4-b271-b9079a07c1a7 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:51:19 devstack sudo[91165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-27f25116-9e7b-4fc4-b271-b9079a07c1a7 Jul 10 15:51:19 devstack sudo[91165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:51:19 devstack sudo[91159]: pam_unix(sudo:session): session closed for user root Jul 10 15:51:19 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-e397582b-77b5-4ec5-9c20-021a77358842 tempest-GroupSnapshotsTest-1929455548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-cf2ee8e3-5f45-4457-add4-07f1d936cd15" returned: 0 in 0.706s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:51:20 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-e397582b-77b5-4ec5-9c20-021a77358842 tempest-GroupSnapshotsTest-1929455548 None] Lock "cinder-quobyte-cf2ee8e3-5f45-4457-add4-07f1d936cd15" released by "delete_volume" :: held 1.761s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:51:20 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-e397582b-77b5-4ec5-9c20-021a77358842 tempest-GroupSnapshotsTest-1929455548 None] Created reservations ['ac5b83b1-dcb6-471f-a176-4929db08640d'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 15:51:20 devstack cinder-volume[87420]: WARNING cinder.quota [None req-e397582b-77b5-4ec5-9c20-021a77358842 tempest-GroupSnapshotsTest-1929455548 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2099399933 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2099399933, it is now deprecated. Please use the default quota class for default quota. Jul 10 15:51:20 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-e397582b-77b5-4ec5-9c20-021a77358842 tempest-GroupSnapshotsTest-1929455548 None] Created reservations ['3f71e677-4cd9-4cc7-87c7-f4a253605d72', 'ef676980-818a-4e7c-b510-a77e9b628e04', '420fe157-2577-46cc-82e4-7ad8de569318', '9d531f04-7b76-4076-81ae-e69e0841ce7f'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 15:51:20 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-e397582b-77b5-4ec5-9c20-021a77358842 tempest-GroupSnapshotsTest-1929455548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:51:20 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-e397582b-77b5-4ec5-9c20-021a77358842 tempest-GroupSnapshotsTest-1929455548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:51:20 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-e397582b-77b5-4ec5-9c20-021a77358842 tempest-GroupSnapshotsTest-1929455548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:51:20 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-e397582b-77b5-4ec5-9c20-021a77358842 tempest-GroupSnapshotsTest-1929455548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:51:20 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-e397582b-77b5-4ec5-9c20-021a77358842 tempest-GroupSnapshotsTest-1929455548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:51:20 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-e397582b-77b5-4ec5-9c20-021a77358842 tempest-GroupSnapshotsTest-1929455548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:51:20 devstack sudo[91167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 15:51:20 devstack sudo[91167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:51:20 devstack sudo[91165]: pam_unix(sudo:session): session closed for user root Jul 10 15:51:20 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8e36bb3f-e15a-4937-9b00-b5e910455917 tempest-TaggedAttachmentsTest-1197600787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-27f25116-9e7b-4fc4-b271-b9079a07c1a7" returned: 0 in 0.703s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:51:20 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-8e36bb3f-e15a-4937-9b00-b5e910455917 tempest-TaggedAttachmentsTest-1197600787 None] Lock "cinder-quobyte-27f25116-9e7b-4fc4-b271-b9079a07c1a7" released by "delete_volume" :: held 1.547s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:51:20 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-8e36bb3f-e15a-4937-9b00-b5e910455917 tempest-TaggedAttachmentsTest-1197600787 None] Created reservations ['9c99afb5-d9a7-42e9-945a-1cca7915f6b7', '9f7551d0-02aa-40f4-bf87-9e6f3ed8a4e1', 'a8a76560-b3ff-4146-92fc-f5ef4ce7c21e', 'b714861b-e984-4d96-97f8-6480f781170a'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 15:51:20 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-8e36bb3f-e15a-4937-9b00-b5e910455917 tempest-TaggedAttachmentsTest-1197600787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:51:20 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-8e36bb3f-e15a-4937-9b00-b5e910455917 tempest-TaggedAttachmentsTest-1197600787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:51:20 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-8e36bb3f-e15a-4937-9b00-b5e910455917 tempest-TaggedAttachmentsTest-1197600787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:51:20 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-8e36bb3f-e15a-4937-9b00-b5e910455917 tempest-TaggedAttachmentsTest-1197600787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:51:20 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-8e36bb3f-e15a-4937-9b00-b5e910455917 tempest-TaggedAttachmentsTest-1197600787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:51:20 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8e36bb3f-e15a-4937-9b00-b5e910455917 tempest-TaggedAttachmentsTest-1197600787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:51:20 devstack sudo[91172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 15:51:20 devstack sudo[91172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:51:21 devstack sudo[91167]: pam_unix(sudo:session): session closed for user root Jul 10 15:51:21 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-e397582b-77b5-4ec5-9c20-021a77358842 tempest-GroupSnapshotsTest-1929455548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 1.000s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:51:21 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-e397582b-77b5-4ec5-9c20-021a77358842 tempest-GroupSnapshotsTest-1929455548 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 15:51:21 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-e397582b-77b5-4ec5-9c20-021a77358842 tempest-GroupSnapshotsTest-1929455548 None] Delete group completed successfully. Jul 10 15:51:21 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-6894e600-1c33-4a56-96e3-67aab0335fe1 tempest-AttachVolumeNegativeTest-1493731096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 15:51:21 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6894e600-1c33-4a56-96e3-67aab0335fe1 tempest-AttachVolumeNegativeTest-1493731096 None] Flow 'volume_create_manager' (926e7b55-ddd4-4ff2-abf1-520cad6050a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:51:21 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6894e600-1c33-4a56-96e3-67aab0335fe1 tempest-AttachVolumeNegativeTest-1493731096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8456f578-0fa0-4407-b45c-36ceb3f97068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:51:21 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6894e600-1c33-4a56-96e3-67aab0335fe1 tempest-AttachVolumeNegativeTest-1493731096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8456f578-0fa0-4407-b45c-36ceb3f97068) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:51:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1089709169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d379d9ec-b303-49c3-882c-2b898db59f2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2952153f098f446c9a2a3feb2ece06da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:51:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:51:22Z,use_quota=True,user_id='144bbba7ccc243468434455811e8982f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:51:21 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6894e600-1c33-4a56-96e3-67aab0335fe1 tempest-AttachVolumeNegativeTest-1493731096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fe4a3b3-3017-46c1-885e-7129d96d6a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:51:21 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6894e600-1c33-4a56-96e3-67aab0335fe1 tempest-AttachVolumeNegativeTest-1493731096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fe4a3b3-3017-46c1-885e-7129d96d6a41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:51:21 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6894e600-1c33-4a56-96e3-67aab0335fe1 tempest-AttachVolumeNegativeTest-1493731096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17259a68-4a81-4747-adc6-f8a063dfc446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:51:21 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6894e600-1c33-4a56-96e3-67aab0335fe1 tempest-AttachVolumeNegativeTest-1493731096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17259a68-4a81-4747-adc6-f8a063dfc446) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd379d9ec-b303-49c3-882c-2b898db59f2d', 'volume_name': 'volume-d379d9ec-b303-49c3-882c-2b898db59f2d', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:51:21 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6894e600-1c33-4a56-96e3-67aab0335fe1 tempest-AttachVolumeNegativeTest-1493731096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5721eed2-a251-4480-88e2-23a36be6dc68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:51:21 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6894e600-1c33-4a56-96e3-67aab0335fe1 tempest-AttachVolumeNegativeTest-1493731096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5721eed2-a251-4480-88e2-23a36be6dc68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:51:21 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6894e600-1c33-4a56-96e3-67aab0335fe1 tempest-AttachVolumeNegativeTest-1493731096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6e4471f-686c-4502-bfbe-99b81e0ba9b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:51:21 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-6894e600-1c33-4a56-96e3-67aab0335fe1 tempest-AttachVolumeNegativeTest-1493731096 None] Volume d379d9ec-b303-49c3-882c-2b898db59f2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d379d9ec-b303-49c3-882c-2b898db59f2d', 'volume_size': 1} Jul 10 15:51:21 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-6894e600-1c33-4a56-96e3-67aab0335fe1 tempest-AttachVolumeNegativeTest-1493731096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:51:21 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-6894e600-1c33-4a56-96e3-67aab0335fe1 tempest-AttachVolumeNegativeTest-1493731096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:51:21 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-6894e600-1c33-4a56-96e3-67aab0335fe1 tempest-AttachVolumeNegativeTest-1493731096 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:51:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1089709169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d379d9ec-b303-49c3-882c-2b898db59f2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2952153f098f446c9a2a3feb2ece06da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:51:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:51:22Z,use_quota=True,user_id='144bbba7ccc243468434455811e8982f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 15:51:21 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-6894e600-1c33-4a56-96e3-67aab0335fe1 tempest-AttachVolumeNegativeTest-1493731096 None] Creating volume d379d9ec-b303-49c3-882c-2b898db59f2d {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 15:51:21 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-6894e600-1c33-4a56-96e3-67aab0335fe1 tempest-AttachVolumeNegativeTest-1493731096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:51:21 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-6894e600-1c33-4a56-96e3-67aab0335fe1 tempest-AttachVolumeNegativeTest-1493731096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:51:21 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-6894e600-1c33-4a56-96e3-67aab0335fe1 tempest-AttachVolumeNegativeTest-1493731096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:51:21 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-6894e600-1c33-4a56-96e3-67aab0335fe1 tempest-AttachVolumeNegativeTest-1493731096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:51:21 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-6894e600-1c33-4a56-96e3-67aab0335fe1 tempest-AttachVolumeNegativeTest-1493731096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:51:21 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-6894e600-1c33-4a56-96e3-67aab0335fe1 tempest-AttachVolumeNegativeTest-1493731096 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 15:51:21 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-6894e600-1c33-4a56-96e3-67aab0335fe1 tempest-AttachVolumeNegativeTest-1493731096 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 15:51:21 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6894e600-1c33-4a56-96e3-67aab0335fe1 tempest-AttachVolumeNegativeTest-1493731096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d379d9ec-b303-49c3-882c-2b898db59f2d 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:51:21 devstack sudo[91177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d379d9ec-b303-49c3-882c-2b898db59f2d 1073741824 Jul 10 15:51:21 devstack sudo[91177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:51:22 devstack sudo[91172]: pam_unix(sudo:session): session closed for user root Jul 10 15:51:22 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8e36bb3f-e15a-4937-9b00-b5e910455917 tempest-TaggedAttachmentsTest-1197600787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 1.353s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:51:22 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-8e36bb3f-e15a-4937-9b00-b5e910455917 tempest-TaggedAttachmentsTest-1197600787 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 15:51:22 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-8e36bb3f-e15a-4937-9b00-b5e910455917 tempest-TaggedAttachmentsTest-1197600787 None] Deleted volume successfully. Jul 10 15:51:22 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-8e36bb3f-e15a-4937-9b00-b5e910455917 tempest-TaggedAttachmentsTest-1197600787 None] Lock "cinder-27f25116-9e7b-4fc4-b271-b9079a07c1a7-delete_volume" released by "delete_volume" :: held 3.254s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:51:23 devstack sudo[91177]: pam_unix(sudo:session): session closed for user root Jul 10 15:51:23 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6894e600-1c33-4a56-96e3-67aab0335fe1 tempest-AttachVolumeNegativeTest-1493731096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d379d9ec-b303-49c3-882c-2b898db59f2d 1073741824" returned: 0 in 1.256s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:51:23 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6894e600-1c33-4a56-96e3-67aab0335fe1 tempest-AttachVolumeNegativeTest-1493731096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d379d9ec-b303-49c3-882c-2b898db59f2d {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:51:23 devstack sudo[91184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d379d9ec-b303-49c3-882c-2b898db59f2d Jul 10 15:51:23 devstack sudo[91184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:51:24 devstack sudo[91184]: pam_unix(sudo:session): session closed for user root Jul 10 15:51:24 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6894e600-1c33-4a56-96e3-67aab0335fe1 tempest-AttachVolumeNegativeTest-1493731096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d379d9ec-b303-49c3-882c-2b898db59f2d" returned: 0 in 1.039s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:51:24 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-6894e600-1c33-4a56-96e3-67aab0335fe1 tempest-AttachVolumeNegativeTest-1493731096 None] <== create_volume: return (2378ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 15:51:24 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-6894e600-1c33-4a56-96e3-67aab0335fe1 tempest-AttachVolumeNegativeTest-1493731096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.381s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:51:24 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6894e600-1c33-4a56-96e3-67aab0335fe1 tempest-AttachVolumeNegativeTest-1493731096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6e4471f-686c-4502-bfbe-99b81e0ba9b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d379d9ec-b303-49c3-882c-2b898db59f2d', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:51:24 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6894e600-1c33-4a56-96e3-67aab0335fe1 tempest-AttachVolumeNegativeTest-1493731096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59cd9ae9-ca9d-407d-b76a-e97544081d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:51:24 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-6894e600-1c33-4a56-96e3-67aab0335fe1 tempest-AttachVolumeNegativeTest-1493731096 None] Volume volume-d379d9ec-b303-49c3-882c-2b898db59f2d (d379d9ec-b303-49c3-882c-2b898db59f2d): created successfully Jul 10 15:51:24 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6894e600-1c33-4a56-96e3-67aab0335fe1 tempest-AttachVolumeNegativeTest-1493731096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59cd9ae9-ca9d-407d-b76a-e97544081d71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:51:24 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6894e600-1c33-4a56-96e3-67aab0335fe1 tempest-AttachVolumeNegativeTest-1493731096 None] Flow 'volume_create_manager' (926e7b55-ddd4-4ff2-abf1-520cad6050a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:51:24 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-6894e600-1c33-4a56-96e3-67aab0335fe1 tempest-AttachVolumeNegativeTest-1493731096 None] Created volume successfully. Jul 10 15:51:27 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-46eb2864-3da9-403d-95ad-f8f78dcbd621 tempest-GroupsTest-1548618761 None] Group tempest-Group1-1209578473: creating Jul 10 15:51:27 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-46eb2864-3da9-403d-95ad-f8f78dcbd621 tempest-GroupsTest-1548618761 None] Group tempest-Group1-1209578473: created successfully Jul 10 15:51:27 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-46eb2864-3da9-403d-95ad-f8f78dcbd621 tempest-GroupsTest-1548618761 None] Create group completed successfully. Jul 10 15:51:28 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [req-6cad77ac-0b4c-43d4-b187-c139b36f33ba req-eae438c9-ad0e-44b7-93f7-e007f623e682 tempest-AttachVolumeNegativeTest-1493731096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:51:28 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [req-6cad77ac-0b4c-43d4-b187-c139b36f33ba req-eae438c9-ad0e-44b7-93f7-e007f623e682 tempest-AttachVolumeNegativeTest-1493731096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:51:28 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[1411d95d-06ec-471f-af5e-4157a49bde3d]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:51:28 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [req-6cad77ac-0b4c-43d4-b187-c139b36f33ba req-eae438c9-ad0e-44b7-93f7-e007f623e682 tempest-AttachVolumeNegativeTest-1493731096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d379d9ec-b303-49c3-882c-2b898db59f2d {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:51:28 devstack sudo[91245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d379d9ec-b303-49c3-882c-2b898db59f2d Jul 10 15:51:28 devstack sudo[91245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:51:29 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-db592258-eb0b-4d79-aaa1-0856bea2b875 tempest-GroupsTest-1548618761 None] Group tempest-Group2-1582329192: creating Jul 10 15:51:29 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-db592258-eb0b-4d79-aaa1-0856bea2b875 tempest-GroupsTest-1548618761 None] Group tempest-Group2-1582329192: created successfully Jul 10 15:51:29 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-db592258-eb0b-4d79-aaa1-0856bea2b875 tempest-GroupsTest-1548618761 None] Create group completed successfully. Jul 10 15:51:29 devstack sudo[91245]: pam_unix(sudo:session): session closed for user root Jul 10 15:51:29 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [req-6cad77ac-0b4c-43d4-b187-c139b36f33ba req-eae438c9-ad0e-44b7-93f7-e007f623e682 tempest-AttachVolumeNegativeTest-1493731096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d379d9ec-b303-49c3-882c-2b898db59f2d" returned: 0 in 0.891s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:51:29 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [req-6cad77ac-0b4c-43d4-b187-c139b36f33ba req-eae438c9-ad0e-44b7-93f7-e007f623e682 tempest-AttachVolumeNegativeTest-1493731096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.914s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:51:29 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [req-6cad77ac-0b4c-43d4-b187-c139b36f33ba req-eae438c9-ad0e-44b7-93f7-e007f623e682 tempest-AttachVolumeNegativeTest-1493731096 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80', 'name': 'volume-d379d9ec-b303-49c3-882c-2b898db59f2d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5035941a-c725-4ab4-a326-59e493655b86', 'enforce_multipath': True} {{(pid=87420) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 15:51:29 devstack cinder-volume[87420]: INFO cinder.volume.manager [req-6cad77ac-0b4c-43d4-b187-c139b36f33ba req-eae438c9-ad0e-44b7-93f7-e007f623e682 tempest-AttachVolumeNegativeTest-1493731096 None] attachment_update completed successfully. Jul 10 15:51:30 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f23b486-e6fe-4ede-9be1-9a279320bba2 tempest-GroupsTest-1548618761 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 15:51:30 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-2f23b486-e6fe-4ede-9be1-9a279320bba2 tempest-GroupsTest-1548618761 None] Flow 'volume_create_manager' (0bfcfb72-47fa-45a1-9f24-862806c1e3fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:51:30 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-2f23b486-e6fe-4ede-9be1-9a279320bba2 tempest-GroupsTest-1548618761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89c6989d-0ea4-49c6-bec8-81cf666d9d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:51:30 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-2f23b486-e6fe-4ede-9be1-9a279320bba2 tempest-GroupsTest-1548618761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89c6989d-0ea4-49c6-bec8-81cf666d9d59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:51:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1270475819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=002e33bb-98c4-4194-b85f-cd7a9c55ecc5,host='devstack@QuobyteHD#QuobyteHD',id=10334e27-35f5-494b-ad58-e8f9607c2d48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df0326c673d34c7182122ab5a8de9002',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:51:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:51:31Z,use_quota=True,user_id='c040a6c4bbb641beb4b5149a5e15ec6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7c6fde7-b8c3-49ff-be81-087b3d949e69),volume_type_id=f7c6fde7-b8c3-49ff-be81-087b3d949e69)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:51:30 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-2f23b486-e6fe-4ede-9be1-9a279320bba2 tempest-GroupsTest-1548618761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6e801fd-4fba-4fc2-86e3-447982202591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:51:30 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-2f23b486-e6fe-4ede-9be1-9a279320bba2 tempest-GroupsTest-1548618761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6e801fd-4fba-4fc2-86e3-447982202591) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:51:30 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-2f23b486-e6fe-4ede-9be1-9a279320bba2 tempest-GroupsTest-1548618761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3c9a1b6-624b-4ea8-9ce5-6867da71d501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:51:30 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-2f23b486-e6fe-4ede-9be1-9a279320bba2 tempest-GroupsTest-1548618761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3c9a1b6-624b-4ea8-9ce5-6867da71d501) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10334e27-35f5-494b-ad58-e8f9607c2d48', 'volume_name': 'volume-10334e27-35f5-494b-ad58-e8f9607c2d48', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:51:30 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-2f23b486-e6fe-4ede-9be1-9a279320bba2 tempest-GroupsTest-1548618761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (497a5cac-d20b-46e9-8910-b96efed8a34a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:51:30 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-2f23b486-e6fe-4ede-9be1-9a279320bba2 tempest-GroupsTest-1548618761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (497a5cac-d20b-46e9-8910-b96efed8a34a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:51:30 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-2f23b486-e6fe-4ede-9be1-9a279320bba2 tempest-GroupsTest-1548618761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28ea1e86-110b-480e-8160-8d24e0fca325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:51:30 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-2f23b486-e6fe-4ede-9be1-9a279320bba2 tempest-GroupsTest-1548618761 None] Volume 10334e27-35f5-494b-ad58-e8f9607c2d48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10334e27-35f5-494b-ad58-e8f9607c2d48', 'volume_size': 1} Jul 10 15:51:30 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-2f23b486-e6fe-4ede-9be1-9a279320bba2 tempest-GroupsTest-1548618761 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:51:30 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-2f23b486-e6fe-4ede-9be1-9a279320bba2 tempest-GroupsTest-1548618761 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:51:30 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-2f23b486-e6fe-4ede-9be1-9a279320bba2 tempest-GroupsTest-1548618761 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=002e33bb-98c4-4194-b85f-cd7a9c55ecc5,created_at=2026-07-10T13:51:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1270475819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=002e33bb-98c4-4194-b85f-cd7a9c55ecc5,host='devstack@QuobyteHD#QuobyteHD',id=10334e27-35f5-494b-ad58-e8f9607c2d48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df0326c673d34c7182122ab5a8de9002',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:51:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:51:31Z,use_quota=True,user_id='c040a6c4bbb641beb4b5149a5e15ec6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7c6fde7-b8c3-49ff-be81-087b3d949e69),volume_type_id=f7c6fde7-b8c3-49ff-be81-087b3d949e69)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 15:51:30 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-2f23b486-e6fe-4ede-9be1-9a279320bba2 tempest-GroupsTest-1548618761 None] Creating volume 10334e27-35f5-494b-ad58-e8f9607c2d48 {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 15:51:30 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-2f23b486-e6fe-4ede-9be1-9a279320bba2 tempest-GroupsTest-1548618761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:51:30 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-2f23b486-e6fe-4ede-9be1-9a279320bba2 tempest-GroupsTest-1548618761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:51:30 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-2f23b486-e6fe-4ede-9be1-9a279320bba2 tempest-GroupsTest-1548618761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:51:30 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-2f23b486-e6fe-4ede-9be1-9a279320bba2 tempest-GroupsTest-1548618761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:51:30 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-2f23b486-e6fe-4ede-9be1-9a279320bba2 tempest-GroupsTest-1548618761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:51:30 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-2f23b486-e6fe-4ede-9be1-9a279320bba2 tempest-GroupsTest-1548618761 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 15:51:30 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-2f23b486-e6fe-4ede-9be1-9a279320bba2 tempest-GroupsTest-1548618761 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 15:51:30 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-2f23b486-e6fe-4ede-9be1-9a279320bba2 tempest-GroupsTest-1548618761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-10334e27-35f5-494b-ad58-e8f9607c2d48 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:51:30 devstack sudo[91635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-10334e27-35f5-494b-ad58-e8f9607c2d48 1073741824 Jul 10 15:51:30 devstack sudo[91635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:51:31 devstack sudo[91635]: pam_unix(sudo:session): session closed for user root Jul 10 15:51:31 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-2f23b486-e6fe-4ede-9be1-9a279320bba2 tempest-GroupsTest-1548618761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-10334e27-35f5-494b-ad58-e8f9607c2d48 1073741824" returned: 0 in 0.918s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:51:31 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-2f23b486-e6fe-4ede-9be1-9a279320bba2 tempest-GroupsTest-1548618761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-10334e27-35f5-494b-ad58-e8f9607c2d48 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:51:31 devstack sudo[91641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-10334e27-35f5-494b-ad58-e8f9607c2d48 Jul 10 15:51:31 devstack sudo[91641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:51:32 devstack sudo[91641]: pam_unix(sudo:session): session closed for user root Jul 10 15:51:32 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-2f23b486-e6fe-4ede-9be1-9a279320bba2 tempest-GroupsTest-1548618761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-10334e27-35f5-494b-ad58-e8f9607c2d48" returned: 0 in 0.807s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:51:32 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-2f23b486-e6fe-4ede-9be1-9a279320bba2 tempest-GroupsTest-1548618761 None] <== create_volume: return (1777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 15:51:32 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-2f23b486-e6fe-4ede-9be1-9a279320bba2 tempest-GroupsTest-1548618761 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.781s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:51:32 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-2f23b486-e6fe-4ede-9be1-9a279320bba2 tempest-GroupsTest-1548618761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28ea1e86-110b-480e-8160-8d24e0fca325) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10334e27-35f5-494b-ad58-e8f9607c2d48', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:51:32 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-2f23b486-e6fe-4ede-9be1-9a279320bba2 tempest-GroupsTest-1548618761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aefacc5b-e5eb-4028-8312-effc3e634a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:51:32 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-2f23b486-e6fe-4ede-9be1-9a279320bba2 tempest-GroupsTest-1548618761 None] Volume volume-10334e27-35f5-494b-ad58-e8f9607c2d48 (10334e27-35f5-494b-ad58-e8f9607c2d48): created successfully Jul 10 15:51:32 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-2f23b486-e6fe-4ede-9be1-9a279320bba2 tempest-GroupsTest-1548618761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aefacc5b-e5eb-4028-8312-effc3e634a96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:51:32 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-2f23b486-e6fe-4ede-9be1-9a279320bba2 tempest-GroupsTest-1548618761 None] Flow 'volume_create_manager' (0bfcfb72-47fa-45a1-9f24-862806c1e3fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:51:32 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-2f23b486-e6fe-4ede-9be1-9a279320bba2 tempest-GroupsTest-1548618761 None] Created volume successfully. Jul 10 15:51:33 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-d5575f49-77db-4795-a2a6-61b454fc16ad tempest-GroupsTest-1548618761 None] Acquiring lock "cinder-quobyte-10334e27-35f5-494b-ad58-e8f9607c2d48" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:51:33 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-d5575f49-77db-4795-a2a6-61b454fc16ad tempest-GroupsTest-1548618761 None] Lock "cinder-quobyte-10334e27-35f5-494b-ad58-e8f9607c2d48" acquired by "delete_volume" :: waited 0.019s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:51:33 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[1031f9e0-c882-450d-8e1f-f282fedec97f]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:51:33 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d5575f49-77db-4795-a2a6-61b454fc16ad tempest-GroupsTest-1548618761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-10334e27-35f5-494b-ad58-e8f9607c2d48 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:51:33 devstack sudo[91645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-10334e27-35f5-494b-ad58-e8f9607c2d48 Jul 10 15:51:33 devstack sudo[91645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:51:34 devstack sudo[91645]: pam_unix(sudo:session): session closed for user root Jul 10 15:51:34 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d5575f49-77db-4795-a2a6-61b454fc16ad tempest-GroupsTest-1548618761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-10334e27-35f5-494b-ad58-e8f9607c2d48" returned: 0 in 0.888s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:51:34 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d5575f49-77db-4795-a2a6-61b454fc16ad tempest-GroupsTest-1548618761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-10334e27-35f5-494b-ad58-e8f9607c2d48 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:51:34 devstack sudo[91652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-10334e27-35f5-494b-ad58-e8f9607c2d48 Jul 10 15:51:34 devstack sudo[91652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:51:35 devstack sudo[91652]: pam_unix(sudo:session): session closed for user root Jul 10 15:51:35 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d5575f49-77db-4795-a2a6-61b454fc16ad tempest-GroupsTest-1548618761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-10334e27-35f5-494b-ad58-e8f9607c2d48" returned: 0 in 0.933s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:51:35 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-d5575f49-77db-4795-a2a6-61b454fc16ad tempest-GroupsTest-1548618761 None] Lock "cinder-quobyte-10334e27-35f5-494b-ad58-e8f9607c2d48" released by "delete_volume" :: held 1.876s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:51:35 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-d5575f49-77db-4795-a2a6-61b454fc16ad tempest-GroupsTest-1548618761 None] Created reservations ['e4a999d5-470c-4490-b81d-88f6793372a6'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 15:51:35 devstack cinder-volume[87420]: WARNING cinder.quota [None req-d5575f49-77db-4795-a2a6-61b454fc16ad tempest-GroupsTest-1548618761 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-67042481 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-67042481, it is now deprecated. Please use the default quota class for default quota. Jul 10 15:51:35 devstack cinder-volume[87420]: WARNING cinder.quota [None req-d5575f49-77db-4795-a2a6-61b454fc16ad tempest-GroupsTest-1548618761 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-67042481 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-67042481, it is now deprecated. Please use the default quota class for default quota. Jul 10 15:51:35 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-d5575f49-77db-4795-a2a6-61b454fc16ad tempest-GroupsTest-1548618761 None] Created reservations ['b70f5708-3c9c-4ac6-a807-8d3cc5cea945', 'bbef9819-56aa-45cd-b33d-0aae51a39ac9', '0f66c204-62f1-40f1-aa78-6f064c1c9c94', '9c81582c-406e-4dbe-aa97-5c019b180218'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 15:51:35 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-d5575f49-77db-4795-a2a6-61b454fc16ad tempest-GroupsTest-1548618761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:51:35 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-d5575f49-77db-4795-a2a6-61b454fc16ad tempest-GroupsTest-1548618761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:51:35 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-d5575f49-77db-4795-a2a6-61b454fc16ad tempest-GroupsTest-1548618761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:51:35 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-d5575f49-77db-4795-a2a6-61b454fc16ad tempest-GroupsTest-1548618761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:51:35 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-d5575f49-77db-4795-a2a6-61b454fc16ad tempest-GroupsTest-1548618761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:51:35 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d5575f49-77db-4795-a2a6-61b454fc16ad tempest-GroupsTest-1548618761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:51:35 devstack sudo[91656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 15:51:35 devstack sudo[91656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:51:36 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-91f266bc-4cff-4b89-9044-b587a08014ee tempest-GroupsTest-1548618761 None] Created reservations ['4473602a-6378-47f8-96a0-b4e11fde95fd'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 15:51:36 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-91f266bc-4cff-4b89-9044-b587a08014ee tempest-GroupsTest-1548618761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:51:36 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-91f266bc-4cff-4b89-9044-b587a08014ee tempest-GroupsTest-1548618761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:51:36 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-91f266bc-4cff-4b89-9044-b587a08014ee tempest-GroupsTest-1548618761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:51:36 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-91f266bc-4cff-4b89-9044-b587a08014ee tempest-GroupsTest-1548618761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:51:36 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-91f266bc-4cff-4b89-9044-b587a08014ee tempest-GroupsTest-1548618761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:51:36 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-91f266bc-4cff-4b89-9044-b587a08014ee tempest-GroupsTest-1548618761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:51:36 devstack sudo[91664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 15:51:36 devstack sudo[91664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:51:36 devstack sudo[91656]: pam_unix(sudo:session): session closed for user root Jul 10 15:51:36 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d5575f49-77db-4795-a2a6-61b454fc16ad tempest-GroupsTest-1548618761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.843s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:51:36 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-d5575f49-77db-4795-a2a6-61b454fc16ad tempest-GroupsTest-1548618761 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 15:51:36 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-d5575f49-77db-4795-a2a6-61b454fc16ad tempest-GroupsTest-1548618761 None] Delete group completed successfully. Jul 10 15:51:37 devstack sudo[91664]: pam_unix(sudo:session): session closed for user root Jul 10 15:51:37 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-91f266bc-4cff-4b89-9044-b587a08014ee tempest-GroupsTest-1548618761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.959s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:51:37 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-91f266bc-4cff-4b89-9044-b587a08014ee tempest-GroupsTest-1548618761 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 15:51:37 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-91f266bc-4cff-4b89-9044-b587a08014ee tempest-GroupsTest-1548618761 None] Delete group completed successfully. Jul 10 15:51:38 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-a977740d-06e3-4587-b1db-31efde848f51 tempest-GroupsTest-1548618761 None] Group tempest-GroupsTest-Group-1865131967: creating Jul 10 15:51:38 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-a977740d-06e3-4587-b1db-31efde848f51 tempest-GroupsTest-1548618761 None] Group tempest-GroupsTest-Group-1865131967: created successfully Jul 10 15:51:38 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-a977740d-06e3-4587-b1db-31efde848f51 tempest-GroupsTest-1548618761 None] Create group completed successfully. Jul 10 15:51:40 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfecbd05-1643-4942-8cb5-480b27c042c0 tempest-GroupsTest-1548618761 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 15:51:40 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-cfecbd05-1643-4942-8cb5-480b27c042c0 tempest-GroupsTest-1548618761 None] Flow 'volume_create_manager' (72dae371-48c5-4f00-818b-ab435db7e2c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:51:40 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-cfecbd05-1643-4942-8cb5-480b27c042c0 tempest-GroupsTest-1548618761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58b39cf2-7215-46ae-a726-e714eb1a0e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:51:40 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-cfecbd05-1643-4942-8cb5-480b27c042c0 tempest-GroupsTest-1548618761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58b39cf2-7215-46ae-a726-e714eb1a0e86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:51:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-450079062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1d4ac840-0102-4ec1-a0d9-c839cbc65ab5,host='devstack@QuobyteHD#QuobyteHD',id=cee8570d-03b3-4dc5-9d4c-a40b122cfa4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df0326c673d34c7182122ab5a8de9002',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:51:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:51:40Z,use_quota=True,user_id='c040a6c4bbb641beb4b5149a5e15ec6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b883d9df-e3d4-428b-b19e-a1362dc6cd44),volume_type_id=b883d9df-e3d4-428b-b19e-a1362dc6cd44)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:51:40 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-cfecbd05-1643-4942-8cb5-480b27c042c0 tempest-GroupsTest-1548618761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a62f6a88-3c80-4adb-a10c-e1e77feee8f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:51:40 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-cfecbd05-1643-4942-8cb5-480b27c042c0 tempest-GroupsTest-1548618761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a62f6a88-3c80-4adb-a10c-e1e77feee8f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:51:40 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-cfecbd05-1643-4942-8cb5-480b27c042c0 tempest-GroupsTest-1548618761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b062cc16-2dbd-4528-96e7-22e84e720f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:51:40 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-cfecbd05-1643-4942-8cb5-480b27c042c0 tempest-GroupsTest-1548618761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b062cc16-2dbd-4528-96e7-22e84e720f70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cee8570d-03b3-4dc5-9d4c-a40b122cfa4b', 'volume_name': 'volume-cee8570d-03b3-4dc5-9d4c-a40b122cfa4b', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:51:40 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-cfecbd05-1643-4942-8cb5-480b27c042c0 tempest-GroupsTest-1548618761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86735783-aa14-4a7b-83fe-67473bbca8e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:51:40 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-cfecbd05-1643-4942-8cb5-480b27c042c0 tempest-GroupsTest-1548618761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86735783-aa14-4a7b-83fe-67473bbca8e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:51:40 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-cfecbd05-1643-4942-8cb5-480b27c042c0 tempest-GroupsTest-1548618761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41569ce1-1a5d-4c16-88dd-8b66d1aaa8ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:51:40 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-cfecbd05-1643-4942-8cb5-480b27c042c0 tempest-GroupsTest-1548618761 None] Volume cee8570d-03b3-4dc5-9d4c-a40b122cfa4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cee8570d-03b3-4dc5-9d4c-a40b122cfa4b', 'volume_size': 1} Jul 10 15:51:40 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-cfecbd05-1643-4942-8cb5-480b27c042c0 tempest-GroupsTest-1548618761 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:51:40 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-cfecbd05-1643-4942-8cb5-480b27c042c0 tempest-GroupsTest-1548618761 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:51:40 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-cfecbd05-1643-4942-8cb5-480b27c042c0 tempest-GroupsTest-1548618761 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1d4ac840-0102-4ec1-a0d9-c839cbc65ab5,created_at=2026-07-10T13:51:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-450079062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1d4ac840-0102-4ec1-a0d9-c839cbc65ab5,host='devstack@QuobyteHD#QuobyteHD',id=cee8570d-03b3-4dc5-9d4c-a40b122cfa4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df0326c673d34c7182122ab5a8de9002',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:51:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:51:40Z,use_quota=True,user_id='c040a6c4bbb641beb4b5149a5e15ec6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b883d9df-e3d4-428b-b19e-a1362dc6cd44),volume_type_id=b883d9df-e3d4-428b-b19e-a1362dc6cd44)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 15:51:40 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-cfecbd05-1643-4942-8cb5-480b27c042c0 tempest-GroupsTest-1548618761 None] Creating volume cee8570d-03b3-4dc5-9d4c-a40b122cfa4b {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 15:51:40 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-cfecbd05-1643-4942-8cb5-480b27c042c0 tempest-GroupsTest-1548618761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:51:40 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-cfecbd05-1643-4942-8cb5-480b27c042c0 tempest-GroupsTest-1548618761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:51:40 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-cfecbd05-1643-4942-8cb5-480b27c042c0 tempest-GroupsTest-1548618761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:51:40 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-cfecbd05-1643-4942-8cb5-480b27c042c0 tempest-GroupsTest-1548618761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:51:40 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-cfecbd05-1643-4942-8cb5-480b27c042c0 tempest-GroupsTest-1548618761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:51:40 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-cfecbd05-1643-4942-8cb5-480b27c042c0 tempest-GroupsTest-1548618761 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 15:51:40 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-cfecbd05-1643-4942-8cb5-480b27c042c0 tempest-GroupsTest-1548618761 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 15:51:40 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-cfecbd05-1643-4942-8cb5-480b27c042c0 tempest-GroupsTest-1548618761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-cee8570d-03b3-4dc5-9d4c-a40b122cfa4b 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:51:40 devstack sudo[91687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-cee8570d-03b3-4dc5-9d4c-a40b122cfa4b 1073741824 Jul 10 15:51:40 devstack sudo[91687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:51:41 devstack sudo[91687]: pam_unix(sudo:session): session closed for user root Jul 10 15:51:41 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-cfecbd05-1643-4942-8cb5-480b27c042c0 tempest-GroupsTest-1548618761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-cee8570d-03b3-4dc5-9d4c-a40b122cfa4b 1073741824" returned: 0 in 1.191s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:51:41 devstack cinder-volume[87420]: DEBUG dbcounter [-] [87420] Writing DB stats cinder:UPDATE=97,cinder:SELECT=99,cinder:INSERT=22,cinder:DELETE=1 {{(pid=87420) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 15:51:41 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-cfecbd05-1643-4942-8cb5-480b27c042c0 tempest-GroupsTest-1548618761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-cee8570d-03b3-4dc5-9d4c-a40b122cfa4b {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:51:41 devstack sudo[91697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-cee8570d-03b3-4dc5-9d4c-a40b122cfa4b Jul 10 15:51:41 devstack sudo[91697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:51:42 devstack sudo[91697]: pam_unix(sudo:session): session closed for user root Jul 10 15:51:42 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-cfecbd05-1643-4942-8cb5-480b27c042c0 tempest-GroupsTest-1548618761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-cee8570d-03b3-4dc5-9d4c-a40b122cfa4b" returned: 0 in 0.786s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:51:42 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-cfecbd05-1643-4942-8cb5-480b27c042c0 tempest-GroupsTest-1548618761 None] <== create_volume: return (2054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 15:51:42 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-cfecbd05-1643-4942-8cb5-480b27c042c0 tempest-GroupsTest-1548618761 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.060s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:51:42 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-cfecbd05-1643-4942-8cb5-480b27c042c0 tempest-GroupsTest-1548618761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41569ce1-1a5d-4c16-88dd-8b66d1aaa8ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cee8570d-03b3-4dc5-9d4c-a40b122cfa4b', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:51:42 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-cfecbd05-1643-4942-8cb5-480b27c042c0 tempest-GroupsTest-1548618761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67e6e3bc-9aa7-4304-ba7d-22fe7626b3ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:51:42 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-cfecbd05-1643-4942-8cb5-480b27c042c0 tempest-GroupsTest-1548618761 None] Volume volume-cee8570d-03b3-4dc5-9d4c-a40b122cfa4b (cee8570d-03b3-4dc5-9d4c-a40b122cfa4b): created successfully Jul 10 15:51:42 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-cfecbd05-1643-4942-8cb5-480b27c042c0 tempest-GroupsTest-1548618761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67e6e3bc-9aa7-4304-ba7d-22fe7626b3ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:51:42 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-cfecbd05-1643-4942-8cb5-480b27c042c0 tempest-GroupsTest-1548618761 None] Flow 'volume_create_manager' (72dae371-48c5-4f00-818b-ab435db7e2c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:51:42 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-cfecbd05-1643-4942-8cb5-480b27c042c0 tempest-GroupsTest-1548618761 None] Created volume successfully. Jul 10 15:51:43 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1e849eb-2fba-4e03-9fb6-f0b5db79a6c5 tempest-GroupsTest-1548618761 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 15:51:43 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b1e849eb-2fba-4e03-9fb6-f0b5db79a6c5 tempest-GroupsTest-1548618761 None] Flow 'volume_create_manager' (7a87088d-b473-42a1-8c83-fa82b26554f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:51:43 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b1e849eb-2fba-4e03-9fb6-f0b5db79a6c5 tempest-GroupsTest-1548618761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6351bf81-f133-4fd8-ad8c-a34a75d10dc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:51:43 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b1e849eb-2fba-4e03-9fb6-f0b5db79a6c5 tempest-GroupsTest-1548618761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6351bf81-f133-4fd8-ad8c-a34a75d10dc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:51:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2105541294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1d4ac840-0102-4ec1-a0d9-c839cbc65ab5,host='devstack@QuobyteHD#QuobyteHD',id=984c8c22-3c96-4316-a8e4-98231325b3d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df0326c673d34c7182122ab5a8de9002',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:51:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:51:43Z,use_quota=True,user_id='c040a6c4bbb641beb4b5149a5e15ec6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b883d9df-e3d4-428b-b19e-a1362dc6cd44),volume_type_id=b883d9df-e3d4-428b-b19e-a1362dc6cd44)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:51:43 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b1e849eb-2fba-4e03-9fb6-f0b5db79a6c5 tempest-GroupsTest-1548618761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a93bfa5-91b7-4841-a33d-cec4b364af3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:51:43 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b1e849eb-2fba-4e03-9fb6-f0b5db79a6c5 tempest-GroupsTest-1548618761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a93bfa5-91b7-4841-a33d-cec4b364af3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:51:43 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b1e849eb-2fba-4e03-9fb6-f0b5db79a6c5 tempest-GroupsTest-1548618761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (133a93f0-540f-46b4-ab22-e4556ccdba6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:51:43 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b1e849eb-2fba-4e03-9fb6-f0b5db79a6c5 tempest-GroupsTest-1548618761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (133a93f0-540f-46b4-ab22-e4556ccdba6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '984c8c22-3c96-4316-a8e4-98231325b3d0', 'volume_name': 'volume-984c8c22-3c96-4316-a8e4-98231325b3d0', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:51:43 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b1e849eb-2fba-4e03-9fb6-f0b5db79a6c5 tempest-GroupsTest-1548618761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef79deab-5ec5-4482-9a7c-42b24b4cee88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:51:43 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b1e849eb-2fba-4e03-9fb6-f0b5db79a6c5 tempest-GroupsTest-1548618761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef79deab-5ec5-4482-9a7c-42b24b4cee88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:51:43 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b1e849eb-2fba-4e03-9fb6-f0b5db79a6c5 tempest-GroupsTest-1548618761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1a3bc54-1de0-45c8-a380-7d2a4f0e5488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:51:43 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-b1e849eb-2fba-4e03-9fb6-f0b5db79a6c5 tempest-GroupsTest-1548618761 None] Volume 984c8c22-3c96-4316-a8e4-98231325b3d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-984c8c22-3c96-4316-a8e4-98231325b3d0', 'volume_size': 1} Jul 10 15:51:43 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-b1e849eb-2fba-4e03-9fb6-f0b5db79a6c5 tempest-GroupsTest-1548618761 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:51:43 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-b1e849eb-2fba-4e03-9fb6-f0b5db79a6c5 tempest-GroupsTest-1548618761 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:51:43 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-b1e849eb-2fba-4e03-9fb6-f0b5db79a6c5 tempest-GroupsTest-1548618761 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1d4ac840-0102-4ec1-a0d9-c839cbc65ab5,created_at=2026-07-10T13:51:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2105541294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1d4ac840-0102-4ec1-a0d9-c839cbc65ab5,host='devstack@QuobyteHD#QuobyteHD',id=984c8c22-3c96-4316-a8e4-98231325b3d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df0326c673d34c7182122ab5a8de9002',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:51:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:51:43Z,use_quota=True,user_id='c040a6c4bbb641beb4b5149a5e15ec6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b883d9df-e3d4-428b-b19e-a1362dc6cd44),volume_type_id=b883d9df-e3d4-428b-b19e-a1362dc6cd44)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 15:51:43 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-b1e849eb-2fba-4e03-9fb6-f0b5db79a6c5 tempest-GroupsTest-1548618761 None] Creating volume 984c8c22-3c96-4316-a8e4-98231325b3d0 {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 15:51:43 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-b1e849eb-2fba-4e03-9fb6-f0b5db79a6c5 tempest-GroupsTest-1548618761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:51:43 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-b1e849eb-2fba-4e03-9fb6-f0b5db79a6c5 tempest-GroupsTest-1548618761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:51:43 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-b1e849eb-2fba-4e03-9fb6-f0b5db79a6c5 tempest-GroupsTest-1548618761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:51:43 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-b1e849eb-2fba-4e03-9fb6-f0b5db79a6c5 tempest-GroupsTest-1548618761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:51:43 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-b1e849eb-2fba-4e03-9fb6-f0b5db79a6c5 tempest-GroupsTest-1548618761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:51:43 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-b1e849eb-2fba-4e03-9fb6-f0b5db79a6c5 tempest-GroupsTest-1548618761 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 15:51:43 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-b1e849eb-2fba-4e03-9fb6-f0b5db79a6c5 tempest-GroupsTest-1548618761 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 15:51:43 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-b1e849eb-2fba-4e03-9fb6-f0b5db79a6c5 tempest-GroupsTest-1548618761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-984c8c22-3c96-4316-a8e4-98231325b3d0 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:51:43 devstack sudo[91704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-984c8c22-3c96-4316-a8e4-98231325b3d0 1073741824 Jul 10 15:51:43 devstack sudo[91704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:51:44 devstack sudo[91704]: pam_unix(sudo:session): session closed for user root Jul 10 15:51:44 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-b1e849eb-2fba-4e03-9fb6-f0b5db79a6c5 tempest-GroupsTest-1548618761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-984c8c22-3c96-4316-a8e4-98231325b3d0 1073741824" returned: 0 in 0.935s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:51:44 devstack cinder-volume[87420]: DEBUG dbcounter [-] [87420] Writing DB stats cinder:UPDATE=89,cinder:SELECT=95,cinder:INSERT=20,cinder:DELETE=3 {{(pid=87420) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 15:51:44 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-b1e849eb-2fba-4e03-9fb6-f0b5db79a6c5 tempest-GroupsTest-1548618761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-984c8c22-3c96-4316-a8e4-98231325b3d0 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:51:44 devstack sudo[91717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-984c8c22-3c96-4316-a8e4-98231325b3d0 Jul 10 15:51:44 devstack sudo[91717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:51:45 devstack sudo[91717]: pam_unix(sudo:session): session closed for user root Jul 10 15:51:45 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-b1e849eb-2fba-4e03-9fb6-f0b5db79a6c5 tempest-GroupsTest-1548618761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-984c8c22-3c96-4316-a8e4-98231325b3d0" returned: 0 in 0.833s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:51:45 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-b1e849eb-2fba-4e03-9fb6-f0b5db79a6c5 tempest-GroupsTest-1548618761 None] <== create_volume: return (1837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 15:51:45 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-b1e849eb-2fba-4e03-9fb6-f0b5db79a6c5 tempest-GroupsTest-1548618761 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.843s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:51:45 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b1e849eb-2fba-4e03-9fb6-f0b5db79a6c5 tempest-GroupsTest-1548618761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1a3bc54-1de0-45c8-a380-7d2a4f0e5488) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-984c8c22-3c96-4316-a8e4-98231325b3d0', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:51:45 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b1e849eb-2fba-4e03-9fb6-f0b5db79a6c5 tempest-GroupsTest-1548618761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43b885bf-2f67-4c48-8cbb-45452941da1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:51:45 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-b1e849eb-2fba-4e03-9fb6-f0b5db79a6c5 tempest-GroupsTest-1548618761 None] Volume volume-984c8c22-3c96-4316-a8e4-98231325b3d0 (984c8c22-3c96-4316-a8e4-98231325b3d0): created successfully Jul 10 15:51:45 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b1e849eb-2fba-4e03-9fb6-f0b5db79a6c5 tempest-GroupsTest-1548618761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43b885bf-2f67-4c48-8cbb-45452941da1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:51:45 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b1e849eb-2fba-4e03-9fb6-f0b5db79a6c5 tempest-GroupsTest-1548618761 None] Flow 'volume_create_manager' (7a87088d-b473-42a1-8c83-fa82b26554f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:51:45 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-b1e849eb-2fba-4e03-9fb6-f0b5db79a6c5 tempest-GroupsTest-1548618761 None] Created volume successfully. Jul 10 15:51:45 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-4589b62b-dde5-4690-8cd6-d4b6a5c75bb3 tempest-AttachVolumeShelveTestJSON-1184417620 None] Acquiring lock "cinder-696fc062-8f81-4dca-bdb4-350927f10aa5-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:51:45 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-4589b62b-dde5-4690-8cd6-d4b6a5c75bb3 tempest-AttachVolumeShelveTestJSON-1184417620 None] Lock "cinder-696fc062-8f81-4dca-bdb4-350927f10aa5-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:51:45 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-4589b62b-dde5-4690-8cd6-d4b6a5c75bb3 tempest-AttachVolumeShelveTestJSON-1184417620 None] Acquiring lock "cinder-quobyte-696fc062-8f81-4dca-bdb4-350927f10aa5" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:51:45 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-4589b62b-dde5-4690-8cd6-d4b6a5c75bb3 tempest-AttachVolumeShelveTestJSON-1184417620 None] Lock "cinder-quobyte-696fc062-8f81-4dca-bdb4-350927f10aa5" acquired by "delete_volume" :: waited 0.025s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:51:45 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d00e298-6866-4c91-9de7-6aa021b567b9]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:51:45 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4589b62b-dde5-4690-8cd6-d4b6a5c75bb3 tempest-AttachVolumeShelveTestJSON-1184417620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-696fc062-8f81-4dca-bdb4-350927f10aa5 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:51:46 devstack sudo[91720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-696fc062-8f81-4dca-bdb4-350927f10aa5 Jul 10 15:51:46 devstack sudo[91720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:51:46 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-3d399632-ccbe-4182-be35-783618bfd7b2 tempest-GroupsTest-1548618761 None] Update group completed successfully. Jul 10 15:51:46 devstack sudo[91720]: pam_unix(sudo:session): session closed for user root Jul 10 15:51:46 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4589b62b-dde5-4690-8cd6-d4b6a5c75bb3 tempest-AttachVolumeShelveTestJSON-1184417620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-696fc062-8f81-4dca-bdb4-350927f10aa5" returned: 0 in 1.029s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:51:46 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4589b62b-dde5-4690-8cd6-d4b6a5c75bb3 tempest-AttachVolumeShelveTestJSON-1184417620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-696fc062-8f81-4dca-bdb4-350927f10aa5 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:51:47 devstack sudo[91726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-696fc062-8f81-4dca-bdb4-350927f10aa5 Jul 10 15:51:47 devstack sudo[91726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:51:47 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-ddf3f6ac-b258-4625-8352-adb291a9b4fc tempest-GroupsTest-1548618761 None] Update group completed successfully. Jul 10 15:51:48 devstack sudo[91726]: pam_unix(sudo:session): session closed for user root Jul 10 15:51:48 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4589b62b-dde5-4690-8cd6-d4b6a5c75bb3 tempest-AttachVolumeShelveTestJSON-1184417620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-696fc062-8f81-4dca-bdb4-350927f10aa5" returned: 0 in 1.096s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:51:48 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-4589b62b-dde5-4690-8cd6-d4b6a5c75bb3 tempest-AttachVolumeShelveTestJSON-1184417620 None] Lock "cinder-quobyte-696fc062-8f81-4dca-bdb4-350927f10aa5" released by "delete_volume" :: held 2.209s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:51:48 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-4589b62b-dde5-4690-8cd6-d4b6a5c75bb3 tempest-AttachVolumeShelveTestJSON-1184417620 None] Created reservations ['3ef064fe-a343-42c9-8b33-46ac9a304931', '3b86a955-4e4e-4c42-aeb6-40a95adf48a6', '382aa7c2-0006-4eb5-83b0-788fe739c776', '7a4df927-8153-43c4-be02-d457f6566d3c'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 15:51:48 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-4589b62b-dde5-4690-8cd6-d4b6a5c75bb3 tempest-AttachVolumeShelveTestJSON-1184417620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:51:48 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-4589b62b-dde5-4690-8cd6-d4b6a5c75bb3 tempest-AttachVolumeShelveTestJSON-1184417620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:51:48 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-4589b62b-dde5-4690-8cd6-d4b6a5c75bb3 tempest-AttachVolumeShelveTestJSON-1184417620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:51:48 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-4589b62b-dde5-4690-8cd6-d4b6a5c75bb3 tempest-AttachVolumeShelveTestJSON-1184417620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:51:48 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-4589b62b-dde5-4690-8cd6-d4b6a5c75bb3 tempest-AttachVolumeShelveTestJSON-1184417620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:51:48 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4589b62b-dde5-4690-8cd6-d4b6a5c75bb3 tempest-AttachVolumeShelveTestJSON-1184417620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:51:48 devstack sudo[91733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 15:51:48 devstack sudo[91733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:51:49 devstack sudo[91733]: pam_unix(sudo:session): session closed for user root Jul 10 15:51:49 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4589b62b-dde5-4690-8cd6-d4b6a5c75bb3 tempest-AttachVolumeShelveTestJSON-1184417620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.856s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:51:49 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-4589b62b-dde5-4690-8cd6-d4b6a5c75bb3 tempest-AttachVolumeShelveTestJSON-1184417620 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 15:51:49 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-4589b62b-dde5-4690-8cd6-d4b6a5c75bb3 tempest-AttachVolumeShelveTestJSON-1184417620 None] Deleted volume successfully. Jul 10 15:51:49 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-4589b62b-dde5-4690-8cd6-d4b6a5c75bb3 tempest-AttachVolumeShelveTestJSON-1184417620 None] Lock "cinder-696fc062-8f81-4dca-bdb4-350927f10aa5-delete_volume" released by "delete_volume" :: held 3.360s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:51:49 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-6cae2fb3-220d-4f53-84f1-a516554cd913 tempest-GroupsTest-1548618761 None] Acquiring lock "cinder-quobyte-984c8c22-3c96-4316-a8e4-98231325b3d0" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:51:49 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-6cae2fb3-220d-4f53-84f1-a516554cd913 tempest-GroupsTest-1548618761 None] Lock "cinder-quobyte-984c8c22-3c96-4316-a8e4-98231325b3d0" acquired by "delete_volume" :: waited 0.038s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:51:49 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9b14bae-e5c8-40c6-8659-b76e0235ebbc]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:51:49 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6cae2fb3-220d-4f53-84f1-a516554cd913 tempest-GroupsTest-1548618761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-984c8c22-3c96-4316-a8e4-98231325b3d0 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:51:49 devstack sudo[91754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-984c8c22-3c96-4316-a8e4-98231325b3d0 Jul 10 15:51:49 devstack sudo[91754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:51:50 devstack sudo[91754]: pam_unix(sudo:session): session closed for user root Jul 10 15:51:50 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6cae2fb3-220d-4f53-84f1-a516554cd913 tempest-GroupsTest-1548618761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-984c8c22-3c96-4316-a8e4-98231325b3d0" returned: 0 in 0.854s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:51:50 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6cae2fb3-220d-4f53-84f1-a516554cd913 tempest-GroupsTest-1548618761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-984c8c22-3c96-4316-a8e4-98231325b3d0 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:51:50 devstack sudo[91783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-984c8c22-3c96-4316-a8e4-98231325b3d0 Jul 10 15:51:50 devstack sudo[91783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:51:51 devstack sudo[91783]: pam_unix(sudo:session): session closed for user root Jul 10 15:51:51 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6cae2fb3-220d-4f53-84f1-a516554cd913 tempest-GroupsTest-1548618761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-984c8c22-3c96-4316-a8e4-98231325b3d0" returned: 0 in 0.803s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:51:51 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-6cae2fb3-220d-4f53-84f1-a516554cd913 tempest-GroupsTest-1548618761 None] Lock "cinder-quobyte-984c8c22-3c96-4316-a8e4-98231325b3d0" released by "delete_volume" :: held 1.718s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:51:51 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-6cae2fb3-220d-4f53-84f1-a516554cd913 tempest-GroupsTest-1548618761 None] Acquiring lock "cinder-quobyte-cee8570d-03b3-4dc5-9d4c-a40b122cfa4b" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:51:51 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-6cae2fb3-220d-4f53-84f1-a516554cd913 tempest-GroupsTest-1548618761 None] Lock "cinder-quobyte-cee8570d-03b3-4dc5-9d4c-a40b122cfa4b" acquired by "delete_volume" :: waited 0.014s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:51:51 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d433f99-f524-4260-a469-1f78c10065d9]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:51:51 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6cae2fb3-220d-4f53-84f1-a516554cd913 tempest-GroupsTest-1548618761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-cee8570d-03b3-4dc5-9d4c-a40b122cfa4b {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:51:51 devstack sudo[91788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-cee8570d-03b3-4dc5-9d4c-a40b122cfa4b Jul 10 15:51:51 devstack sudo[91788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:51:52 devstack sudo[91788]: pam_unix(sudo:session): session closed for user root Jul 10 15:51:52 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6cae2fb3-220d-4f53-84f1-a516554cd913 tempest-GroupsTest-1548618761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-cee8570d-03b3-4dc5-9d4c-a40b122cfa4b" returned: 0 in 1.064s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:51:52 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6cae2fb3-220d-4f53-84f1-a516554cd913 tempest-GroupsTest-1548618761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-cee8570d-03b3-4dc5-9d4c-a40b122cfa4b {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:51:52 devstack sudo[91796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-cee8570d-03b3-4dc5-9d4c-a40b122cfa4b Jul 10 15:51:52 devstack sudo[91796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:51:53 devstack sudo[91796]: pam_unix(sudo:session): session closed for user root Jul 10 15:51:53 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6cae2fb3-220d-4f53-84f1-a516554cd913 tempest-GroupsTest-1548618761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-cee8570d-03b3-4dc5-9d4c-a40b122cfa4b" returned: 0 in 1.068s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:51:53 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-6cae2fb3-220d-4f53-84f1-a516554cd913 tempest-GroupsTest-1548618761 None] Lock "cinder-quobyte-cee8570d-03b3-4dc5-9d4c-a40b122cfa4b" released by "delete_volume" :: held 2.180s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:51:53 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-6cae2fb3-220d-4f53-84f1-a516554cd913 tempest-GroupsTest-1548618761 None] Created reservations ['02b29555-1818-4c62-b709-4001b8c994a3'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 15:51:53 devstack cinder-volume[87420]: WARNING cinder.quota [None req-6cae2fb3-220d-4f53-84f1-a516554cd913 tempest-GroupsTest-1548618761 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1752811308 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1752811308, it is now deprecated. Please use the default quota class for default quota. Jul 10 15:51:53 devstack cinder-volume[87420]: WARNING cinder.quota [None req-6cae2fb3-220d-4f53-84f1-a516554cd913 tempest-GroupsTest-1548618761 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1752811308 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1752811308, it is now deprecated. Please use the default quota class for default quota. Jul 10 15:51:53 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-6cae2fb3-220d-4f53-84f1-a516554cd913 tempest-GroupsTest-1548618761 None] Created reservations ['e468eff0-bb0d-4a17-a9b4-545a54e7cc63', 'b2f5667c-059a-4f3d-bd6b-41634737229b', '060e811b-4e39-4709-96b0-fd83ae70f1c1', 'a7f818a1-5d3e-4da8-be54-b1387923704f'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 15:51:53 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-6cae2fb3-220d-4f53-84f1-a516554cd913 tempest-GroupsTest-1548618761 None] Created reservations ['c2914d95-518f-460c-95d2-77b56af7ddb4', 'c283f36c-bba0-4e07-ae67-785eb2c092e9', 'b1b43647-43d4-40de-826a-b4f5caef7a7b', '0564746a-942c-461b-8f9c-94b02059fc9f'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 15:51:53 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-6cae2fb3-220d-4f53-84f1-a516554cd913 tempest-GroupsTest-1548618761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:51:53 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-6cae2fb3-220d-4f53-84f1-a516554cd913 tempest-GroupsTest-1548618761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:51:53 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-6cae2fb3-220d-4f53-84f1-a516554cd913 tempest-GroupsTest-1548618761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:51:53 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-6cae2fb3-220d-4f53-84f1-a516554cd913 tempest-GroupsTest-1548618761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:51:53 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-6cae2fb3-220d-4f53-84f1-a516554cd913 tempest-GroupsTest-1548618761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:51:53 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6cae2fb3-220d-4f53-84f1-a516554cd913 tempest-GroupsTest-1548618761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:51:53 devstack sudo[91823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 15:51:53 devstack sudo[91823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:51:54 devstack sudo[91823]: pam_unix(sudo:session): session closed for user root Jul 10 15:51:54 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6cae2fb3-220d-4f53-84f1-a516554cd913 tempest-GroupsTest-1548618761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.891s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:51:54 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-6cae2fb3-220d-4f53-84f1-a516554cd913 tempest-GroupsTest-1548618761 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 15:51:54 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-6cae2fb3-220d-4f53-84f1-a516554cd913 tempest-GroupsTest-1548618761 None] Delete group completed successfully. Jul 10 15:52:02 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-119126db-90ed-4416-b9f3-2a99b860a1ca tempest-GroupsV314Test-1609463789 None] Group tempest-GroupsV314Test-Group-1064227323: creating Jul 10 15:52:03 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-119126db-90ed-4416-b9f3-2a99b860a1ca tempest-GroupsV314Test-1609463789 None] Group tempest-GroupsV314Test-Group-1064227323: created successfully Jul 10 15:52:03 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-119126db-90ed-4416-b9f3-2a99b860a1ca tempest-GroupsV314Test-1609463789 None] Create group completed successfully. Jul 10 15:52:04 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a460d79-7e6d-4c59-9556-25f78fde66bf tempest-GroupsV314Test-1609463789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 15:52:04 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-4a460d79-7e6d-4c59-9556-25f78fde66bf tempest-GroupsV314Test-1609463789 None] Flow 'volume_create_manager' (0ef0b2fe-54a8-40b7-a5ab-ac5532963251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:52:04 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-4a460d79-7e6d-4c59-9556-25f78fde66bf tempest-GroupsV314Test-1609463789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfb50b7c-e4bf-46b8-9543-e0b9d18e6cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:52:04 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-4a460d79-7e6d-4c59-9556-25f78fde66bf tempest-GroupsV314Test-1609463789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfb50b7c-e4bf-46b8-9543-e0b9d18e6cd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:52:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-213338323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a5e2df2e-1fb0-4fc9-af4d-114a74ccb3e0,host='devstack@QuobyteHD#QuobyteHD',id=895188c1-5fef-49e9-9efd-71a7854a8f5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29e5b5f1d38e4e158d4989feb4bdaeda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:52:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:52:05Z,use_quota=True,user_id='7fe03bfad5b24bd8b488d5f2acf2e3d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4e6a13c-97d7-4b78-9bf1-138e7cc6108e),volume_type_id=e4e6a13c-97d7-4b78-9bf1-138e7cc6108e)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:52:04 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-4a460d79-7e6d-4c59-9556-25f78fde66bf tempest-GroupsV314Test-1609463789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13b25602-860d-48c0-8006-3a91dbbfd93d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:52:05 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-4a460d79-7e6d-4c59-9556-25f78fde66bf tempest-GroupsV314Test-1609463789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13b25602-860d-48c0-8006-3a91dbbfd93d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:52:05 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-4a460d79-7e6d-4c59-9556-25f78fde66bf tempest-GroupsV314Test-1609463789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52e8300a-d76e-44c5-9ed7-5279e772900c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:52:05 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-4a460d79-7e6d-4c59-9556-25f78fde66bf tempest-GroupsV314Test-1609463789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52e8300a-d76e-44c5-9ed7-5279e772900c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '895188c1-5fef-49e9-9efd-71a7854a8f5e', 'volume_name': 'volume-895188c1-5fef-49e9-9efd-71a7854a8f5e', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:52:05 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-4a460d79-7e6d-4c59-9556-25f78fde66bf tempest-GroupsV314Test-1609463789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea05816d-3876-4030-a7f1-4df806361c27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:52:05 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-4a460d79-7e6d-4c59-9556-25f78fde66bf tempest-GroupsV314Test-1609463789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea05816d-3876-4030-a7f1-4df806361c27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:52:05 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-4a460d79-7e6d-4c59-9556-25f78fde66bf tempest-GroupsV314Test-1609463789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb0ca31d-eda2-4c7a-8792-c07c1597ca4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:52:05 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-4a460d79-7e6d-4c59-9556-25f78fde66bf tempest-GroupsV314Test-1609463789 None] Volume 895188c1-5fef-49e9-9efd-71a7854a8f5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-895188c1-5fef-49e9-9efd-71a7854a8f5e', 'volume_size': 1} Jul 10 15:52:05 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-4a460d79-7e6d-4c59-9556-25f78fde66bf tempest-GroupsV314Test-1609463789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:52:05 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-4a460d79-7e6d-4c59-9556-25f78fde66bf tempest-GroupsV314Test-1609463789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:52:05 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-4a460d79-7e6d-4c59-9556-25f78fde66bf tempest-GroupsV314Test-1609463789 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a5e2df2e-1fb0-4fc9-af4d-114a74ccb3e0,created_at=2026-07-10T13:52:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-213338323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a5e2df2e-1fb0-4fc9-af4d-114a74ccb3e0,host='devstack@QuobyteHD#QuobyteHD',id=895188c1-5fef-49e9-9efd-71a7854a8f5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29e5b5f1d38e4e158d4989feb4bdaeda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:52:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:52:05Z,use_quota=True,user_id='7fe03bfad5b24bd8b488d5f2acf2e3d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4e6a13c-97d7-4b78-9bf1-138e7cc6108e),volume_type_id=e4e6a13c-97d7-4b78-9bf1-138e7cc6108e)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 15:52:05 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-4a460d79-7e6d-4c59-9556-25f78fde66bf tempest-GroupsV314Test-1609463789 None] Creating volume 895188c1-5fef-49e9-9efd-71a7854a8f5e {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 15:52:05 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-4a460d79-7e6d-4c59-9556-25f78fde66bf tempest-GroupsV314Test-1609463789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:52:05 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-4a460d79-7e6d-4c59-9556-25f78fde66bf tempest-GroupsV314Test-1609463789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:52:05 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-4a460d79-7e6d-4c59-9556-25f78fde66bf tempest-GroupsV314Test-1609463789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:52:05 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-4a460d79-7e6d-4c59-9556-25f78fde66bf tempest-GroupsV314Test-1609463789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:52:05 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-4a460d79-7e6d-4c59-9556-25f78fde66bf tempest-GroupsV314Test-1609463789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:52:05 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-4a460d79-7e6d-4c59-9556-25f78fde66bf tempest-GroupsV314Test-1609463789 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 15:52:05 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-4a460d79-7e6d-4c59-9556-25f78fde66bf tempest-GroupsV314Test-1609463789 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 15:52:05 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4a460d79-7e6d-4c59-9556-25f78fde66bf tempest-GroupsV314Test-1609463789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-895188c1-5fef-49e9-9efd-71a7854a8f5e 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:52:05 devstack sudo[91889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-895188c1-5fef-49e9-9efd-71a7854a8f5e 1073741824 Jul 10 15:52:05 devstack sudo[91889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:52:06 devstack sudo[91889]: pam_unix(sudo:session): session closed for user root Jul 10 15:52:06 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4a460d79-7e6d-4c59-9556-25f78fde66bf tempest-GroupsV314Test-1609463789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-895188c1-5fef-49e9-9efd-71a7854a8f5e 1073741824" returned: 0 in 1.205s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:52:06 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4a460d79-7e6d-4c59-9556-25f78fde66bf tempest-GroupsV314Test-1609463789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-895188c1-5fef-49e9-9efd-71a7854a8f5e {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:52:06 devstack sudo[91895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-895188c1-5fef-49e9-9efd-71a7854a8f5e Jul 10 15:52:06 devstack sudo[91895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:52:07 devstack sudo[91895]: pam_unix(sudo:session): session closed for user root Jul 10 15:52:07 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4a460d79-7e6d-4c59-9556-25f78fde66bf tempest-GroupsV314Test-1609463789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-895188c1-5fef-49e9-9efd-71a7854a8f5e" returned: 0 in 0.962s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:52:07 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-4a460d79-7e6d-4c59-9556-25f78fde66bf tempest-GroupsV314Test-1609463789 None] <== create_volume: return (2240ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 15:52:07 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-4a460d79-7e6d-4c59-9556-25f78fde66bf tempest-GroupsV314Test-1609463789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.244s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:52:07 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-4a460d79-7e6d-4c59-9556-25f78fde66bf tempest-GroupsV314Test-1609463789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb0ca31d-eda2-4c7a-8792-c07c1597ca4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-895188c1-5fef-49e9-9efd-71a7854a8f5e', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:52:07 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-4a460d79-7e6d-4c59-9556-25f78fde66bf tempest-GroupsV314Test-1609463789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (223251d3-657d-4d8a-8647-9da4b0539323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:52:07 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-4a460d79-7e6d-4c59-9556-25f78fde66bf tempest-GroupsV314Test-1609463789 None] Volume volume-895188c1-5fef-49e9-9efd-71a7854a8f5e (895188c1-5fef-49e9-9efd-71a7854a8f5e): created successfully Jul 10 15:52:07 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-4a460d79-7e6d-4c59-9556-25f78fde66bf tempest-GroupsV314Test-1609463789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (223251d3-657d-4d8a-8647-9da4b0539323) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:52:07 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-4a460d79-7e6d-4c59-9556-25f78fde66bf tempest-GroupsV314Test-1609463789 None] Flow 'volume_create_manager' (0ef0b2fe-54a8-40b7-a5ab-ac5532963251) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:52:07 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-4a460d79-7e6d-4c59-9556-25f78fde66bf tempest-GroupsV314Test-1609463789 None] Created volume successfully. Jul 10 15:52:10 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-a07c321e-a0d8-4082-b6c7-1633cc1886ef tempest-GroupsV314Test-1609463789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:52:10 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-a07c321e-a0d8-4082-b6c7-1633cc1886ef tempest-GroupsV314Test-1609463789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:52:10 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-a07c321e-a0d8-4082-b6c7-1633cc1886ef tempest-GroupsV314Test-1609463789 None] Cloning volume 895188c1-5fef-49e9-9efd-71a7854a8f5e to volume 34c9f9d0-fff2-4f52-b003-22ce451d5e05 Jul 10 15:52:10 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-a07c321e-a0d8-4082-b6c7-1633cc1886ef tempest-GroupsV314Test-1609463789 None] Creating offline snapshot 95525ab1-20d4-4224-96a2-a47fe895f731 of volume 895188c1-5fef-49e9-9efd-71a7854a8f5e {{(pid=87420) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 15:52:10 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b6d6226-a043-4fc5-81cf-1e46df5b881a]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:52:10 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a07c321e-a0d8-4082-b6c7-1633cc1886ef tempest-GroupsV314Test-1609463789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-895188c1-5fef-49e9-9efd-71a7854a8f5e {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:52:10 devstack sudo[91987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-895188c1-5fef-49e9-9efd-71a7854a8f5e Jul 10 15:52:10 devstack sudo[91987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:52:11 devstack sudo[91987]: pam_unix(sudo:session): session closed for user root Jul 10 15:52:11 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a07c321e-a0d8-4082-b6c7-1633cc1886ef tempest-GroupsV314Test-1609463789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-895188c1-5fef-49e9-9efd-71a7854a8f5e" returned: 0 in 1.169s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:52:11 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a07c321e-a0d8-4082-b6c7-1633cc1886ef tempest-GroupsV314Test-1609463789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-895188c1-5fef-49e9-9efd-71a7854a8f5e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-895188c1-5fef-49e9-9efd-71a7854a8f5e.95525ab1-20d4-4224-96a2-a47fe895f731 1G {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:52:11 devstack sudo[91992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-895188c1-5fef-49e9-9efd-71a7854a8f5e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-895188c1-5fef-49e9-9efd-71a7854a8f5e.95525ab1-20d4-4224-96a2-a47fe895f731 1G Jul 10 15:52:11 devstack sudo[91992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:52:12 devstack sudo[91992]: pam_unix(sudo:session): session closed for user root Jul 10 15:52:12 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a07c321e-a0d8-4082-b6c7-1633cc1886ef tempest-GroupsV314Test-1609463789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-895188c1-5fef-49e9-9efd-71a7854a8f5e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-895188c1-5fef-49e9-9efd-71a7854a8f5e.95525ab1-20d4-4224-96a2-a47fe895f731 1G" returned: 0 in 1.233s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:52:12 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a07c321e-a0d8-4082-b6c7-1633cc1886ef tempest-GroupsV314Test-1609463789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-895188c1-5fef-49e9-9efd-71a7854a8f5e -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-895188c1-5fef-49e9-9efd-71a7854a8f5e.95525ab1-20d4-4224-96a2-a47fe895f731 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:52:12 devstack sudo[91998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-895188c1-5fef-49e9-9efd-71a7854a8f5e -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-895188c1-5fef-49e9-9efd-71a7854a8f5e.95525ab1-20d4-4224-96a2-a47fe895f731 Jul 10 15:52:12 devstack sudo[91998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:52:13 devstack sudo[91998]: pam_unix(sudo:session): session closed for user root Jul 10 15:52:13 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a07c321e-a0d8-4082-b6c7-1633cc1886ef tempest-GroupsV314Test-1609463789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-895188c1-5fef-49e9-9efd-71a7854a8f5e -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-895188c1-5fef-49e9-9efd-71a7854a8f5e.95525ab1-20d4-4224-96a2-a47fe895f731" returned: 0 in 0.941s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:52:13 devstack cinder-volume[87420]: WARNING cinder.volume.drivers.remotefs [None req-a07c321e-a0d8-4082-b6c7-1633cc1886ef tempest-GroupsV314Test-1609463789 None] /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-895188c1-5fef-49e9-9efd-71a7854a8f5e.95525ab1-20d4-4224-96a2-a47fe895f731 is being set with open permissions: ugo+rw: NotImplementedError Jul 10 15:52:13 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a07c321e-a0d8-4082-b6c7-1633cc1886ef tempest-GroupsV314Test-1609463789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-895188c1-5fef-49e9-9efd-71a7854a8f5e.95525ab1-20d4-4224-96a2-a47fe895f731 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:52:13 devstack sudo[92004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-895188c1-5fef-49e9-9efd-71a7854a8f5e.95525ab1-20d4-4224-96a2-a47fe895f731 Jul 10 15:52:13 devstack sudo[92004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:52:14 devstack sudo[92004]: pam_unix(sudo:session): session closed for user root Jul 10 15:52:14 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a07c321e-a0d8-4082-b6c7-1633cc1886ef tempest-GroupsV314Test-1609463789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-895188c1-5fef-49e9-9efd-71a7854a8f5e.95525ab1-20d4-4224-96a2-a47fe895f731" returned: 0 in 1.040s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:52:14 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a07c321e-a0d8-4082-b6c7-1633cc1886ef tempest-GroupsV314Test-1609463789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-895188c1-5fef-49e9-9efd-71a7854a8f5e.info {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:52:14 devstack sudo[92010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-895188c1-5fef-49e9-9efd-71a7854a8f5e.info Jul 10 15:52:14 devstack sudo[92010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:52:15 devstack sudo[92010]: pam_unix(sudo:session): session closed for user root Jul 10 15:52:15 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a07c321e-a0d8-4082-b6c7-1633cc1886ef tempest-GroupsV314Test-1609463789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-895188c1-5fef-49e9-9efd-71a7854a8f5e.info" returned: 0 in 1.180s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:52:15 devstack cinder-volume[87420]: WARNING cinder.volume.drivers.remotefs [None req-a07c321e-a0d8-4082-b6c7-1633cc1886ef tempest-GroupsV314Test-1609463789 None] /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-895188c1-5fef-49e9-9efd-71a7854a8f5e.info is being set with open permissions: ugo+rw: NotImplementedError Jul 10 15:52:15 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a07c321e-a0d8-4082-b6c7-1633cc1886ef tempest-GroupsV314Test-1609463789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-895188c1-5fef-49e9-9efd-71a7854a8f5e.info {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:52:15 devstack sudo[92013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-895188c1-5fef-49e9-9efd-71a7854a8f5e.info Jul 10 15:52:15 devstack sudo[92013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:52:16 devstack sudo[92013]: pam_unix(sudo:session): session closed for user root Jul 10 15:52:16 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a07c321e-a0d8-4082-b6c7-1633cc1886ef tempest-GroupsV314Test-1609463789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-895188c1-5fef-49e9-9efd-71a7854a8f5e.info" returned: 0 in 0.730s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:52:16 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-a07c321e-a0d8-4082-b6c7-1633cc1886ef tempest-GroupsV314Test-1609463789 None] Acquiring lock "cinder-quobyte-34c9f9d0-fff2-4f52-b003-22ce451d5e05" by "_copy_volume_from_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:52:16 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-a07c321e-a0d8-4082-b6c7-1633cc1886ef tempest-GroupsV314Test-1609463789 None] Lock "cinder-quobyte-34c9f9d0-fff2-4f52-b003-22ce451d5e05" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:52:16 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-a07c321e-a0d8-4082-b6c7-1633cc1886ef tempest-GroupsV314Test-1609463789 None] snapshot: 95525ab1-20d4-4224-96a2-a47fe895f731, volume: 34c9f9d0-fff2-4f52-b003-22ce451d5e05, {{(pid=87420) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 15:52:16 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-a07c321e-a0d8-4082-b6c7-1633cc1886ef tempest-GroupsV314Test-1609463789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:52:16 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-a07c321e-a0d8-4082-b6c7-1633cc1886ef tempest-GroupsV314Test-1609463789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:52:16 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-a07c321e-a0d8-4082-b6c7-1633cc1886ef tempest-GroupsV314Test-1609463789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:52:16 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-a07c321e-a0d8-4082-b6c7-1633cc1886ef tempest-GroupsV314Test-1609463789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:52:16 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-a07c321e-a0d8-4082-b6c7-1633cc1886ef tempest-GroupsV314Test-1609463789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:52:16 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[1185a30b-8d90-4e4e-857a-b668c834295a]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:52:16 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a07c321e-a0d8-4082-b6c7-1633cc1886ef tempest-GroupsV314Test-1609463789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-895188c1-5fef-49e9-9efd-71a7854a8f5e.95525ab1-20d4-4224-96a2-a47fe895f731 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:52:16 devstack sudo[92016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-895188c1-5fef-49e9-9efd-71a7854a8f5e.95525ab1-20d4-4224-96a2-a47fe895f731 Jul 10 15:52:16 devstack sudo[92016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:52:17 devstack cinder-volume[87420]: DEBUG oslo_service.periodic_task [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87420) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 15:52:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:52:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:52:17 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:52:17 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:52:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:52:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:52:17 devstack sudo[92018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 15:52:17 devstack sudo[92018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:52:17 devstack sudo[92016]: pam_unix(sudo:session): session closed for user root Jul 10 15:52:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a07c321e-a0d8-4082-b6c7-1633cc1886ef tempest-GroupsV314Test-1609463789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-895188c1-5fef-49e9-9efd-71a7854a8f5e.95525ab1-20d4-4224-96a2-a47fe895f731" returned: 0 in 1.060s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:52:17 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-a07c321e-a0d8-4082-b6c7-1633cc1886ef tempest-GroupsV314Test-1609463789 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-895188c1-5fef-49e9-9efd-71a7854a8f5e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87420) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 15:52:17 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-a07c321e-a0d8-4082-b6c7-1633cc1886ef tempest-GroupsV314Test-1609463789 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-895188c1-5fef-49e9-9efd-71a7854a8f5e {{(pid=87420) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 15:52:17 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-a07c321e-a0d8-4082-b6c7-1633cc1886ef tempest-GroupsV314Test-1609463789 None] Creating direct copy from snapshot {{(pid=87420) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 15:52:17 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aeeef4a-96d2-4bad-8f9d-542d5b6052ea]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:52:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a07c321e-a0d8-4082-b6c7-1633cc1886ef tempest-GroupsV314Test-1609463789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-895188c1-5fef-49e9-9efd-71a7854a8f5e {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:52:17 devstack sudo[92026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-895188c1-5fef-49e9-9efd-71a7854a8f5e Jul 10 15:52:17 devstack sudo[92026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:52:18 devstack sudo[92018]: pam_unix(sudo:session): session closed for user root Jul 10 15:52:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.964s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:52:18 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 15:52:18 devstack cinder-volume[87420]: DEBUG oslo_service.periodic_task [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Running periodic task VolumeManager._thread_info {{(pid=87420) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 15:52:18 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] thread count: 8 {{(pid=87420) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 15:52:18 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] thread info: [<_MainThread(MainThread, started 133639250378880)>, , , , , , , ] {{(pid=87420) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 15:52:18 devstack sudo[92026]: pam_unix(sudo:session): session closed for user root Jul 10 15:52:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a07c321e-a0d8-4082-b6c7-1633cc1886ef tempest-GroupsV314Test-1609463789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-895188c1-5fef-49e9-9efd-71a7854a8f5e" returned: 0 in 1.084s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:52:18 devstack cinder-volume[87420]: DEBUG cinder.utils [None req-a07c321e-a0d8-4082-b6c7-1633cc1886ef tempest-GroupsV314Test-1609463789 None] Path /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-34c9f9d0-fff2-4f52-b003-22ce451d5e05 not found in is_blk_device check {{(pid=87420) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 15:52:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a07c321e-a0d8-4082-b6c7-1633cc1886ef tempest-GroupsV314Test-1609463789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-895188c1-5fef-49e9-9efd-71a7854a8f5e /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-34c9f9d0-fff2-4f52-b003-22ce451d5e05 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:52:18 devstack sudo[92047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-895188c1-5fef-49e9-9efd-71a7854a8f5e /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-34c9f9d0-fff2-4f52-b003-22ce451d5e05 Jul 10 15:52:18 devstack sudo[92047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:52:24 devstack cinder-volume[87420]: DEBUG dbcounter [-] [87420] Writing DB stats cinder:UPDATE=42,cinder:DELETE=2,cinder:SELECT=33,cinder:INSERT=9 {{(pid=87420) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 15:52:24 devstack cinder-volume[87420]: DEBUG dbcounter [-] [87420] Writing DB stats cinder:UPDATE=31,cinder:SELECT=31,cinder:DELETE=2,cinder:INSERT=8 {{(pid=87420) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 15:52:26 devstack sudo[92047]: pam_unix(sudo:session): session closed for user root Jul 10 15:52:26 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a07c321e-a0d8-4082-b6c7-1633cc1886ef tempest-GroupsV314Test-1609463789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-895188c1-5fef-49e9-9efd-71a7854a8f5e /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-34c9f9d0-fff2-4f52-b003-22ce451d5e05" returned: 0 in 7.303s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:52:26 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e311fdf-bfc5-483b-80c0-fb5c7e9f822a]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:52:26 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a07c321e-a0d8-4082-b6c7-1633cc1886ef tempest-GroupsV314Test-1609463789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-895188c1-5fef-49e9-9efd-71a7854a8f5e {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:52:26 devstack sudo[92124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-895188c1-5fef-49e9-9efd-71a7854a8f5e Jul 10 15:52:26 devstack sudo[92124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:52:27 devstack sudo[92124]: pam_unix(sudo:session): session closed for user root Jul 10 15:52:27 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a07c321e-a0d8-4082-b6c7-1633cc1886ef tempest-GroupsV314Test-1609463789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-895188c1-5fef-49e9-9efd-71a7854a8f5e" returned: 0 in 1.364s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:52:27 devstack cinder-volume[87420]: DEBUG cinder.image.image_utils [None req-a07c321e-a0d8-4082-b6c7-1633cc1886ef tempest-GroupsV314Test-1609463789 None] Image conversion details: src /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-895188c1-5fef-49e9-9efd-71a7854a8f5e, size 1024.00 MB, duration 7.30 sec, destination /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-34c9f9d0-fff2-4f52-b003-22ce451d5e05 {{(pid=87420) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 15:52:27 devstack cinder-volume[87420]: INFO cinder.image.image_utils [None req-a07c321e-a0d8-4082-b6c7-1633cc1886ef tempest-GroupsV314Test-1609463789 None] Converted 1024.00 MB image at 140.19 MB/s Jul 10 15:52:27 devstack cinder-volume[87420]: WARNING cinder.volume.drivers.remotefs [None req-a07c321e-a0d8-4082-b6c7-1633cc1886ef tempest-GroupsV314Test-1609463789 None] /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-34c9f9d0-fff2-4f52-b003-22ce451d5e05 is being set with open permissions: ugo+rw: NotImplementedError Jul 10 15:52:27 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a07c321e-a0d8-4082-b6c7-1633cc1886ef tempest-GroupsV314Test-1609463789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-34c9f9d0-fff2-4f52-b003-22ce451d5e05 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:52:27 devstack sudo[92172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-34c9f9d0-fff2-4f52-b003-22ce451d5e05 Jul 10 15:52:27 devstack sudo[92172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:52:28 devstack sudo[92172]: pam_unix(sudo:session): session closed for user root Jul 10 15:52:28 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a07c321e-a0d8-4082-b6c7-1633cc1886ef tempest-GroupsV314Test-1609463789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-34c9f9d0-fff2-4f52-b003-22ce451d5e05" returned: 0 in 0.651s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:52:28 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-a07c321e-a0d8-4082-b6c7-1633cc1886ef tempest-GroupsV314Test-1609463789 None] Lock "cinder-quobyte-34c9f9d0-fff2-4f52-b003-22ce451d5e05" released by "_copy_volume_from_snapshot" :: held 11.580s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:52:28 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-a07c321e-a0d8-4082-b6c7-1633cc1886ef tempest-GroupsV314Test-1609463789 None] Acquiring lock "cinder-quobyte-95525ab1-20d4-4224-96a2-a47fe895f731" by "_delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:52:28 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-a07c321e-a0d8-4082-b6c7-1633cc1886ef tempest-GroupsV314Test-1609463789 None] Lock "cinder-quobyte-95525ab1-20d4-4224-96a2-a47fe895f731" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:52:28 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-a07c321e-a0d8-4082-b6c7-1633cc1886ef tempest-GroupsV314Test-1609463789 None] Deleting offline snapshot 95525ab1-20d4-4224-96a2-a47fe895f731 of volume 895188c1-5fef-49e9-9efd-71a7854a8f5e {{(pid=87420) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 15:52:28 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-a07c321e-a0d8-4082-b6c7-1633cc1886ef tempest-GroupsV314Test-1609463789 None] snapshot_file for this snap is: volume-895188c1-5fef-49e9-9efd-71a7854a8f5e.95525ab1-20d4-4224-96a2-a47fe895f731 {{(pid=87420) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 15:52:28 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[95fb9a0b-e594-4e61-8733-ebbb2bcf4bbd]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:52:28 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a07c321e-a0d8-4082-b6c7-1633cc1886ef tempest-GroupsV314Test-1609463789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-895188c1-5fef-49e9-9efd-71a7854a8f5e.95525ab1-20d4-4224-96a2-a47fe895f731 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:52:28 devstack sudo[92176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-895188c1-5fef-49e9-9efd-71a7854a8f5e.95525ab1-20d4-4224-96a2-a47fe895f731 Jul 10 15:52:28 devstack sudo[92176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:52:28 devstack sudo[92176]: pam_unix(sudo:session): session closed for user root Jul 10 15:52:29 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a07c321e-a0d8-4082-b6c7-1633cc1886ef tempest-GroupsV314Test-1609463789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-895188c1-5fef-49e9-9efd-71a7854a8f5e.95525ab1-20d4-4224-96a2-a47fe895f731" returned: 0 in 0.756s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:52:29 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-a07c321e-a0d8-4082-b6c7-1633cc1886ef tempest-GroupsV314Test-1609463789 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-895188c1-5fef-49e9-9efd-71a7854a8f5e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87420) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 15:52:29 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[adc24238-1b43-4cb7-b81e-7ca540fc90fc]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:52:29 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a07c321e-a0d8-4082-b6c7-1633cc1886ef tempest-GroupsV314Test-1609463789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-895188c1-5fef-49e9-9efd-71a7854a8f5e {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:52:29 devstack sudo[92181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-895188c1-5fef-49e9-9efd-71a7854a8f5e Jul 10 15:52:29 devstack sudo[92181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:52:29 devstack sudo[92181]: pam_unix(sudo:session): session closed for user root Jul 10 15:52:29 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a07c321e-a0d8-4082-b6c7-1633cc1886ef tempest-GroupsV314Test-1609463789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-895188c1-5fef-49e9-9efd-71a7854a8f5e" returned: 0 in 0.823s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:52:29 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a07c321e-a0d8-4082-b6c7-1633cc1886ef tempest-GroupsV314Test-1609463789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-895188c1-5fef-49e9-9efd-71a7854a8f5e.95525ab1-20d4-4224-96a2-a47fe895f731 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:52:29 devstack sudo[92186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-895188c1-5fef-49e9-9efd-71a7854a8f5e.95525ab1-20d4-4224-96a2-a47fe895f731 Jul 10 15:52:29 devstack sudo[92186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:52:30 devstack sudo[92186]: pam_unix(sudo:session): session closed for user root Jul 10 15:52:30 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a07c321e-a0d8-4082-b6c7-1633cc1886ef tempest-GroupsV314Test-1609463789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-895188c1-5fef-49e9-9efd-71a7854a8f5e.95525ab1-20d4-4224-96a2-a47fe895f731" returned: 0 in 1.085s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:52:30 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a07c321e-a0d8-4082-b6c7-1633cc1886ef tempest-GroupsV314Test-1609463789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-895188c1-5fef-49e9-9efd-71a7854a8f5e.95525ab1-20d4-4224-96a2-a47fe895f731 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:52:30 devstack sudo[92224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-895188c1-5fef-49e9-9efd-71a7854a8f5e.95525ab1-20d4-4224-96a2-a47fe895f731 Jul 10 15:52:30 devstack sudo[92224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:52:32 devstack sudo[92224]: pam_unix(sudo:session): session closed for user root Jul 10 15:52:32 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a07c321e-a0d8-4082-b6c7-1633cc1886ef tempest-GroupsV314Test-1609463789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-895188c1-5fef-49e9-9efd-71a7854a8f5e.95525ab1-20d4-4224-96a2-a47fe895f731" returned: 0 in 1.112s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:52:32 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-a07c321e-a0d8-4082-b6c7-1633cc1886ef tempest-GroupsV314Test-1609463789 None] Lock "cinder-quobyte-95525ab1-20d4-4224-96a2-a47fe895f731" released by "_delete_snapshot" :: held 3.884s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:52:32 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-a07c321e-a0d8-4082-b6c7-1633cc1886ef tempest-GroupsV314Test-1609463789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 22.014s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:52:32 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-a07c321e-a0d8-4082-b6c7-1633cc1886ef tempest-GroupsV314Test-1609463789 None] Create group from source-group-a5e2df2e-1fb0-4fc9-af4d-114a74ccb3e0 completed successfully. Jul 10 15:52:33 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-09809343-4c0c-44a2-9aa1-6838eb0998cb tempest-GroupsV314Test-1609463789 None] Acquiring lock "cinder-quobyte-34c9f9d0-fff2-4f52-b003-22ce451d5e05" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:52:33 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-09809343-4c0c-44a2-9aa1-6838eb0998cb tempest-GroupsV314Test-1609463789 None] Lock "cinder-quobyte-34c9f9d0-fff2-4f52-b003-22ce451d5e05" acquired by "delete_volume" :: waited 0.029s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:52:33 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5ed0cb0-3781-4a96-84a7-81023e823af0]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:52:33 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-09809343-4c0c-44a2-9aa1-6838eb0998cb tempest-GroupsV314Test-1609463789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-34c9f9d0-fff2-4f52-b003-22ce451d5e05 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:52:33 devstack sudo[92263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-34c9f9d0-fff2-4f52-b003-22ce451d5e05 Jul 10 15:52:33 devstack sudo[92263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:52:34 devstack sudo[92263]: pam_unix(sudo:session): session closed for user root Jul 10 15:52:34 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-09809343-4c0c-44a2-9aa1-6838eb0998cb tempest-GroupsV314Test-1609463789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-34c9f9d0-fff2-4f52-b003-22ce451d5e05" returned: 0 in 0.966s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:52:34 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-09809343-4c0c-44a2-9aa1-6838eb0998cb tempest-GroupsV314Test-1609463789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-34c9f9d0-fff2-4f52-b003-22ce451d5e05 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:52:34 devstack sudo[92273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-34c9f9d0-fff2-4f52-b003-22ce451d5e05 Jul 10 15:52:34 devstack sudo[92273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:52:35 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7ab3cbb-8bfa-46b1-84b7-41c5b39f3f36 tempest-ServerActionsTestOtherA-1627818978 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 15:52:35 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f7ab3cbb-8bfa-46b1-84b7-41c5b39f3f36 tempest-ServerActionsTestOtherA-1627818978 None] Flow 'volume_create_manager' (7445295a-a8f0-460a-8a6d-4cef83362065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:52:35 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f7ab3cbb-8bfa-46b1-84b7-41c5b39f3f36 tempest-ServerActionsTestOtherA-1627818978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ed836c9-3688-45d3-b834-562d6bcc5c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:52:35 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f7ab3cbb-8bfa-46b1-84b7-41c5b39f3f36 tempest-ServerActionsTestOtherA-1627818978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ed836c9-3688-45d3-b834-562d6bcc5c45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:52:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-227409640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3282387e-9817-4aa9-9920-a817fca74afa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c152475b87646bbb49f9f3829922944',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:52:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:52:35Z,use_quota=True,user_id='62ada516d55a4582b7e96a0cec7296d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:52:35 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f7ab3cbb-8bfa-46b1-84b7-41c5b39f3f36 tempest-ServerActionsTestOtherA-1627818978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (926a73aa-af18-4e26-8eb9-df24eb1fcabb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:52:35 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f7ab3cbb-8bfa-46b1-84b7-41c5b39f3f36 tempest-ServerActionsTestOtherA-1627818978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (926a73aa-af18-4e26-8eb9-df24eb1fcabb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:52:35 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f7ab3cbb-8bfa-46b1-84b7-41c5b39f3f36 tempest-ServerActionsTestOtherA-1627818978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd3f5c43-dd7d-4c1d-9d55-993f73aa8d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:52:35 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f7ab3cbb-8bfa-46b1-84b7-41c5b39f3f36 tempest-ServerActionsTestOtherA-1627818978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd3f5c43-dd7d-4c1d-9d55-993f73aa8d64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3282387e-9817-4aa9-9920-a817fca74afa', 'volume_name': 'volume-3282387e-9817-4aa9-9920-a817fca74afa', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:52:35 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f7ab3cbb-8bfa-46b1-84b7-41c5b39f3f36 tempest-ServerActionsTestOtherA-1627818978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f96fe4c-328f-4d70-b5ff-32b34210d46b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:52:35 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f7ab3cbb-8bfa-46b1-84b7-41c5b39f3f36 tempest-ServerActionsTestOtherA-1627818978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f96fe4c-328f-4d70-b5ff-32b34210d46b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:52:35 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f7ab3cbb-8bfa-46b1-84b7-41c5b39f3f36 tempest-ServerActionsTestOtherA-1627818978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a6ba968-7ef0-4af2-94eb-55f7e010ab82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:52:35 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-f7ab3cbb-8bfa-46b1-84b7-41c5b39f3f36 tempest-ServerActionsTestOtherA-1627818978 None] Volume 3282387e-9817-4aa9-9920-a817fca74afa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3282387e-9817-4aa9-9920-a817fca74afa', 'volume_size': 1} Jul 10 15:52:35 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-f7ab3cbb-8bfa-46b1-84b7-41c5b39f3f36 tempest-ServerActionsTestOtherA-1627818978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:52:35 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-f7ab3cbb-8bfa-46b1-84b7-41c5b39f3f36 tempest-ServerActionsTestOtherA-1627818978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:52:35 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-f7ab3cbb-8bfa-46b1-84b7-41c5b39f3f36 tempest-ServerActionsTestOtherA-1627818978 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:52:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-227409640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3282387e-9817-4aa9-9920-a817fca74afa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c152475b87646bbb49f9f3829922944',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:52:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:52:35Z,use_quota=True,user_id='62ada516d55a4582b7e96a0cec7296d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 15:52:35 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-f7ab3cbb-8bfa-46b1-84b7-41c5b39f3f36 tempest-ServerActionsTestOtherA-1627818978 None] Creating volume 3282387e-9817-4aa9-9920-a817fca74afa {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 15:52:35 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-f7ab3cbb-8bfa-46b1-84b7-41c5b39f3f36 tempest-ServerActionsTestOtherA-1627818978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:52:35 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-f7ab3cbb-8bfa-46b1-84b7-41c5b39f3f36 tempest-ServerActionsTestOtherA-1627818978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:52:35 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-f7ab3cbb-8bfa-46b1-84b7-41c5b39f3f36 tempest-ServerActionsTestOtherA-1627818978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:52:35 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-f7ab3cbb-8bfa-46b1-84b7-41c5b39f3f36 tempest-ServerActionsTestOtherA-1627818978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:52:35 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-f7ab3cbb-8bfa-46b1-84b7-41c5b39f3f36 tempest-ServerActionsTestOtherA-1627818978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:52:35 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-f7ab3cbb-8bfa-46b1-84b7-41c5b39f3f36 tempest-ServerActionsTestOtherA-1627818978 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 15:52:35 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-f7ab3cbb-8bfa-46b1-84b7-41c5b39f3f36 tempest-ServerActionsTestOtherA-1627818978 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 15:52:35 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f7ab3cbb-8bfa-46b1-84b7-41c5b39f3f36 tempest-ServerActionsTestOtherA-1627818978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3282387e-9817-4aa9-9920-a817fca74afa 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:52:35 devstack sudo[92278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3282387e-9817-4aa9-9920-a817fca74afa 1073741824 Jul 10 15:52:35 devstack sudo[92278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:52:35 devstack sudo[92273]: pam_unix(sudo:session): session closed for user root Jul 10 15:52:35 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-09809343-4c0c-44a2-9aa1-6838eb0998cb tempest-GroupsV314Test-1609463789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-34c9f9d0-fff2-4f52-b003-22ce451d5e05" returned: 0 in 1.305s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:52:35 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-09809343-4c0c-44a2-9aa1-6838eb0998cb tempest-GroupsV314Test-1609463789 None] Lock "cinder-quobyte-34c9f9d0-fff2-4f52-b003-22ce451d5e05" released by "delete_volume" :: held 2.389s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:52:35 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-09809343-4c0c-44a2-9aa1-6838eb0998cb tempest-GroupsV314Test-1609463789 None] Created reservations ['fce95af0-10a5-4e3a-b8ae-8dc32a9826c8'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 15:52:35 devstack cinder-volume[87420]: WARNING cinder.quota [None req-09809343-4c0c-44a2-9aa1-6838eb0998cb tempest-GroupsV314Test-1609463789 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1691949690 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1691949690, it is now deprecated. Please use the default quota class for default quota. Jul 10 15:52:35 devstack cinder-volume[87420]: WARNING cinder.quota [None req-09809343-4c0c-44a2-9aa1-6838eb0998cb tempest-GroupsV314Test-1609463789 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1691949690 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1691949690, it is now deprecated. Please use the default quota class for default quota. Jul 10 15:52:36 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-09809343-4c0c-44a2-9aa1-6838eb0998cb tempest-GroupsV314Test-1609463789 None] Created reservations ['802632f9-3d1d-44ee-9b9a-80a9143629ab', '59f4aac7-f580-4589-9200-70fd72aa3d8e', 'db5b244c-2b05-4431-aad9-09884e61f173', 'b869bdbd-403e-47a2-abcd-ebd647837d00'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 15:52:36 devstack cinder-volume[87420]: INFO cinder.volume.manager [req-9ecf1c74-165b-4a7a-9cbe-7475b23a03c9 req-62e57318-5f98-47aa-aa4b-415012dc4d75 tempest-AttachVolumeNegativeTest-1493731096 None] Terminate volume connection completed successfully. Jul 10 15:52:36 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [req-9ecf1c74-165b-4a7a-9cbe-7475b23a03c9 req-62e57318-5f98-47aa-aa4b-415012dc4d75 tempest-AttachVolumeNegativeTest-1493731096 None] Deleting attachment 5035941a-c725-4ab4-a326-59e493655b86. {{(pid=87420) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 15:52:36 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-09809343-4c0c-44a2-9aa1-6838eb0998cb tempest-GroupsV314Test-1609463789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:52:36 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-09809343-4c0c-44a2-9aa1-6838eb0998cb tempest-GroupsV314Test-1609463789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:52:36 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-09809343-4c0c-44a2-9aa1-6838eb0998cb tempest-GroupsV314Test-1609463789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:52:36 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-09809343-4c0c-44a2-9aa1-6838eb0998cb tempest-GroupsV314Test-1609463789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:52:36 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-09809343-4c0c-44a2-9aa1-6838eb0998cb tempest-GroupsV314Test-1609463789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:52:36 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-09809343-4c0c-44a2-9aa1-6838eb0998cb tempest-GroupsV314Test-1609463789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:52:36 devstack sudo[92285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 15:52:36 devstack sudo[92285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:52:37 devstack sudo[92278]: pam_unix(sudo:session): session closed for user root Jul 10 15:52:37 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f7ab3cbb-8bfa-46b1-84b7-41c5b39f3f36 tempest-ServerActionsTestOtherA-1627818978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3282387e-9817-4aa9-9920-a817fca74afa 1073741824" returned: 0 in 1.779s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:52:37 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f7ab3cbb-8bfa-46b1-84b7-41c5b39f3f36 tempest-ServerActionsTestOtherA-1627818978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3282387e-9817-4aa9-9920-a817fca74afa {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:52:37 devstack sudo[92289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3282387e-9817-4aa9-9920-a817fca74afa Jul 10 15:52:37 devstack sudo[92289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:52:37 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-c43ba53f-8486-44f1-a7ce-eef4096e2030 tempest-GroupsV314Test-1609463789 None] Acquiring lock "cinder-quobyte-895188c1-5fef-49e9-9efd-71a7854a8f5e" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:52:37 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-c43ba53f-8486-44f1-a7ce-eef4096e2030 tempest-GroupsV314Test-1609463789 None] Lock "cinder-quobyte-895188c1-5fef-49e9-9efd-71a7854a8f5e" acquired by "delete_volume" :: waited 0.054s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:52:37 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fcd9da4-d26e-40c5-b5b7-41bf277e4323]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:52:37 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c43ba53f-8486-44f1-a7ce-eef4096e2030 tempest-GroupsV314Test-1609463789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-895188c1-5fef-49e9-9efd-71a7854a8f5e {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:52:38 devstack sudo[92292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-895188c1-5fef-49e9-9efd-71a7854a8f5e Jul 10 15:52:38 devstack sudo[92285]: pam_unix(sudo:session): session closed for user root Jul 10 15:52:38 devstack sudo[92292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:52:38 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-09809343-4c0c-44a2-9aa1-6838eb0998cb tempest-GroupsV314Test-1609463789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 1.739s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:52:38 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-09809343-4c0c-44a2-9aa1-6838eb0998cb tempest-GroupsV314Test-1609463789 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 15:52:38 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-09809343-4c0c-44a2-9aa1-6838eb0998cb tempest-GroupsV314Test-1609463789 None] Delete group completed successfully. Jul 10 15:52:38 devstack sudo[92289]: pam_unix(sudo:session): session closed for user root Jul 10 15:52:38 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f7ab3cbb-8bfa-46b1-84b7-41c5b39f3f36 tempest-ServerActionsTestOtherA-1627818978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3282387e-9817-4aa9-9920-a817fca74afa" returned: 0 in 1.549s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:52:38 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-f7ab3cbb-8bfa-46b1-84b7-41c5b39f3f36 tempest-ServerActionsTestOtherA-1627818978 None] <== create_volume: return (3425ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 15:52:38 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-f7ab3cbb-8bfa-46b1-84b7-41c5b39f3f36 tempest-ServerActionsTestOtherA-1627818978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.428s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:52:38 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f7ab3cbb-8bfa-46b1-84b7-41c5b39f3f36 tempest-ServerActionsTestOtherA-1627818978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a6ba968-7ef0-4af2-94eb-55f7e010ab82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3282387e-9817-4aa9-9920-a817fca74afa', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:52:38 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f7ab3cbb-8bfa-46b1-84b7-41c5b39f3f36 tempest-ServerActionsTestOtherA-1627818978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea4b0888-25a8-4c9e-95f4-07b3a7c2d567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:52:38 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-f7ab3cbb-8bfa-46b1-84b7-41c5b39f3f36 tempest-ServerActionsTestOtherA-1627818978 None] Volume volume-3282387e-9817-4aa9-9920-a817fca74afa (3282387e-9817-4aa9-9920-a817fca74afa): created successfully Jul 10 15:52:38 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f7ab3cbb-8bfa-46b1-84b7-41c5b39f3f36 tempest-ServerActionsTestOtherA-1627818978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea4b0888-25a8-4c9e-95f4-07b3a7c2d567) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:52:38 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f7ab3cbb-8bfa-46b1-84b7-41c5b39f3f36 tempest-ServerActionsTestOtherA-1627818978 None] Flow 'volume_create_manager' (7445295a-a8f0-460a-8a6d-4cef83362065) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:52:38 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-f7ab3cbb-8bfa-46b1-84b7-41c5b39f3f36 tempest-ServerActionsTestOtherA-1627818978 None] Created volume successfully. Jul 10 15:52:39 devstack sudo[92292]: pam_unix(sudo:session): session closed for user root Jul 10 15:52:39 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c43ba53f-8486-44f1-a7ce-eef4096e2030 tempest-GroupsV314Test-1609463789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-895188c1-5fef-49e9-9efd-71a7854a8f5e" returned: 0 in 1.652s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:52:39 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c43ba53f-8486-44f1-a7ce-eef4096e2030 tempest-GroupsV314Test-1609463789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-895188c1-5fef-49e9-9efd-71a7854a8f5e {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:52:39 devstack sudo[92301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-895188c1-5fef-49e9-9efd-71a7854a8f5e Jul 10 15:52:39 devstack sudo[92301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:52:40 devstack sudo[92301]: pam_unix(sudo:session): session closed for user root Jul 10 15:52:40 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c43ba53f-8486-44f1-a7ce-eef4096e2030 tempest-GroupsV314Test-1609463789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-895188c1-5fef-49e9-9efd-71a7854a8f5e" returned: 0 in 1.097s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:52:40 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-c43ba53f-8486-44f1-a7ce-eef4096e2030 tempest-GroupsV314Test-1609463789 None] Lock "cinder-quobyte-895188c1-5fef-49e9-9efd-71a7854a8f5e" released by "delete_volume" :: held 2.903s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:52:40 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-c43ba53f-8486-44f1-a7ce-eef4096e2030 tempest-GroupsV314Test-1609463789 None] Created reservations ['d8965a50-2822-4867-90e9-838491391f2e'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 15:52:40 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-c43ba53f-8486-44f1-a7ce-eef4096e2030 tempest-GroupsV314Test-1609463789 None] Created reservations ['77d1c57d-a8c3-4be8-a8c7-741497c5714c', '00553279-6470-4ba7-981b-294dfdba17ff', '326066fa-8a90-46d1-b20d-85b23de93dac', 'd7efe27c-f3b2-455b-bd15-16b442bdf45f'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 15:52:41 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-c43ba53f-8486-44f1-a7ce-eef4096e2030 tempest-GroupsV314Test-1609463789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:52:41 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-c43ba53f-8486-44f1-a7ce-eef4096e2030 tempest-GroupsV314Test-1609463789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:52:41 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-c43ba53f-8486-44f1-a7ce-eef4096e2030 tempest-GroupsV314Test-1609463789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:52:41 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-c43ba53f-8486-44f1-a7ce-eef4096e2030 tempest-GroupsV314Test-1609463789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:52:41 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-c43ba53f-8486-44f1-a7ce-eef4096e2030 tempest-GroupsV314Test-1609463789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:52:41 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c43ba53f-8486-44f1-a7ce-eef4096e2030 tempest-GroupsV314Test-1609463789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:52:41 devstack sudo[92328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 15:52:41 devstack sudo[92328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:52:42 devstack sudo[92328]: pam_unix(sudo:session): session closed for user root Jul 10 15:52:42 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c43ba53f-8486-44f1-a7ce-eef4096e2030 tempest-GroupsV314Test-1609463789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 1.657s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:52:42 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-c43ba53f-8486-44f1-a7ce-eef4096e2030 tempest-GroupsV314Test-1609463789 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 15:52:42 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-c43ba53f-8486-44f1-a7ce-eef4096e2030 tempest-GroupsV314Test-1609463789 None] Delete group completed successfully. Jul 10 15:52:47 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-4ae6271f-7931-4a5c-b622-3a978054addd tempest-GroupsV320Test-1197006136 None] Group tempest-GroupsV320Test-Group-1994272345: creating Jul 10 15:52:47 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-4ae6271f-7931-4a5c-b622-3a978054addd tempest-GroupsV320Test-1197006136 None] Group tempest-GroupsV320Test-Group-1994272345: created successfully Jul 10 15:52:47 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-4ae6271f-7931-4a5c-b622-3a978054addd tempest-GroupsV320Test-1197006136 None] Create group completed successfully. Jul 10 15:52:49 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-2bd8cd33-dad3-4640-9fd7-539232e1f6c6 tempest-GroupsV320Test-1197006136 None] Created reservations ['81ee4860-0d3d-4b88-9721-aa7da0fa383d'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 15:52:49 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-2bd8cd33-dad3-4640-9fd7-539232e1f6c6 tempest-GroupsV320Test-1197006136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:52:49 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-2bd8cd33-dad3-4640-9fd7-539232e1f6c6 tempest-GroupsV320Test-1197006136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:52:49 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-2bd8cd33-dad3-4640-9fd7-539232e1f6c6 tempest-GroupsV320Test-1197006136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:52:49 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-2bd8cd33-dad3-4640-9fd7-539232e1f6c6 tempest-GroupsV320Test-1197006136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:52:49 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-2bd8cd33-dad3-4640-9fd7-539232e1f6c6 tempest-GroupsV320Test-1197006136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:52:49 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-2bd8cd33-dad3-4640-9fd7-539232e1f6c6 tempest-GroupsV320Test-1197006136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:52:49 devstack sudo[92371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 15:52:49 devstack sudo[92371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:52:50 devstack sudo[92371]: pam_unix(sudo:session): session closed for user root Jul 10 15:52:50 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-2bd8cd33-dad3-4640-9fd7-539232e1f6c6 tempest-GroupsV320Test-1197006136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.706s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:52:50 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-2bd8cd33-dad3-4640-9fd7-539232e1f6c6 tempest-GroupsV320Test-1197006136 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 15:52:50 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-2bd8cd33-dad3-4640-9fd7-539232e1f6c6 tempest-GroupsV320Test-1197006136 None] Delete group completed successfully. Jul 10 15:52:59 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-c095a388-7be5-4453-8536-b2795b49a2b1 tempest-AttachVolumeTestJSON-927521694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 15:52:59 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c095a388-7be5-4453-8536-b2795b49a2b1 tempest-AttachVolumeTestJSON-927521694 None] Flow 'volume_create_manager' (62cf38f0-ffdb-46ef-86ae-dc88ccb67f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:52:59 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c095a388-7be5-4453-8536-b2795b49a2b1 tempest-AttachVolumeTestJSON-927521694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffc2581a-86da-47f8-8176-efdb627d1015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:52:59 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c095a388-7be5-4453-8536-b2795b49a2b1 tempest-AttachVolumeTestJSON-927521694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffc2581a-86da-47f8-8176-efdb627d1015) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:52:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-478347842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=691a1195-b6ba-4a90-9c37-4140d3b05b8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea67c374aa3346b2aad4092e92ea0fb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:52:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:52:59Z,use_quota=True,user_id='435cd5d215bb400995f051c97e8de689',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:52:59 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c095a388-7be5-4453-8536-b2795b49a2b1 tempest-AttachVolumeTestJSON-927521694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2488d8dc-75dc-4a35-817c-72e48699ce5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:52:59 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c095a388-7be5-4453-8536-b2795b49a2b1 tempest-AttachVolumeTestJSON-927521694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2488d8dc-75dc-4a35-817c-72e48699ce5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:52:59 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c095a388-7be5-4453-8536-b2795b49a2b1 tempest-AttachVolumeTestJSON-927521694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55f41dab-847a-4d96-b031-7535e1d091df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:52:59 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c095a388-7be5-4453-8536-b2795b49a2b1 tempest-AttachVolumeTestJSON-927521694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55f41dab-847a-4d96-b031-7535e1d091df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '691a1195-b6ba-4a90-9c37-4140d3b05b8f', 'volume_name': 'volume-691a1195-b6ba-4a90-9c37-4140d3b05b8f', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:52:59 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c095a388-7be5-4453-8536-b2795b49a2b1 tempest-AttachVolumeTestJSON-927521694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcef3df0-5991-4650-9b54-09e475734181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:52:59 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c095a388-7be5-4453-8536-b2795b49a2b1 tempest-AttachVolumeTestJSON-927521694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcef3df0-5991-4650-9b54-09e475734181) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:52:59 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c095a388-7be5-4453-8536-b2795b49a2b1 tempest-AttachVolumeTestJSON-927521694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34fa1db5-086d-49fd-8d60-703031b704ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:52:59 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-c095a388-7be5-4453-8536-b2795b49a2b1 tempest-AttachVolumeTestJSON-927521694 None] Volume 691a1195-b6ba-4a90-9c37-4140d3b05b8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-691a1195-b6ba-4a90-9c37-4140d3b05b8f', 'volume_size': 1} Jul 10 15:52:59 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-c095a388-7be5-4453-8536-b2795b49a2b1 tempest-AttachVolumeTestJSON-927521694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:52:59 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-c095a388-7be5-4453-8536-b2795b49a2b1 tempest-AttachVolumeTestJSON-927521694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:52:59 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-c095a388-7be5-4453-8536-b2795b49a2b1 tempest-AttachVolumeTestJSON-927521694 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:52:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-478347842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=691a1195-b6ba-4a90-9c37-4140d3b05b8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea67c374aa3346b2aad4092e92ea0fb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:52:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:52:59Z,use_quota=True,user_id='435cd5d215bb400995f051c97e8de689',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 15:52:59 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-c095a388-7be5-4453-8536-b2795b49a2b1 tempest-AttachVolumeTestJSON-927521694 None] Creating volume 691a1195-b6ba-4a90-9c37-4140d3b05b8f {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 15:52:59 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-c095a388-7be5-4453-8536-b2795b49a2b1 tempest-AttachVolumeTestJSON-927521694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:52:59 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-c095a388-7be5-4453-8536-b2795b49a2b1 tempest-AttachVolumeTestJSON-927521694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:52:59 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-c095a388-7be5-4453-8536-b2795b49a2b1 tempest-AttachVolumeTestJSON-927521694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:52:59 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-c095a388-7be5-4453-8536-b2795b49a2b1 tempest-AttachVolumeTestJSON-927521694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:52:59 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-c095a388-7be5-4453-8536-b2795b49a2b1 tempest-AttachVolumeTestJSON-927521694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:52:59 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-c095a388-7be5-4453-8536-b2795b49a2b1 tempest-AttachVolumeTestJSON-927521694 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 15:52:59 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-c095a388-7be5-4453-8536-b2795b49a2b1 tempest-AttachVolumeTestJSON-927521694 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 15:52:59 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c095a388-7be5-4453-8536-b2795b49a2b1 tempest-AttachVolumeTestJSON-927521694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-691a1195-b6ba-4a90-9c37-4140d3b05b8f 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:52:59 devstack sudo[92431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-691a1195-b6ba-4a90-9c37-4140d3b05b8f 1073741824 Jul 10 15:52:59 devstack sudo[92431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:53:00 devstack sudo[92431]: pam_unix(sudo:session): session closed for user root Jul 10 15:53:00 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c095a388-7be5-4453-8536-b2795b49a2b1 tempest-AttachVolumeTestJSON-927521694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-691a1195-b6ba-4a90-9c37-4140d3b05b8f 1073741824" returned: 0 in 1.310s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:53:00 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c095a388-7be5-4453-8536-b2795b49a2b1 tempest-AttachVolumeTestJSON-927521694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-691a1195-b6ba-4a90-9c37-4140d3b05b8f {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:53:00 devstack sudo[92460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-691a1195-b6ba-4a90-9c37-4140d3b05b8f Jul 10 15:53:00 devstack sudo[92460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:53:01 devstack sudo[92460]: pam_unix(sudo:session): session closed for user root Jul 10 15:53:01 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c095a388-7be5-4453-8536-b2795b49a2b1 tempest-AttachVolumeTestJSON-927521694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-691a1195-b6ba-4a90-9c37-4140d3b05b8f" returned: 0 in 0.992s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:53:01 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-c095a388-7be5-4453-8536-b2795b49a2b1 tempest-AttachVolumeTestJSON-927521694 None] <== create_volume: return (2409ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 15:53:01 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-c095a388-7be5-4453-8536-b2795b49a2b1 tempest-AttachVolumeTestJSON-927521694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.415s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:53:01 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c095a388-7be5-4453-8536-b2795b49a2b1 tempest-AttachVolumeTestJSON-927521694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34fa1db5-086d-49fd-8d60-703031b704ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-691a1195-b6ba-4a90-9c37-4140d3b05b8f', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:53:01 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c095a388-7be5-4453-8536-b2795b49a2b1 tempest-AttachVolumeTestJSON-927521694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e14c1dc-49fc-4da3-aa8a-4dfa88e10696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:53:01 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-c095a388-7be5-4453-8536-b2795b49a2b1 tempest-AttachVolumeTestJSON-927521694 None] Volume volume-691a1195-b6ba-4a90-9c37-4140d3b05b8f (691a1195-b6ba-4a90-9c37-4140d3b05b8f): created successfully Jul 10 15:53:01 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c095a388-7be5-4453-8536-b2795b49a2b1 tempest-AttachVolumeTestJSON-927521694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e14c1dc-49fc-4da3-aa8a-4dfa88e10696) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:53:01 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c095a388-7be5-4453-8536-b2795b49a2b1 tempest-AttachVolumeTestJSON-927521694 None] Flow 'volume_create_manager' (62cf38f0-ffdb-46ef-86ae-dc88ccb67f6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:53:01 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-c095a388-7be5-4453-8536-b2795b49a2b1 tempest-AttachVolumeTestJSON-927521694 None] Created volume successfully. Jul 10 15:53:06 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [req-45852628-04d2-4745-8c8b-e36cdcfb1436 req-72a13da5-3e1c-4142-8deb-b65460266c6a tempest-AttachVolumeTestJSON-927521694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:53:06 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [req-45852628-04d2-4745-8c8b-e36cdcfb1436 req-72a13da5-3e1c-4142-8deb-b65460266c6a tempest-AttachVolumeTestJSON-927521694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:53:06 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f80b81d-2e6c-434c-89dc-c0e2a0f80832]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:53:06 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [req-45852628-04d2-4745-8c8b-e36cdcfb1436 req-72a13da5-3e1c-4142-8deb-b65460266c6a tempest-AttachVolumeTestJSON-927521694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-691a1195-b6ba-4a90-9c37-4140d3b05b8f {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:53:06 devstack sudo[92535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-691a1195-b6ba-4a90-9c37-4140d3b05b8f Jul 10 15:53:06 devstack sudo[92535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:53:07 devstack sudo[92535]: pam_unix(sudo:session): session closed for user root Jul 10 15:53:07 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [req-45852628-04d2-4745-8c8b-e36cdcfb1436 req-72a13da5-3e1c-4142-8deb-b65460266c6a tempest-AttachVolumeTestJSON-927521694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-691a1195-b6ba-4a90-9c37-4140d3b05b8f" returned: 0 in 0.972s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:53:07 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [req-45852628-04d2-4745-8c8b-e36cdcfb1436 req-72a13da5-3e1c-4142-8deb-b65460266c6a tempest-AttachVolumeTestJSON-927521694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.006s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:53:07 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [req-45852628-04d2-4745-8c8b-e36cdcfb1436 req-72a13da5-3e1c-4142-8deb-b65460266c6a tempest-AttachVolumeTestJSON-927521694 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80', 'name': 'volume-691a1195-b6ba-4a90-9c37-4140d3b05b8f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'adc5daed-2b60-4722-bd7b-4e5531a2d0fa', 'enforce_multipath': True} {{(pid=87420) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 15:53:07 devstack cinder-volume[87420]: INFO cinder.volume.manager [req-45852628-04d2-4745-8c8b-e36cdcfb1436 req-72a13da5-3e1c-4142-8deb-b65460266c6a tempest-AttachVolumeTestJSON-927521694 None] attachment_update completed successfully. Jul 10 15:53:17 devstack cinder-volume[87420]: DEBUG dbcounter [-] [87420] Writing DB stats cinder:UPDATE=34,cinder:SELECT=35,cinder:INSERT=8,cinder:DELETE=1 {{(pid=87420) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 15:53:17 devstack cinder-volume[87420]: DEBUG dbcounter [-] [87420] Writing DB stats cinder:UPDATE=38,cinder:SELECT=36,cinder:INSERT=5,cinder:DELETE=1 {{(pid=87420) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 15:53:17 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-c88119ea-3942-4127-a366-7be12246e8b6 tempest-VolumeRetypeWithoutMigrationTest-942670041 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 15:53:17 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c88119ea-3942-4127-a366-7be12246e8b6 tempest-VolumeRetypeWithoutMigrationTest-942670041 None] Flow 'volume_create_manager' (8a4491c3-34a1-4e05-b113-30ae261f888e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:53:17 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c88119ea-3942-4127-a366-7be12246e8b6 tempest-VolumeRetypeWithoutMigrationTest-942670041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e60803e7-97b6-41bd-8934-011df525ed73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:53:17 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c88119ea-3942-4127-a366-7be12246e8b6 tempest-VolumeRetypeWithoutMigrationTest-942670041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e60803e7-97b6-41bd-8934-011df525ed73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:53:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-914257228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4fa7288-ced1-4ee0-b01b-df28b0d373e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8fae6541a904a4d8de7c5393ee2a304',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:53:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:53:17Z,use_quota=True,user_id='243d11bdeb0543b59c0df20952586b74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2498a9c3-fb5d-4de0-a291-673d0d4fce28),volume_type_id=2498a9c3-fb5d-4de0-a291-673d0d4fce28)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:53:17 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c88119ea-3942-4127-a366-7be12246e8b6 tempest-VolumeRetypeWithoutMigrationTest-942670041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9521337c-04aa-47cf-a8f3-166d66c194c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:53:17 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c88119ea-3942-4127-a366-7be12246e8b6 tempest-VolumeRetypeWithoutMigrationTest-942670041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9521337c-04aa-47cf-a8f3-166d66c194c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:53:17 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c88119ea-3942-4127-a366-7be12246e8b6 tempest-VolumeRetypeWithoutMigrationTest-942670041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51f37c05-1b9e-4feb-bfc2-3405cab99caa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:53:17 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c88119ea-3942-4127-a366-7be12246e8b6 tempest-VolumeRetypeWithoutMigrationTest-942670041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51f37c05-1b9e-4feb-bfc2-3405cab99caa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4fa7288-ced1-4ee0-b01b-df28b0d373e9', 'volume_name': 'volume-a4fa7288-ced1-4ee0-b01b-df28b0d373e9', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:53:17 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c88119ea-3942-4127-a366-7be12246e8b6 tempest-VolumeRetypeWithoutMigrationTest-942670041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c6d8cf1-6f98-458b-a4ef-95a23082c2a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:53:17 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c88119ea-3942-4127-a366-7be12246e8b6 tempest-VolumeRetypeWithoutMigrationTest-942670041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c6d8cf1-6f98-458b-a4ef-95a23082c2a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:53:17 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c88119ea-3942-4127-a366-7be12246e8b6 tempest-VolumeRetypeWithoutMigrationTest-942670041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18d02422-9c03-469c-a777-04573ed04f0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:53:17 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-c88119ea-3942-4127-a366-7be12246e8b6 tempest-VolumeRetypeWithoutMigrationTest-942670041 None] Volume a4fa7288-ced1-4ee0-b01b-df28b0d373e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4fa7288-ced1-4ee0-b01b-df28b0d373e9', 'volume_size': 1} Jul 10 15:53:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-c88119ea-3942-4127-a366-7be12246e8b6 tempest-VolumeRetypeWithoutMigrationTest-942670041 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:53:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-c88119ea-3942-4127-a366-7be12246e8b6 tempest-VolumeRetypeWithoutMigrationTest-942670041 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:53:17 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-c88119ea-3942-4127-a366-7be12246e8b6 tempest-VolumeRetypeWithoutMigrationTest-942670041 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:53:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-914257228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4fa7288-ced1-4ee0-b01b-df28b0d373e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8fae6541a904a4d8de7c5393ee2a304',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:53:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:53:17Z,use_quota=True,user_id='243d11bdeb0543b59c0df20952586b74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2498a9c3-fb5d-4de0-a291-673d0d4fce28),volume_type_id=2498a9c3-fb5d-4de0-a291-673d0d4fce28)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 15:53:17 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-c88119ea-3942-4127-a366-7be12246e8b6 tempest-VolumeRetypeWithoutMigrationTest-942670041 None] Creating volume a4fa7288-ced1-4ee0-b01b-df28b0d373e9 {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 15:53:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-c88119ea-3942-4127-a366-7be12246e8b6 tempest-VolumeRetypeWithoutMigrationTest-942670041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:53:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-c88119ea-3942-4127-a366-7be12246e8b6 tempest-VolumeRetypeWithoutMigrationTest-942670041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:53:17 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-c88119ea-3942-4127-a366-7be12246e8b6 tempest-VolumeRetypeWithoutMigrationTest-942670041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:53:17 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-c88119ea-3942-4127-a366-7be12246e8b6 tempest-VolumeRetypeWithoutMigrationTest-942670041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:53:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-c88119ea-3942-4127-a366-7be12246e8b6 tempest-VolumeRetypeWithoutMigrationTest-942670041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:53:17 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-c88119ea-3942-4127-a366-7be12246e8b6 tempest-VolumeRetypeWithoutMigrationTest-942670041 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 15:53:17 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-c88119ea-3942-4127-a366-7be12246e8b6 tempest-VolumeRetypeWithoutMigrationTest-942670041 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 15:53:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c88119ea-3942-4127-a366-7be12246e8b6 tempest-VolumeRetypeWithoutMigrationTest-942670041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a4fa7288-ced1-4ee0-b01b-df28b0d373e9 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:53:17 devstack cinder-volume[87420]: DEBUG oslo_service.periodic_task [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87420) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 15:53:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:53:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:53:17 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:53:17 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:53:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:53:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:53:17 devstack sudo[92997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a4fa7288-ced1-4ee0-b01b-df28b0d373e9 1073741824 Jul 10 15:53:17 devstack sudo[92997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:53:17 devstack sudo[92998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 15:53:17 devstack sudo[92998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:53:18 devstack sudo[92998]: pam_unix(sudo:session): session closed for user root Jul 10 15:53:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.712s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:53:18 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 15:53:18 devstack cinder-volume[87420]: DEBUG oslo_service.periodic_task [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Running periodic task VolumeManager._thread_info {{(pid=87420) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 15:53:18 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] thread count: 8 {{(pid=87420) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 15:53:18 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] thread info: [<_MainThread(MainThread, started 133639250378880)>, , , , , , , ] {{(pid=87420) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 15:53:18 devstack sudo[92997]: pam_unix(sudo:session): session closed for user root Jul 10 15:53:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c88119ea-3942-4127-a366-7be12246e8b6 tempest-VolumeRetypeWithoutMigrationTest-942670041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a4fa7288-ced1-4ee0-b01b-df28b0d373e9 1073741824" returned: 0 in 0.949s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:53:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c88119ea-3942-4127-a366-7be12246e8b6 tempest-VolumeRetypeWithoutMigrationTest-942670041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a4fa7288-ced1-4ee0-b01b-df28b0d373e9 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:53:18 devstack sudo[93006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a4fa7288-ced1-4ee0-b01b-df28b0d373e9 Jul 10 15:53:18 devstack sudo[93006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:53:18 devstack sudo[93006]: pam_unix(sudo:session): session closed for user root Jul 10 15:53:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c88119ea-3942-4127-a366-7be12246e8b6 tempest-VolumeRetypeWithoutMigrationTest-942670041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a4fa7288-ced1-4ee0-b01b-df28b0d373e9" returned: 0 in 0.641s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:53:18 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-c88119ea-3942-4127-a366-7be12246e8b6 tempest-VolumeRetypeWithoutMigrationTest-942670041 None] <== create_volume: return (1637ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 15:53:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-c88119ea-3942-4127-a366-7be12246e8b6 tempest-VolumeRetypeWithoutMigrationTest-942670041 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.640s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:53:19 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c88119ea-3942-4127-a366-7be12246e8b6 tempest-VolumeRetypeWithoutMigrationTest-942670041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18d02422-9c03-469c-a777-04573ed04f0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4fa7288-ced1-4ee0-b01b-df28b0d373e9', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:53:19 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c88119ea-3942-4127-a366-7be12246e8b6 tempest-VolumeRetypeWithoutMigrationTest-942670041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d3b88a0-c756-45d4-87b4-72c5e788235b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:53:19 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-c88119ea-3942-4127-a366-7be12246e8b6 tempest-VolumeRetypeWithoutMigrationTest-942670041 None] Volume volume-a4fa7288-ced1-4ee0-b01b-df28b0d373e9 (a4fa7288-ced1-4ee0-b01b-df28b0d373e9): created successfully Jul 10 15:53:19 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c88119ea-3942-4127-a366-7be12246e8b6 tempest-VolumeRetypeWithoutMigrationTest-942670041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d3b88a0-c756-45d4-87b4-72c5e788235b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:53:19 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c88119ea-3942-4127-a366-7be12246e8b6 tempest-VolumeRetypeWithoutMigrationTest-942670041 None] Flow 'volume_create_manager' (8a4491c3-34a1-4e05-b113-30ae261f888e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:53:19 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-c88119ea-3942-4127-a366-7be12246e8b6 tempest-VolumeRetypeWithoutMigrationTest-942670041 None] Created volume successfully. Jul 10 15:53:19 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-e5ac671c-3050-4d7a-82b9-158c5bb1a5d3 tempest-VolumeRetypeWithoutMigrationTest-942670041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:53:19 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-e5ac671c-3050-4d7a-82b9-158c5bb1a5d3 tempest-VolumeRetypeWithoutMigrationTest-942670041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:53:19 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-e5ac671c-3050-4d7a-82b9-158c5bb1a5d3 tempest-VolumeRetypeWithoutMigrationTest-942670041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:53:19 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-e5ac671c-3050-4d7a-82b9-158c5bb1a5d3 tempest-VolumeRetypeWithoutMigrationTest-942670041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:53:19 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-e5ac671c-3050-4d7a-82b9-158c5bb1a5d3 tempest-VolumeRetypeWithoutMigrationTest-942670041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:53:19 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-e5ac671c-3050-4d7a-82b9-158c5bb1a5d3 tempest-VolumeRetypeWithoutMigrationTest-942670041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:53:19 devstack sudo[93010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 15:53:19 devstack sudo[93010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:53:20 devstack sudo[93010]: pam_unix(sudo:session): session closed for user root Jul 10 15:53:20 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-e5ac671c-3050-4d7a-82b9-158c5bb1a5d3 tempest-VolumeRetypeWithoutMigrationTest-942670041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.721s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:53:20 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-e5ac671c-3050-4d7a-82b9-158c5bb1a5d3 tempest-VolumeRetypeWithoutMigrationTest-942670041 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 15:53:20 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-e5ac671c-3050-4d7a-82b9-158c5bb1a5d3 tempest-VolumeRetypeWithoutMigrationTest-942670041 None] Retype volume completed successfully. Jul 10 15:53:21 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-f8adc1ad-c71d-44f8-b88b-3555f5e8adfe tempest-VolumeRetypeWithoutMigrationTest-942670041 None] Acquiring lock "cinder-a4fa7288-ced1-4ee0-b01b-df28b0d373e9-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:53:21 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-f8adc1ad-c71d-44f8-b88b-3555f5e8adfe tempest-VolumeRetypeWithoutMigrationTest-942670041 None] Lock "cinder-a4fa7288-ced1-4ee0-b01b-df28b0d373e9-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:53:21 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-f8adc1ad-c71d-44f8-b88b-3555f5e8adfe tempest-VolumeRetypeWithoutMigrationTest-942670041 None] Acquiring lock "cinder-quobyte-a4fa7288-ced1-4ee0-b01b-df28b0d373e9" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:53:21 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-f8adc1ad-c71d-44f8-b88b-3555f5e8adfe tempest-VolumeRetypeWithoutMigrationTest-942670041 None] Lock "cinder-quobyte-a4fa7288-ced1-4ee0-b01b-df28b0d373e9" acquired by "delete_volume" :: waited 0.018s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:53:21 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fe79019-ac6b-4c70-90e2-451f82b2eae3]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:53:21 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f8adc1ad-c71d-44f8-b88b-3555f5e8adfe tempest-VolumeRetypeWithoutMigrationTest-942670041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a4fa7288-ced1-4ee0-b01b-df28b0d373e9 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:53:21 devstack sudo[93080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a4fa7288-ced1-4ee0-b01b-df28b0d373e9 Jul 10 15:53:21 devstack sudo[93080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:53:22 devstack sudo[93080]: pam_unix(sudo:session): session closed for user root Jul 10 15:53:22 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f8adc1ad-c71d-44f8-b88b-3555f5e8adfe tempest-VolumeRetypeWithoutMigrationTest-942670041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a4fa7288-ced1-4ee0-b01b-df28b0d373e9" returned: 0 in 0.790s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:53:22 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f8adc1ad-c71d-44f8-b88b-3555f5e8adfe tempest-VolumeRetypeWithoutMigrationTest-942670041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a4fa7288-ced1-4ee0-b01b-df28b0d373e9 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:53:22 devstack sudo[93153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a4fa7288-ced1-4ee0-b01b-df28b0d373e9 Jul 10 15:53:22 devstack sudo[93153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:53:22 devstack sudo[93153]: pam_unix(sudo:session): session closed for user root Jul 10 15:53:22 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f8adc1ad-c71d-44f8-b88b-3555f5e8adfe tempest-VolumeRetypeWithoutMigrationTest-942670041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a4fa7288-ced1-4ee0-b01b-df28b0d373e9" returned: 0 in 0.650s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:53:22 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-f8adc1ad-c71d-44f8-b88b-3555f5e8adfe tempest-VolumeRetypeWithoutMigrationTest-942670041 None] Lock "cinder-quobyte-a4fa7288-ced1-4ee0-b01b-df28b0d373e9" released by "delete_volume" :: held 1.486s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:53:22 devstack cinder-volume[87420]: WARNING cinder.quota [None req-f8adc1ad-c71d-44f8-b88b-3555f5e8adfe tempest-VolumeRetypeWithoutMigrationTest-942670041 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 10 15:53:22 devstack cinder-volume[87420]: WARNING cinder.quota [None req-f8adc1ad-c71d-44f8-b88b-3555f5e8adfe tempest-VolumeRetypeWithoutMigrationTest-942670041 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 10 15:53:22 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-f8adc1ad-c71d-44f8-b88b-3555f5e8adfe tempest-VolumeRetypeWithoutMigrationTest-942670041 None] Created reservations ['23329ed8-d024-4e30-a11e-f2cb9579ef38', 'fb04060a-911a-4e7f-a877-43e53c453a2e', 'afc1920c-57ba-47cd-a6c7-8409909e6ac1', 'e2603a0b-2b17-40d2-8b23-b0751a1c6dae'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 15:53:22 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-f8adc1ad-c71d-44f8-b88b-3555f5e8adfe tempest-VolumeRetypeWithoutMigrationTest-942670041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:53:22 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-f8adc1ad-c71d-44f8-b88b-3555f5e8adfe tempest-VolumeRetypeWithoutMigrationTest-942670041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:53:22 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-f8adc1ad-c71d-44f8-b88b-3555f5e8adfe tempest-VolumeRetypeWithoutMigrationTest-942670041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:53:22 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-f8adc1ad-c71d-44f8-b88b-3555f5e8adfe tempest-VolumeRetypeWithoutMigrationTest-942670041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:53:22 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-f8adc1ad-c71d-44f8-b88b-3555f5e8adfe tempest-VolumeRetypeWithoutMigrationTest-942670041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:53:22 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f8adc1ad-c71d-44f8-b88b-3555f5e8adfe tempest-VolumeRetypeWithoutMigrationTest-942670041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:53:22 devstack sudo[93163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 15:53:22 devstack sudo[93163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:53:23 devstack sudo[93163]: pam_unix(sudo:session): session closed for user root Jul 10 15:53:23 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f8adc1ad-c71d-44f8-b88b-3555f5e8adfe tempest-VolumeRetypeWithoutMigrationTest-942670041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.773s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:53:23 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-f8adc1ad-c71d-44f8-b88b-3555f5e8adfe tempest-VolumeRetypeWithoutMigrationTest-942670041 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 15:53:23 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-f8adc1ad-c71d-44f8-b88b-3555f5e8adfe tempest-VolumeRetypeWithoutMigrationTest-942670041 None] Deleted volume successfully. Jul 10 15:53:23 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-f8adc1ad-c71d-44f8-b88b-3555f5e8adfe tempest-VolumeRetypeWithoutMigrationTest-942670041 None] Lock "cinder-a4fa7288-ced1-4ee0-b01b-df28b0d373e9-delete_volume" released by "delete_volume" :: held 2.471s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:53:24 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [req-9d05de81-b95d-4357-a3b0-0211ddf911c2 req-5ef3528b-715c-4197-a442-be6bd797c64c tempest-ServerActionsTestOtherA-1627818978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:53:24 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [req-9d05de81-b95d-4357-a3b0-0211ddf911c2 req-5ef3528b-715c-4197-a442-be6bd797c64c tempest-ServerActionsTestOtherA-1627818978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:53:24 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa5cc1c9-1021-40c9-bac7-81defe6dc136]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:53:24 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [req-9d05de81-b95d-4357-a3b0-0211ddf911c2 req-5ef3528b-715c-4197-a442-be6bd797c64c tempest-ServerActionsTestOtherA-1627818978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3282387e-9817-4aa9-9920-a817fca74afa {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:53:24 devstack sudo[93181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3282387e-9817-4aa9-9920-a817fca74afa Jul 10 15:53:24 devstack sudo[93181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:53:25 devstack sudo[93181]: pam_unix(sudo:session): session closed for user root Jul 10 15:53:25 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [req-9d05de81-b95d-4357-a3b0-0211ddf911c2 req-5ef3528b-715c-4197-a442-be6bd797c64c tempest-ServerActionsTestOtherA-1627818978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3282387e-9817-4aa9-9920-a817fca74afa" returned: 0 in 1.353s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:53:25 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [req-9d05de81-b95d-4357-a3b0-0211ddf911c2 req-5ef3528b-715c-4197-a442-be6bd797c64c tempest-ServerActionsTestOtherA-1627818978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.371s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:53:25 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [req-9d05de81-b95d-4357-a3b0-0211ddf911c2 req-5ef3528b-715c-4197-a442-be6bd797c64c tempest-ServerActionsTestOtherA-1627818978 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80', 'name': 'volume-3282387e-9817-4aa9-9920-a817fca74afa', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5001193b-0553-418e-a9c3-162e7f530f9a', 'enforce_multipath': True} {{(pid=87420) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 15:53:25 devstack cinder-volume[87420]: INFO cinder.volume.manager [req-9d05de81-b95d-4357-a3b0-0211ddf911c2 req-5ef3528b-715c-4197-a442-be6bd797c64c tempest-ServerActionsTestOtherA-1627818978 None] attachment_update completed successfully. Jul 10 15:53:31 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d637812-809d-4b32-ad99-58a5c814e34d tempest-AttachVolumeNegativeTest-1493731096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 15:53:31 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-2d637812-809d-4b32-ad99-58a5c814e34d tempest-AttachVolumeNegativeTest-1493731096 None] Flow 'volume_create_manager' (69aadc76-0332-458b-8c8b-789364f9377e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:53:31 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-2d637812-809d-4b32-ad99-58a5c814e34d tempest-AttachVolumeNegativeTest-1493731096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db02e387-cb27-4b75-8e1e-8bcb6277e1d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:53:31 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-2d637812-809d-4b32-ad99-58a5c814e34d tempest-AttachVolumeNegativeTest-1493731096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db02e387-cb27-4b75-8e1e-8bcb6277e1d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:53:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1502457413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3ff47dd-d0f3-47d8-9139-3b254f020454,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2952153f098f446c9a2a3feb2ece06da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:53:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:53:32Z,use_quota=True,user_id='144bbba7ccc243468434455811e8982f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:53:31 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-2d637812-809d-4b32-ad99-58a5c814e34d tempest-AttachVolumeNegativeTest-1493731096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fa0e573-dcae-41cc-8bbf-4277977a3ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:53:31 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-2d637812-809d-4b32-ad99-58a5c814e34d tempest-AttachVolumeNegativeTest-1493731096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fa0e573-dcae-41cc-8bbf-4277977a3ac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:53:31 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-2d637812-809d-4b32-ad99-58a5c814e34d tempest-AttachVolumeNegativeTest-1493731096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a94d483-793f-45cb-9794-37d1b86f2e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:53:31 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-2d637812-809d-4b32-ad99-58a5c814e34d tempest-AttachVolumeNegativeTest-1493731096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a94d483-793f-45cb-9794-37d1b86f2e1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3ff47dd-d0f3-47d8-9139-3b254f020454', 'volume_name': 'volume-f3ff47dd-d0f3-47d8-9139-3b254f020454', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:53:31 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-2d637812-809d-4b32-ad99-58a5c814e34d tempest-AttachVolumeNegativeTest-1493731096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ed7dd1c-0c6c-4612-924f-b497212ae6f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:53:31 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-2d637812-809d-4b32-ad99-58a5c814e34d tempest-AttachVolumeNegativeTest-1493731096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ed7dd1c-0c6c-4612-924f-b497212ae6f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:53:31 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-2d637812-809d-4b32-ad99-58a5c814e34d tempest-AttachVolumeNegativeTest-1493731096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d67d9cf7-7a55-45e2-aa07-a1fe6a8b8d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:53:31 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-2d637812-809d-4b32-ad99-58a5c814e34d tempest-AttachVolumeNegativeTest-1493731096 None] Volume f3ff47dd-d0f3-47d8-9139-3b254f020454: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3ff47dd-d0f3-47d8-9139-3b254f020454', 'volume_size': 1} Jul 10 15:53:31 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-2d637812-809d-4b32-ad99-58a5c814e34d tempest-AttachVolumeNegativeTest-1493731096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:53:31 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-2d637812-809d-4b32-ad99-58a5c814e34d tempest-AttachVolumeNegativeTest-1493731096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:53:31 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-2d637812-809d-4b32-ad99-58a5c814e34d tempest-AttachVolumeNegativeTest-1493731096 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:53:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1502457413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3ff47dd-d0f3-47d8-9139-3b254f020454,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2952153f098f446c9a2a3feb2ece06da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:53:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:53:32Z,use_quota=True,user_id='144bbba7ccc243468434455811e8982f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 15:53:31 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-2d637812-809d-4b32-ad99-58a5c814e34d tempest-AttachVolumeNegativeTest-1493731096 None] Creating volume f3ff47dd-d0f3-47d8-9139-3b254f020454 {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 15:53:31 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-2d637812-809d-4b32-ad99-58a5c814e34d tempest-AttachVolumeNegativeTest-1493731096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:53:31 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-2d637812-809d-4b32-ad99-58a5c814e34d tempest-AttachVolumeNegativeTest-1493731096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:53:31 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-2d637812-809d-4b32-ad99-58a5c814e34d tempest-AttachVolumeNegativeTest-1493731096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:53:31 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-2d637812-809d-4b32-ad99-58a5c814e34d tempest-AttachVolumeNegativeTest-1493731096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:53:31 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-2d637812-809d-4b32-ad99-58a5c814e34d tempest-AttachVolumeNegativeTest-1493731096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:53:31 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-2d637812-809d-4b32-ad99-58a5c814e34d tempest-AttachVolumeNegativeTest-1493731096 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 15:53:31 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-2d637812-809d-4b32-ad99-58a5c814e34d tempest-AttachVolumeNegativeTest-1493731096 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 15:53:31 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-2d637812-809d-4b32-ad99-58a5c814e34d tempest-AttachVolumeNegativeTest-1493731096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f3ff47dd-d0f3-47d8-9139-3b254f020454 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:53:31 devstack sudo[93613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f3ff47dd-d0f3-47d8-9139-3b254f020454 1073741824 Jul 10 15:53:31 devstack sudo[93613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:53:32 devstack sudo[93613]: pam_unix(sudo:session): session closed for user root Jul 10 15:53:32 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-2d637812-809d-4b32-ad99-58a5c814e34d tempest-AttachVolumeNegativeTest-1493731096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f3ff47dd-d0f3-47d8-9139-3b254f020454 1073741824" returned: 0 in 1.072s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:53:32 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-2d637812-809d-4b32-ad99-58a5c814e34d tempest-AttachVolumeNegativeTest-1493731096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f3ff47dd-d0f3-47d8-9139-3b254f020454 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:53:33 devstack sudo[93620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f3ff47dd-d0f3-47d8-9139-3b254f020454 Jul 10 15:53:33 devstack sudo[93620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:53:33 devstack sudo[93620]: pam_unix(sudo:session): session closed for user root Jul 10 15:53:33 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-2d637812-809d-4b32-ad99-58a5c814e34d tempest-AttachVolumeNegativeTest-1493731096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f3ff47dd-d0f3-47d8-9139-3b254f020454" returned: 0 in 0.852s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:53:33 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-2d637812-809d-4b32-ad99-58a5c814e34d tempest-AttachVolumeNegativeTest-1493731096 None] <== create_volume: return (1979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 15:53:33 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-2d637812-809d-4b32-ad99-58a5c814e34d tempest-AttachVolumeNegativeTest-1493731096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.982s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:53:33 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-2d637812-809d-4b32-ad99-58a5c814e34d tempest-AttachVolumeNegativeTest-1493731096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d67d9cf7-7a55-45e2-aa07-a1fe6a8b8d4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3ff47dd-d0f3-47d8-9139-3b254f020454', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:53:33 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-2d637812-809d-4b32-ad99-58a5c814e34d tempest-AttachVolumeNegativeTest-1493731096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8226916a-9889-4e27-b9ba-acb11deffbc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:53:33 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-2d637812-809d-4b32-ad99-58a5c814e34d tempest-AttachVolumeNegativeTest-1493731096 None] Volume volume-f3ff47dd-d0f3-47d8-9139-3b254f020454 (f3ff47dd-d0f3-47d8-9139-3b254f020454): created successfully Jul 10 15:53:33 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-2d637812-809d-4b32-ad99-58a5c814e34d tempest-AttachVolumeNegativeTest-1493731096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8226916a-9889-4e27-b9ba-acb11deffbc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:53:33 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-2d637812-809d-4b32-ad99-58a5c814e34d tempest-AttachVolumeNegativeTest-1493731096 None] Flow 'volume_create_manager' (69aadc76-0332-458b-8c8b-789364f9377e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:53:33 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-2d637812-809d-4b32-ad99-58a5c814e34d tempest-AttachVolumeNegativeTest-1493731096 None] Created volume successfully. Jul 10 15:53:34 devstack cinder-volume[87420]: INFO cinder.volume.manager [req-0ef982b4-74be-4a0b-b49f-b73ed5d1abc4 req-c5dd5405-702f-48e9-a8a7-655169911ffe tempest-ServerActionsTestOtherA-1627818978 None] Terminate volume connection completed successfully. Jul 10 15:53:34 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [req-0ef982b4-74be-4a0b-b49f-b73ed5d1abc4 req-c5dd5405-702f-48e9-a8a7-655169911ffe tempest-ServerActionsTestOtherA-1627818978 None] Deleting attachment 5001193b-0553-418e-a9c3-162e7f530f9a. {{(pid=87420) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 15:53:37 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [req-0ef982b4-74be-4a0b-b49f-b73ed5d1abc4 req-0938fbbb-332f-4900-bfe4-a7848a2b9674 tempest-ServerActionsTestOtherA-1627818978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:53:37 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [req-0ef982b4-74be-4a0b-b49f-b73ed5d1abc4 req-0938fbbb-332f-4900-bfe4-a7848a2b9674 tempest-ServerActionsTestOtherA-1627818978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:53:37 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[46295017-9cd5-486d-9393-78cd80dfddda]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:53:37 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [req-0ef982b4-74be-4a0b-b49f-b73ed5d1abc4 req-0938fbbb-332f-4900-bfe4-a7848a2b9674 tempest-ServerActionsTestOtherA-1627818978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3282387e-9817-4aa9-9920-a817fca74afa {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:53:37 devstack sudo[93666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3282387e-9817-4aa9-9920-a817fca74afa Jul 10 15:53:37 devstack sudo[93666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:53:38 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [req-568af47b-e9a1-4a3b-8fed-89fab76b30bc req-210c9c19-d3c4-4f00-a9d0-24f480231a85 tempest-AttachVolumeNegativeTest-1493731096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:53:38 devstack sudo[93666]: pam_unix(sudo:session): session closed for user root Jul 10 15:53:38 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [req-0ef982b4-74be-4a0b-b49f-b73ed5d1abc4 req-0938fbbb-332f-4900-bfe4-a7848a2b9674 tempest-ServerActionsTestOtherA-1627818978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3282387e-9817-4aa9-9920-a817fca74afa" returned: 0 in 1.069s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:53:38 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [req-0ef982b4-74be-4a0b-b49f-b73ed5d1abc4 req-0938fbbb-332f-4900-bfe4-a7848a2b9674 tempest-ServerActionsTestOtherA-1627818978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.103s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:53:38 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [req-568af47b-e9a1-4a3b-8fed-89fab76b30bc req-210c9c19-d3c4-4f00-a9d0-24f480231a85 tempest-AttachVolumeNegativeTest-1493731096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.164s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:53:38 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[63b3f424-cfe3-4778-87c0-e909ecba89c9]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:53:38 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [req-568af47b-e9a1-4a3b-8fed-89fab76b30bc req-210c9c19-d3c4-4f00-a9d0-24f480231a85 tempest-AttachVolumeNegativeTest-1493731096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f3ff47dd-d0f3-47d8-9139-3b254f020454 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:53:38 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [req-0ef982b4-74be-4a0b-b49f-b73ed5d1abc4 req-0938fbbb-332f-4900-bfe4-a7848a2b9674 tempest-ServerActionsTestOtherA-1627818978 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80', 'name': 'volume-3282387e-9817-4aa9-9920-a817fca74afa', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '20604394-eebc-4b6e-9cc0-cdbefc9686f9', 'enforce_multipath': True} {{(pid=87420) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 15:53:38 devstack cinder-volume[87420]: INFO cinder.volume.manager [req-0ef982b4-74be-4a0b-b49f-b73ed5d1abc4 req-0938fbbb-332f-4900-bfe4-a7848a2b9674 tempest-ServerActionsTestOtherA-1627818978 None] attachment_update completed successfully. Jul 10 15:53:38 devstack sudo[93681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f3ff47dd-d0f3-47d8-9139-3b254f020454 Jul 10 15:53:38 devstack sudo[93681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:53:39 devstack sudo[93681]: pam_unix(sudo:session): session closed for user root Jul 10 15:53:39 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [req-568af47b-e9a1-4a3b-8fed-89fab76b30bc req-210c9c19-d3c4-4f00-a9d0-24f480231a85 tempest-AttachVolumeNegativeTest-1493731096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f3ff47dd-d0f3-47d8-9139-3b254f020454" returned: 0 in 1.113s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:53:39 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [req-568af47b-e9a1-4a3b-8fed-89fab76b30bc req-210c9c19-d3c4-4f00-a9d0-24f480231a85 tempest-AttachVolumeNegativeTest-1493731096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.138s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:53:39 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [req-568af47b-e9a1-4a3b-8fed-89fab76b30bc req-210c9c19-d3c4-4f00-a9d0-24f480231a85 tempest-AttachVolumeNegativeTest-1493731096 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80', 'name': 'volume-f3ff47dd-d0f3-47d8-9139-3b254f020454', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e7d98ed6-18d5-4707-baea-e46047679889', 'enforce_multipath': True} {{(pid=87420) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 15:53:39 devstack cinder-volume[87420]: INFO cinder.volume.manager [req-568af47b-e9a1-4a3b-8fed-89fab76b30bc req-210c9c19-d3c4-4f00-a9d0-24f480231a85 tempest-AttachVolumeNegativeTest-1493731096 None] attachment_update completed successfully. Jul 10 15:53:43 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-d980827c-8315-44e3-8a5f-682cbc168d67 tempest-VolumesListAdminTestJSON-967159459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 15:53:43 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d980827c-8315-44e3-8a5f-682cbc168d67 tempest-VolumesListAdminTestJSON-967159459 None] Flow 'volume_create_manager' (60eadcd9-2f56-47d5-98c7-382e0d1db4c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:53:43 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d980827c-8315-44e3-8a5f-682cbc168d67 tempest-VolumesListAdminTestJSON-967159459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9eeac06a-02ef-4f39-8455-2414654303f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:53:43 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d980827c-8315-44e3-8a5f-682cbc168d67 tempest-VolumesListAdminTestJSON-967159459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9eeac06a-02ef-4f39-8455-2414654303f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:53:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-83591400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2588f38d-e901-4e77-9093-eeda7d732e34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab7fcbda674f44b6978045c4b0394091',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:53:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:53:43Z,use_quota=True,user_id='e05569ef849d472f9df43c55a3770ba2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:53:43 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d980827c-8315-44e3-8a5f-682cbc168d67 tempest-VolumesListAdminTestJSON-967159459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea53db1d-89bf-49e5-ad7a-71991cf47eae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:53:43 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d980827c-8315-44e3-8a5f-682cbc168d67 tempest-VolumesListAdminTestJSON-967159459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea53db1d-89bf-49e5-ad7a-71991cf47eae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:53:43 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d980827c-8315-44e3-8a5f-682cbc168d67 tempest-VolumesListAdminTestJSON-967159459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8b8e38e-ce9e-44c7-8cf9-68fea77fdb3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:53:43 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d980827c-8315-44e3-8a5f-682cbc168d67 tempest-VolumesListAdminTestJSON-967159459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8b8e38e-ce9e-44c7-8cf9-68fea77fdb3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2588f38d-e901-4e77-9093-eeda7d732e34', 'volume_name': 'volume-2588f38d-e901-4e77-9093-eeda7d732e34', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:53:43 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d980827c-8315-44e3-8a5f-682cbc168d67 tempest-VolumesListAdminTestJSON-967159459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (811beec8-802a-43ab-80d0-d95f892ef677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:53:43 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d980827c-8315-44e3-8a5f-682cbc168d67 tempest-VolumesListAdminTestJSON-967159459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (811beec8-802a-43ab-80d0-d95f892ef677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:53:43 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d980827c-8315-44e3-8a5f-682cbc168d67 tempest-VolumesListAdminTestJSON-967159459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34b1b2a0-8ff8-4412-8437-aa36880835b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:53:43 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-d980827c-8315-44e3-8a5f-682cbc168d67 tempest-VolumesListAdminTestJSON-967159459 None] Volume 2588f38d-e901-4e77-9093-eeda7d732e34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2588f38d-e901-4e77-9093-eeda7d732e34', 'volume_size': 1} Jul 10 15:53:43 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-d980827c-8315-44e3-8a5f-682cbc168d67 tempest-VolumesListAdminTestJSON-967159459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:53:43 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-d980827c-8315-44e3-8a5f-682cbc168d67 tempest-VolumesListAdminTestJSON-967159459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:53:43 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-d980827c-8315-44e3-8a5f-682cbc168d67 tempest-VolumesListAdminTestJSON-967159459 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:53:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-83591400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2588f38d-e901-4e77-9093-eeda7d732e34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab7fcbda674f44b6978045c4b0394091',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:53:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:53:43Z,use_quota=True,user_id='e05569ef849d472f9df43c55a3770ba2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 15:53:43 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-d980827c-8315-44e3-8a5f-682cbc168d67 tempest-VolumesListAdminTestJSON-967159459 None] Creating volume 2588f38d-e901-4e77-9093-eeda7d732e34 {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 15:53:43 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-d980827c-8315-44e3-8a5f-682cbc168d67 tempest-VolumesListAdminTestJSON-967159459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:53:43 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-d980827c-8315-44e3-8a5f-682cbc168d67 tempest-VolumesListAdminTestJSON-967159459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:53:43 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-d980827c-8315-44e3-8a5f-682cbc168d67 tempest-VolumesListAdminTestJSON-967159459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:53:43 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-d980827c-8315-44e3-8a5f-682cbc168d67 tempest-VolumesListAdminTestJSON-967159459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:53:43 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-d980827c-8315-44e3-8a5f-682cbc168d67 tempest-VolumesListAdminTestJSON-967159459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:53:43 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-d980827c-8315-44e3-8a5f-682cbc168d67 tempest-VolumesListAdminTestJSON-967159459 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 15:53:43 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-d980827c-8315-44e3-8a5f-682cbc168d67 tempest-VolumesListAdminTestJSON-967159459 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 15:53:43 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d980827c-8315-44e3-8a5f-682cbc168d67 tempest-VolumesListAdminTestJSON-967159459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-2588f38d-e901-4e77-9093-eeda7d732e34 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:53:43 devstack sudo[93770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-2588f38d-e901-4e77-9093-eeda7d732e34 1073741824 Jul 10 15:53:43 devstack sudo[93770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:53:44 devstack sudo[93770]: pam_unix(sudo:session): session closed for user root Jul 10 15:53:44 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d980827c-8315-44e3-8a5f-682cbc168d67 tempest-VolumesListAdminTestJSON-967159459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-2588f38d-e901-4e77-9093-eeda7d732e34 1073741824" returned: 0 in 0.883s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:53:44 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d980827c-8315-44e3-8a5f-682cbc168d67 tempest-VolumesListAdminTestJSON-967159459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-2588f38d-e901-4e77-9093-eeda7d732e34 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:53:44 devstack sudo[93798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-2588f38d-e901-4e77-9093-eeda7d732e34 Jul 10 15:53:44 devstack sudo[93798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:53:44 devstack sudo[93798]: pam_unix(sudo:session): session closed for user root Jul 10 15:53:44 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d980827c-8315-44e3-8a5f-682cbc168d67 tempest-VolumesListAdminTestJSON-967159459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-2588f38d-e901-4e77-9093-eeda7d732e34" returned: 0 in 0.740s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:53:44 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-d980827c-8315-44e3-8a5f-682cbc168d67 tempest-VolumesListAdminTestJSON-967159459 None] <== create_volume: return (1685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 15:53:44 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-d980827c-8315-44e3-8a5f-682cbc168d67 tempest-VolumesListAdminTestJSON-967159459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.692s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:53:44 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d980827c-8315-44e3-8a5f-682cbc168d67 tempest-VolumesListAdminTestJSON-967159459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34b1b2a0-8ff8-4412-8437-aa36880835b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2588f38d-e901-4e77-9093-eeda7d732e34', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:53:44 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d980827c-8315-44e3-8a5f-682cbc168d67 tempest-VolumesListAdminTestJSON-967159459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13ebc62b-b2d8-4221-9893-5a452752963d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:53:45 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-d980827c-8315-44e3-8a5f-682cbc168d67 tempest-VolumesListAdminTestJSON-967159459 None] Volume volume-2588f38d-e901-4e77-9093-eeda7d732e34 (2588f38d-e901-4e77-9093-eeda7d732e34): created successfully Jul 10 15:53:45 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d980827c-8315-44e3-8a5f-682cbc168d67 tempest-VolumesListAdminTestJSON-967159459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13ebc62b-b2d8-4221-9893-5a452752963d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:53:45 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d980827c-8315-44e3-8a5f-682cbc168d67 tempest-VolumesListAdminTestJSON-967159459 None] Flow 'volume_create_manager' (60eadcd9-2f56-47d5-98c7-382e0d1db4c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:53:45 devstack cinder-volume[87420]: INFO cinder.volume.manager [req-9e7c08d8-7938-4e49-8b02-f1851cb61167 req-d0c08801-c3cf-49e8-9723-874eeed800d2 tempest-AttachVolumeNegativeTest-1493731096 None] Terminate volume connection completed successfully. Jul 10 15:53:45 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [req-9e7c08d8-7938-4e49-8b02-f1851cb61167 req-d0c08801-c3cf-49e8-9723-874eeed800d2 tempest-AttachVolumeNegativeTest-1493731096 None] Deleting attachment e7d98ed6-18d5-4707-baea-e46047679889. {{(pid=87420) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 15:53:45 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-d980827c-8315-44e3-8a5f-682cbc168d67 tempest-VolumesListAdminTestJSON-967159459 None] Created volume successfully. Jul 10 15:53:45 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-415ce1ce-8952-4b53-b229-1ac47559e177 tempest-VolumesListAdminTestJSON-967159459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 15:53:46 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-415ce1ce-8952-4b53-b229-1ac47559e177 tempest-VolumesListAdminTestJSON-967159459 None] Flow 'volume_create_manager' (ae93f22d-c2dc-4903-89ad-b291148bdf5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:53:46 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-415ce1ce-8952-4b53-b229-1ac47559e177 tempest-VolumesListAdminTestJSON-967159459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (166fc63a-ce89-480f-be25-c4f1fb62cd03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:53:46 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-415ce1ce-8952-4b53-b229-1ac47559e177 tempest-VolumesListAdminTestJSON-967159459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (166fc63a-ce89-480f-be25-c4f1fb62cd03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:53:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1537272867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2ef3c92-1710-4d13-8ff7-b8645e69292a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab7fcbda674f44b6978045c4b0394091',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:53:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:53:46Z,use_quota=True,user_id='e05569ef849d472f9df43c55a3770ba2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:53:46 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-415ce1ce-8952-4b53-b229-1ac47559e177 tempest-VolumesListAdminTestJSON-967159459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (810b48d8-8b75-45fd-911c-b150c3d6f2eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:53:46 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-415ce1ce-8952-4b53-b229-1ac47559e177 tempest-VolumesListAdminTestJSON-967159459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (810b48d8-8b75-45fd-911c-b150c3d6f2eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:53:46 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-415ce1ce-8952-4b53-b229-1ac47559e177 tempest-VolumesListAdminTestJSON-967159459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dd5cffc-6e06-4412-937e-fbec9d6faa66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:53:46 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-415ce1ce-8952-4b53-b229-1ac47559e177 tempest-VolumesListAdminTestJSON-967159459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dd5cffc-6e06-4412-937e-fbec9d6faa66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2ef3c92-1710-4d13-8ff7-b8645e69292a', 'volume_name': 'volume-a2ef3c92-1710-4d13-8ff7-b8645e69292a', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:53:46 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-415ce1ce-8952-4b53-b229-1ac47559e177 tempest-VolumesListAdminTestJSON-967159459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b12e4ccd-e1a1-4e2b-b9e1-c13591fb7965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:53:46 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-415ce1ce-8952-4b53-b229-1ac47559e177 tempest-VolumesListAdminTestJSON-967159459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b12e4ccd-e1a1-4e2b-b9e1-c13591fb7965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:53:46 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-415ce1ce-8952-4b53-b229-1ac47559e177 tempest-VolumesListAdminTestJSON-967159459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bda02e1a-efdf-4750-8b9b-69d225fe9f79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:53:46 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-415ce1ce-8952-4b53-b229-1ac47559e177 tempest-VolumesListAdminTestJSON-967159459 None] Volume a2ef3c92-1710-4d13-8ff7-b8645e69292a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2ef3c92-1710-4d13-8ff7-b8645e69292a', 'volume_size': 1} Jul 10 15:53:46 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-415ce1ce-8952-4b53-b229-1ac47559e177 tempest-VolumesListAdminTestJSON-967159459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:53:46 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-415ce1ce-8952-4b53-b229-1ac47559e177 tempest-VolumesListAdminTestJSON-967159459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:53:46 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-415ce1ce-8952-4b53-b229-1ac47559e177 tempest-VolumesListAdminTestJSON-967159459 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:53:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1537272867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2ef3c92-1710-4d13-8ff7-b8645e69292a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab7fcbda674f44b6978045c4b0394091',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:53:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:53:46Z,use_quota=True,user_id='e05569ef849d472f9df43c55a3770ba2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 15:53:46 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-415ce1ce-8952-4b53-b229-1ac47559e177 tempest-VolumesListAdminTestJSON-967159459 None] Creating volume a2ef3c92-1710-4d13-8ff7-b8645e69292a {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 15:53:46 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-415ce1ce-8952-4b53-b229-1ac47559e177 tempest-VolumesListAdminTestJSON-967159459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:53:46 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-415ce1ce-8952-4b53-b229-1ac47559e177 tempest-VolumesListAdminTestJSON-967159459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:53:46 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-415ce1ce-8952-4b53-b229-1ac47559e177 tempest-VolumesListAdminTestJSON-967159459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:53:46 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-415ce1ce-8952-4b53-b229-1ac47559e177 tempest-VolumesListAdminTestJSON-967159459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:53:46 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-415ce1ce-8952-4b53-b229-1ac47559e177 tempest-VolumesListAdminTestJSON-967159459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:53:46 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-415ce1ce-8952-4b53-b229-1ac47559e177 tempest-VolumesListAdminTestJSON-967159459 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 15:53:46 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-415ce1ce-8952-4b53-b229-1ac47559e177 tempest-VolumesListAdminTestJSON-967159459 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 15:53:46 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-415ce1ce-8952-4b53-b229-1ac47559e177 tempest-VolumesListAdminTestJSON-967159459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a2ef3c92-1710-4d13-8ff7-b8645e69292a 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:53:46 devstack sudo[93811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a2ef3c92-1710-4d13-8ff7-b8645e69292a 1073741824 Jul 10 15:53:46 devstack sudo[93811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:53:47 devstack sudo[93811]: pam_unix(sudo:session): session closed for user root Jul 10 15:53:47 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-415ce1ce-8952-4b53-b229-1ac47559e177 tempest-VolumesListAdminTestJSON-967159459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a2ef3c92-1710-4d13-8ff7-b8645e69292a 1073741824" returned: 0 in 1.135s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:53:47 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-415ce1ce-8952-4b53-b229-1ac47559e177 tempest-VolumesListAdminTestJSON-967159459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a2ef3c92-1710-4d13-8ff7-b8645e69292a {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:53:47 devstack sudo[93818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a2ef3c92-1710-4d13-8ff7-b8645e69292a Jul 10 15:53:47 devstack sudo[93818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:53:48 devstack sudo[93818]: pam_unix(sudo:session): session closed for user root Jul 10 15:53:48 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-415ce1ce-8952-4b53-b229-1ac47559e177 tempest-VolumesListAdminTestJSON-967159459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a2ef3c92-1710-4d13-8ff7-b8645e69292a" returned: 0 in 0.757s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:53:48 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-415ce1ce-8952-4b53-b229-1ac47559e177 tempest-VolumesListAdminTestJSON-967159459 None] <== create_volume: return (1964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 15:53:48 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-415ce1ce-8952-4b53-b229-1ac47559e177 tempest-VolumesListAdminTestJSON-967159459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.966s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:53:48 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-415ce1ce-8952-4b53-b229-1ac47559e177 tempest-VolumesListAdminTestJSON-967159459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bda02e1a-efdf-4750-8b9b-69d225fe9f79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2ef3c92-1710-4d13-8ff7-b8645e69292a', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:53:48 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-415ce1ce-8952-4b53-b229-1ac47559e177 tempest-VolumesListAdminTestJSON-967159459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d80dd4c9-a267-4c63-a593-b437d64692e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:53:48 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-415ce1ce-8952-4b53-b229-1ac47559e177 tempest-VolumesListAdminTestJSON-967159459 None] Volume volume-a2ef3c92-1710-4d13-8ff7-b8645e69292a (a2ef3c92-1710-4d13-8ff7-b8645e69292a): created successfully Jul 10 15:53:48 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-415ce1ce-8952-4b53-b229-1ac47559e177 tempest-VolumesListAdminTestJSON-967159459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d80dd4c9-a267-4c63-a593-b437d64692e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:53:48 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-415ce1ce-8952-4b53-b229-1ac47559e177 tempest-VolumesListAdminTestJSON-967159459 None] Flow 'volume_create_manager' (ae93f22d-c2dc-4903-89ad-b291148bdf5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:53:48 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-415ce1ce-8952-4b53-b229-1ac47559e177 tempest-VolumesListAdminTestJSON-967159459 None] Created volume successfully. Jul 10 15:53:49 devstack cinder-volume[87420]: INFO cinder.volume.manager [req-1426d2e4-1924-45e7-b177-0b8746dda5aa req-b68034e4-958e-4ff6-8ad5-14081fa107d1 tempest-AttachVolumeTestJSON-927521694 None] Terminate volume connection completed successfully. Jul 10 15:53:49 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [req-1426d2e4-1924-45e7-b177-0b8746dda5aa req-b68034e4-958e-4ff6-8ad5-14081fa107d1 tempest-AttachVolumeTestJSON-927521694 None] Deleting attachment adc5daed-2b60-4722-bd7b-4e5531a2d0fa. {{(pid=87420) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 15:53:50 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-f15fff25-fec7-4e37-af85-12d6f9ab45cc tempest-VolumesListAdminTestJSON-967159459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 15:53:50 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f15fff25-fec7-4e37-af85-12d6f9ab45cc tempest-VolumesListAdminTestJSON-967159459 None] Flow 'volume_create_manager' (6ae516df-ecfc-4e0a-a600-5913ad22ad19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:53:50 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f15fff25-fec7-4e37-af85-12d6f9ab45cc tempest-VolumesListAdminTestJSON-967159459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1d24b32-7455-454a-ba1d-436bed193122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:53:50 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f15fff25-fec7-4e37-af85-12d6f9ab45cc tempest-VolumesListAdminTestJSON-967159459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1d24b32-7455-454a-ba1d-436bed193122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:53:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-645091177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ae8f08b-cfc8-4e36-8bf3-4382b3ac0001,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab7fcbda674f44b6978045c4b0394091',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:53:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:53:50Z,use_quota=True,user_id='e05569ef849d472f9df43c55a3770ba2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:53:50 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f15fff25-fec7-4e37-af85-12d6f9ab45cc tempest-VolumesListAdminTestJSON-967159459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c6d67a5-5e44-4769-9d76-8049b4f48aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:53:50 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f15fff25-fec7-4e37-af85-12d6f9ab45cc tempest-VolumesListAdminTestJSON-967159459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c6d67a5-5e44-4769-9d76-8049b4f48aec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:53:50 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f15fff25-fec7-4e37-af85-12d6f9ab45cc tempest-VolumesListAdminTestJSON-967159459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c7dcdb5-2d50-449d-b75b-7a6a6e04e7fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:53:50 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f15fff25-fec7-4e37-af85-12d6f9ab45cc tempest-VolumesListAdminTestJSON-967159459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c7dcdb5-2d50-449d-b75b-7a6a6e04e7fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ae8f08b-cfc8-4e36-8bf3-4382b3ac0001', 'volume_name': 'volume-0ae8f08b-cfc8-4e36-8bf3-4382b3ac0001', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:53:50 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f15fff25-fec7-4e37-af85-12d6f9ab45cc tempest-VolumesListAdminTestJSON-967159459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b4b6d90-85bb-429c-82e5-7fdc75a23680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:53:50 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f15fff25-fec7-4e37-af85-12d6f9ab45cc tempest-VolumesListAdminTestJSON-967159459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b4b6d90-85bb-429c-82e5-7fdc75a23680) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:53:50 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f15fff25-fec7-4e37-af85-12d6f9ab45cc tempest-VolumesListAdminTestJSON-967159459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5276d083-15d7-4293-83bf-8866de07669a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:53:50 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-f15fff25-fec7-4e37-af85-12d6f9ab45cc tempest-VolumesListAdminTestJSON-967159459 None] Volume 0ae8f08b-cfc8-4e36-8bf3-4382b3ac0001: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ae8f08b-cfc8-4e36-8bf3-4382b3ac0001', 'volume_size': 1} Jul 10 15:53:50 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-f15fff25-fec7-4e37-af85-12d6f9ab45cc tempest-VolumesListAdminTestJSON-967159459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:53:50 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-f15fff25-fec7-4e37-af85-12d6f9ab45cc tempest-VolumesListAdminTestJSON-967159459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:53:50 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-f15fff25-fec7-4e37-af85-12d6f9ab45cc tempest-VolumesListAdminTestJSON-967159459 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:53:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-645091177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ae8f08b-cfc8-4e36-8bf3-4382b3ac0001,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab7fcbda674f44b6978045c4b0394091',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:53:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:53:50Z,use_quota=True,user_id='e05569ef849d472f9df43c55a3770ba2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 15:53:50 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-f15fff25-fec7-4e37-af85-12d6f9ab45cc tempest-VolumesListAdminTestJSON-967159459 None] Creating volume 0ae8f08b-cfc8-4e36-8bf3-4382b3ac0001 {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 15:53:50 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-f15fff25-fec7-4e37-af85-12d6f9ab45cc tempest-VolumesListAdminTestJSON-967159459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:53:50 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-f15fff25-fec7-4e37-af85-12d6f9ab45cc tempest-VolumesListAdminTestJSON-967159459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:53:50 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-f15fff25-fec7-4e37-af85-12d6f9ab45cc tempest-VolumesListAdminTestJSON-967159459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:53:50 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-f15fff25-fec7-4e37-af85-12d6f9ab45cc tempest-VolumesListAdminTestJSON-967159459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:53:50 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-f15fff25-fec7-4e37-af85-12d6f9ab45cc tempest-VolumesListAdminTestJSON-967159459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:53:50 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-f15fff25-fec7-4e37-af85-12d6f9ab45cc tempest-VolumesListAdminTestJSON-967159459 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 15:53:50 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-f15fff25-fec7-4e37-af85-12d6f9ab45cc tempest-VolumesListAdminTestJSON-967159459 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 15:53:50 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f15fff25-fec7-4e37-af85-12d6f9ab45cc tempest-VolumesListAdminTestJSON-967159459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-0ae8f08b-cfc8-4e36-8bf3-4382b3ac0001 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:53:50 devstack sudo[93848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-0ae8f08b-cfc8-4e36-8bf3-4382b3ac0001 1073741824 Jul 10 15:53:50 devstack sudo[93848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:53:51 devstack sudo[93848]: pam_unix(sudo:session): session closed for user root Jul 10 15:53:51 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f15fff25-fec7-4e37-af85-12d6f9ab45cc tempest-VolumesListAdminTestJSON-967159459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-0ae8f08b-cfc8-4e36-8bf3-4382b3ac0001 1073741824" returned: 0 in 1.337s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:53:51 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f15fff25-fec7-4e37-af85-12d6f9ab45cc tempest-VolumesListAdminTestJSON-967159459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-0ae8f08b-cfc8-4e36-8bf3-4382b3ac0001 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:53:51 devstack sudo[93857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-0ae8f08b-cfc8-4e36-8bf3-4382b3ac0001 Jul 10 15:53:51 devstack sudo[93857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:53:52 devstack sudo[93857]: pam_unix(sudo:session): session closed for user root Jul 10 15:53:52 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f15fff25-fec7-4e37-af85-12d6f9ab45cc tempest-VolumesListAdminTestJSON-967159459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-0ae8f08b-cfc8-4e36-8bf3-4382b3ac0001" returned: 0 in 0.694s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:53:52 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-f15fff25-fec7-4e37-af85-12d6f9ab45cc tempest-VolumesListAdminTestJSON-967159459 None] <== create_volume: return (2083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 15:53:52 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-f15fff25-fec7-4e37-af85-12d6f9ab45cc tempest-VolumesListAdminTestJSON-967159459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.088s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:53:52 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f15fff25-fec7-4e37-af85-12d6f9ab45cc tempest-VolumesListAdminTestJSON-967159459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5276d083-15d7-4293-83bf-8866de07669a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ae8f08b-cfc8-4e36-8bf3-4382b3ac0001', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:53:52 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f15fff25-fec7-4e37-af85-12d6f9ab45cc tempest-VolumesListAdminTestJSON-967159459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c9d5c33-9771-4f1d-a997-57478fae5c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:53:52 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-f15fff25-fec7-4e37-af85-12d6f9ab45cc tempest-VolumesListAdminTestJSON-967159459 None] Volume volume-0ae8f08b-cfc8-4e36-8bf3-4382b3ac0001 (0ae8f08b-cfc8-4e36-8bf3-4382b3ac0001): created successfully Jul 10 15:53:52 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f15fff25-fec7-4e37-af85-12d6f9ab45cc tempest-VolumesListAdminTestJSON-967159459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c9d5c33-9771-4f1d-a997-57478fae5c72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:53:52 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f15fff25-fec7-4e37-af85-12d6f9ab45cc tempest-VolumesListAdminTestJSON-967159459 None] Flow 'volume_create_manager' (6ae516df-ecfc-4e0a-a600-5913ad22ad19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:53:52 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-f15fff25-fec7-4e37-af85-12d6f9ab45cc tempest-VolumesListAdminTestJSON-967159459 None] Created volume successfully. Jul 10 15:53:54 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e1f91bd-db46-4713-ab3f-292218392bdf tempest-VolumesListAdminTestJSON-1112347292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 15:53:54 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-3e1f91bd-db46-4713-ab3f-292218392bdf tempest-VolumesListAdminTestJSON-1112347292 None] Flow 'volume_create_manager' (6618c87a-ec19-46a7-8617-fbcc94dee848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:53:54 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-3e1f91bd-db46-4713-ab3f-292218392bdf tempest-VolumesListAdminTestJSON-1112347292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ae42ca5-2999-402d-80d7-38dcb788ff6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:53:54 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-3e1f91bd-db46-4713-ab3f-292218392bdf tempest-VolumesListAdminTestJSON-1112347292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ae42ca5-2999-402d-80d7-38dcb788ff6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:53:54Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ace4e4cc-8de5-42af-96d3-3b6c46f44f76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfbf134076054205ba23049b567fa597',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:53:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:53:54Z,use_quota=True,user_id='f4550f43c0a04b9388e0540cb501101a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:53:54 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-3e1f91bd-db46-4713-ab3f-292218392bdf tempest-VolumesListAdminTestJSON-1112347292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6da5cce4-ff31-4fc4-b643-637e38b4a69a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:53:54 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-3e1f91bd-db46-4713-ab3f-292218392bdf tempest-VolumesListAdminTestJSON-1112347292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6da5cce4-ff31-4fc4-b643-637e38b4a69a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:53:54 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-3e1f91bd-db46-4713-ab3f-292218392bdf tempest-VolumesListAdminTestJSON-1112347292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8a3529f-7f3d-4e93-91a9-4260097d1abd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:53:54 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-3e1f91bd-db46-4713-ab3f-292218392bdf tempest-VolumesListAdminTestJSON-1112347292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8a3529f-7f3d-4e93-91a9-4260097d1abd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ace4e4cc-8de5-42af-96d3-3b6c46f44f76', 'volume_name': 'volume-ace4e4cc-8de5-42af-96d3-3b6c46f44f76', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:53:54 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-3e1f91bd-db46-4713-ab3f-292218392bdf tempest-VolumesListAdminTestJSON-1112347292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dad03d2-d2fb-447a-b8ff-09d639b1665f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:53:54 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-3e1f91bd-db46-4713-ab3f-292218392bdf tempest-VolumesListAdminTestJSON-1112347292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dad03d2-d2fb-447a-b8ff-09d639b1665f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:53:54 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-3e1f91bd-db46-4713-ab3f-292218392bdf tempest-VolumesListAdminTestJSON-1112347292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3070b0b7-164e-428f-a58c-1061f7d9f4ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:53:54 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-3e1f91bd-db46-4713-ab3f-292218392bdf tempest-VolumesListAdminTestJSON-1112347292 None] Volume ace4e4cc-8de5-42af-96d3-3b6c46f44f76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ace4e4cc-8de5-42af-96d3-3b6c46f44f76', 'volume_size': 1} Jul 10 15:53:54 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-3e1f91bd-db46-4713-ab3f-292218392bdf tempest-VolumesListAdminTestJSON-1112347292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:53:54 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-3e1f91bd-db46-4713-ab3f-292218392bdf tempest-VolumesListAdminTestJSON-1112347292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:53:54 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-3e1f91bd-db46-4713-ab3f-292218392bdf tempest-VolumesListAdminTestJSON-1112347292 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:53:54Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ace4e4cc-8de5-42af-96d3-3b6c46f44f76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfbf134076054205ba23049b567fa597',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:53:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:53:54Z,use_quota=True,user_id='f4550f43c0a04b9388e0540cb501101a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 15:53:54 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-3e1f91bd-db46-4713-ab3f-292218392bdf tempest-VolumesListAdminTestJSON-1112347292 None] Creating volume ace4e4cc-8de5-42af-96d3-3b6c46f44f76 {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 15:53:54 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-3e1f91bd-db46-4713-ab3f-292218392bdf tempest-VolumesListAdminTestJSON-1112347292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:53:54 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-3e1f91bd-db46-4713-ab3f-292218392bdf tempest-VolumesListAdminTestJSON-1112347292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:53:54 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-3e1f91bd-db46-4713-ab3f-292218392bdf tempest-VolumesListAdminTestJSON-1112347292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:53:54 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-3e1f91bd-db46-4713-ab3f-292218392bdf tempest-VolumesListAdminTestJSON-1112347292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:53:54 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-3e1f91bd-db46-4713-ab3f-292218392bdf tempest-VolumesListAdminTestJSON-1112347292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:53:54 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-3e1f91bd-db46-4713-ab3f-292218392bdf tempest-VolumesListAdminTestJSON-1112347292 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 15:53:54 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-3e1f91bd-db46-4713-ab3f-292218392bdf tempest-VolumesListAdminTestJSON-1112347292 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 15:53:54 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-3e1f91bd-db46-4713-ab3f-292218392bdf tempest-VolumesListAdminTestJSON-1112347292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ace4e4cc-8de5-42af-96d3-3b6c46f44f76 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:53:54 devstack sudo[93867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ace4e4cc-8de5-42af-96d3-3b6c46f44f76 1073741824 Jul 10 15:53:54 devstack sudo[93867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:53:55 devstack sudo[93867]: pam_unix(sudo:session): session closed for user root Jul 10 15:53:55 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-3e1f91bd-db46-4713-ab3f-292218392bdf tempest-VolumesListAdminTestJSON-1112347292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ace4e4cc-8de5-42af-96d3-3b6c46f44f76 1073741824" returned: 0 in 1.037s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:53:55 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-3e1f91bd-db46-4713-ab3f-292218392bdf tempest-VolumesListAdminTestJSON-1112347292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ace4e4cc-8de5-42af-96d3-3b6c46f44f76 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:53:55 devstack sudo[93873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ace4e4cc-8de5-42af-96d3-3b6c46f44f76 Jul 10 15:53:55 devstack sudo[93873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:53:56 devstack sudo[93873]: pam_unix(sudo:session): session closed for user root Jul 10 15:53:56 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-3e1f91bd-db46-4713-ab3f-292218392bdf tempest-VolumesListAdminTestJSON-1112347292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ace4e4cc-8de5-42af-96d3-3b6c46f44f76" returned: 0 in 0.966s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:53:56 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-3e1f91bd-db46-4713-ab3f-292218392bdf tempest-VolumesListAdminTestJSON-1112347292 None] <== create_volume: return (2090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 15:53:56 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-3e1f91bd-db46-4713-ab3f-292218392bdf tempest-VolumesListAdminTestJSON-1112347292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.092s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:53:56 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-3e1f91bd-db46-4713-ab3f-292218392bdf tempest-VolumesListAdminTestJSON-1112347292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3070b0b7-164e-428f-a58c-1061f7d9f4ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ace4e4cc-8de5-42af-96d3-3b6c46f44f76', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:53:56 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-3e1f91bd-db46-4713-ab3f-292218392bdf tempest-VolumesListAdminTestJSON-1112347292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (661e17bc-2a0b-43d7-a6b8-f8c34edaf94e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:53:56 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-3e1f91bd-db46-4713-ab3f-292218392bdf tempest-VolumesListAdminTestJSON-1112347292 None] Volume volume-ace4e4cc-8de5-42af-96d3-3b6c46f44f76 (ace4e4cc-8de5-42af-96d3-3b6c46f44f76): created successfully Jul 10 15:53:56 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-3e1f91bd-db46-4713-ab3f-292218392bdf tempest-VolumesListAdminTestJSON-1112347292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (661e17bc-2a0b-43d7-a6b8-f8c34edaf94e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:53:56 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-3e1f91bd-db46-4713-ab3f-292218392bdf tempest-VolumesListAdminTestJSON-1112347292 None] Flow 'volume_create_manager' (6618c87a-ec19-46a7-8617-fbcc94dee848) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:53:56 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-3e1f91bd-db46-4713-ab3f-292218392bdf tempest-VolumesListAdminTestJSON-1112347292 None] Created volume successfully. Jul 10 15:53:57 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-77e4da39-368f-41ab-9ee7-7290270482f2 tempest-VolumesListAdminTestJSON-1112347292 None] Acquiring lock "cinder-ace4e4cc-8de5-42af-96d3-3b6c46f44f76-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:53:57 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-77e4da39-368f-41ab-9ee7-7290270482f2 tempest-VolumesListAdminTestJSON-1112347292 None] Lock "cinder-ace4e4cc-8de5-42af-96d3-3b6c46f44f76-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:53:57 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-77e4da39-368f-41ab-9ee7-7290270482f2 tempest-VolumesListAdminTestJSON-1112347292 None] Acquiring lock "cinder-quobyte-ace4e4cc-8de5-42af-96d3-3b6c46f44f76" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:53:57 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-77e4da39-368f-41ab-9ee7-7290270482f2 tempest-VolumesListAdminTestJSON-1112347292 None] Lock "cinder-quobyte-ace4e4cc-8de5-42af-96d3-3b6c46f44f76" acquired by "delete_volume" :: waited 0.028s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:53:57 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[916d0bf9-d13f-4464-9878-d7ee6b329a86]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:53:57 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-77e4da39-368f-41ab-9ee7-7290270482f2 tempest-VolumesListAdminTestJSON-1112347292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ace4e4cc-8de5-42af-96d3-3b6c46f44f76 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:53:57 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-aec3959a-f9ed-451a-ae48-3e1310e04836 tempest-VolumesListAdminTestJSON-967159459 None] Acquiring lock "cinder-0ae8f08b-cfc8-4e36-8bf3-4382b3ac0001-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:53:57 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-aec3959a-f9ed-451a-ae48-3e1310e04836 tempest-VolumesListAdminTestJSON-967159459 None] Lock "cinder-0ae8f08b-cfc8-4e36-8bf3-4382b3ac0001-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:53:58 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-aec3959a-f9ed-451a-ae48-3e1310e04836 tempest-VolumesListAdminTestJSON-967159459 None] Acquiring lock "cinder-quobyte-0ae8f08b-cfc8-4e36-8bf3-4382b3ac0001" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:53:58 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-aec3959a-f9ed-451a-ae48-3e1310e04836 tempest-VolumesListAdminTestJSON-967159459 None] Lock "cinder-quobyte-0ae8f08b-cfc8-4e36-8bf3-4382b3ac0001" acquired by "delete_volume" :: waited 0.016s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:53:58 devstack sudo[93907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ace4e4cc-8de5-42af-96d3-3b6c46f44f76 Jul 10 15:53:58 devstack sudo[93907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:53:58 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6b84a16-c19a-444e-9957-fc6e81ee6a77]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:53:58 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-aec3959a-f9ed-451a-ae48-3e1310e04836 tempest-VolumesListAdminTestJSON-967159459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-0ae8f08b-cfc8-4e36-8bf3-4382b3ac0001 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:53:58 devstack sudo[93909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-0ae8f08b-cfc8-4e36-8bf3-4382b3ac0001 Jul 10 15:53:58 devstack sudo[93909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:53:58 devstack sudo[93909]: pam_unix(sudo:session): session closed for user root Jul 10 15:53:58 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-aec3959a-f9ed-451a-ae48-3e1310e04836 tempest-VolumesListAdminTestJSON-967159459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-0ae8f08b-cfc8-4e36-8bf3-4382b3ac0001" returned: 0 in 0.872s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:53:58 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-aec3959a-f9ed-451a-ae48-3e1310e04836 tempest-VolumesListAdminTestJSON-967159459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-0ae8f08b-cfc8-4e36-8bf3-4382b3ac0001 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:53:58 devstack sudo[93918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-0ae8f08b-cfc8-4e36-8bf3-4382b3ac0001 Jul 10 15:53:58 devstack sudo[93918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:53:59 devstack sudo[93907]: pam_unix(sudo:session): session closed for user root Jul 10 15:53:59 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-77e4da39-368f-41ab-9ee7-7290270482f2 tempest-VolumesListAdminTestJSON-1112347292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ace4e4cc-8de5-42af-96d3-3b6c46f44f76" returned: 0 in 1.122s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:53:59 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-77e4da39-368f-41ab-9ee7-7290270482f2 tempest-VolumesListAdminTestJSON-1112347292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ace4e4cc-8de5-42af-96d3-3b6c46f44f76 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:53:59 devstack sudo[93920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ace4e4cc-8de5-42af-96d3-3b6c46f44f76 Jul 10 15:53:59 devstack sudo[93920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:53:59 devstack sudo[93918]: pam_unix(sudo:session): session closed for user root Jul 10 15:53:59 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-aec3959a-f9ed-451a-ae48-3e1310e04836 tempest-VolumesListAdminTestJSON-967159459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-0ae8f08b-cfc8-4e36-8bf3-4382b3ac0001" returned: 0 in 0.859s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:53:59 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-aec3959a-f9ed-451a-ae48-3e1310e04836 tempest-VolumesListAdminTestJSON-967159459 None] Lock "cinder-quobyte-0ae8f08b-cfc8-4e36-8bf3-4382b3ac0001" released by "delete_volume" :: held 1.804s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:53:59 devstack sudo[93920]: pam_unix(sudo:session): session closed for user root Jul 10 15:53:59 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-77e4da39-368f-41ab-9ee7-7290270482f2 tempest-VolumesListAdminTestJSON-1112347292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ace4e4cc-8de5-42af-96d3-3b6c46f44f76" returned: 0 in 0.838s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:53:59 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-77e4da39-368f-41ab-9ee7-7290270482f2 tempest-VolumesListAdminTestJSON-1112347292 None] Lock "cinder-quobyte-ace4e4cc-8de5-42af-96d3-3b6c46f44f76" released by "delete_volume" :: held 2.037s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:53:59 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-aec3959a-f9ed-451a-ae48-3e1310e04836 tempest-VolumesListAdminTestJSON-967159459 None] Created reservations ['90c89702-5392-4356-a210-607f4de9c532', '3ad9d450-c373-4f7d-9f73-dcf5868c2f28', 'fb822a1f-10c9-4720-aec4-9bf397a8fa00', '302ea73f-4663-49ca-821a-9bb88c6d9860'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 15:54:00 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-77e4da39-368f-41ab-9ee7-7290270482f2 tempest-VolumesListAdminTestJSON-1112347292 None] Created reservations ['4215cd9a-160d-4aad-86d3-ebd957f2b68e', 'dc0c5324-bad0-45a3-994f-91bc1b28058d', 'e5f0271b-4a7f-4eb7-b2d9-1511f3b35b16', '3ee29c2d-d3b1-44fc-b4ab-7361084ada27'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 15:54:00 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-aec3959a-f9ed-451a-ae48-3e1310e04836 tempest-VolumesListAdminTestJSON-967159459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:54:00 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-aec3959a-f9ed-451a-ae48-3e1310e04836 tempest-VolumesListAdminTestJSON-967159459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:54:00 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-aec3959a-f9ed-451a-ae48-3e1310e04836 tempest-VolumesListAdminTestJSON-967159459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:54:00 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-aec3959a-f9ed-451a-ae48-3e1310e04836 tempest-VolumesListAdminTestJSON-967159459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:54:00 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-aec3959a-f9ed-451a-ae48-3e1310e04836 tempest-VolumesListAdminTestJSON-967159459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:54:00 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-aec3959a-f9ed-451a-ae48-3e1310e04836 tempest-VolumesListAdminTestJSON-967159459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:54:00 devstack sudo[93939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 15:54:00 devstack sudo[93939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:54:00 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-77e4da39-368f-41ab-9ee7-7290270482f2 tempest-VolumesListAdminTestJSON-1112347292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:54:00 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-77e4da39-368f-41ab-9ee7-7290270482f2 tempest-VolumesListAdminTestJSON-1112347292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:54:00 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-77e4da39-368f-41ab-9ee7-7290270482f2 tempest-VolumesListAdminTestJSON-1112347292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:54:00 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-77e4da39-368f-41ab-9ee7-7290270482f2 tempest-VolumesListAdminTestJSON-1112347292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:54:00 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-77e4da39-368f-41ab-9ee7-7290270482f2 tempest-VolumesListAdminTestJSON-1112347292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:54:00 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-77e4da39-368f-41ab-9ee7-7290270482f2 tempest-VolumesListAdminTestJSON-1112347292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:54:00 devstack sudo[93942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 15:54:00 devstack sudo[93942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:54:00 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-1dcf5ed4-dda4-4cc8-8425-03e064eb63d8 tempest-VolumesListAdminTestJSON-967159459 None] Acquiring lock "cinder-a2ef3c92-1710-4d13-8ff7-b8645e69292a-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:54:00 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-1dcf5ed4-dda4-4cc8-8425-03e064eb63d8 tempest-VolumesListAdminTestJSON-967159459 None] Lock "cinder-a2ef3c92-1710-4d13-8ff7-b8645e69292a-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:54:00 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-1dcf5ed4-dda4-4cc8-8425-03e064eb63d8 tempest-VolumesListAdminTestJSON-967159459 None] Acquiring lock "cinder-quobyte-a2ef3c92-1710-4d13-8ff7-b8645e69292a" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:54:00 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-1dcf5ed4-dda4-4cc8-8425-03e064eb63d8 tempest-VolumesListAdminTestJSON-967159459 None] Lock "cinder-quobyte-a2ef3c92-1710-4d13-8ff7-b8645e69292a" acquired by "delete_volume" :: waited 0.044s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:54:00 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f2ba70d-1a8a-454f-ac06-ef62f0076c8f]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:54:00 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-1dcf5ed4-dda4-4cc8-8425-03e064eb63d8 tempest-VolumesListAdminTestJSON-967159459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a2ef3c92-1710-4d13-8ff7-b8645e69292a {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:54:00 devstack sudo[93945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a2ef3c92-1710-4d13-8ff7-b8645e69292a Jul 10 15:54:00 devstack sudo[93945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:54:01 devstack sudo[93939]: pam_unix(sudo:session): session closed for user root Jul 10 15:54:01 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-aec3959a-f9ed-451a-ae48-3e1310e04836 tempest-VolumesListAdminTestJSON-967159459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 1.143s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:54:01 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-aec3959a-f9ed-451a-ae48-3e1310e04836 tempest-VolumesListAdminTestJSON-967159459 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 15:54:01 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-aec3959a-f9ed-451a-ae48-3e1310e04836 tempest-VolumesListAdminTestJSON-967159459 None] Deleted volume successfully. Jul 10 15:54:01 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-aec3959a-f9ed-451a-ae48-3e1310e04836 tempest-VolumesListAdminTestJSON-967159459 None] Lock "cinder-0ae8f08b-cfc8-4e36-8bf3-4382b3ac0001-delete_volume" released by "delete_volume" :: held 3.282s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:54:01 devstack sudo[93942]: pam_unix(sudo:session): session closed for user root Jul 10 15:54:01 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-77e4da39-368f-41ab-9ee7-7290270482f2 tempest-VolumesListAdminTestJSON-1112347292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 1.196s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:54:01 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-77e4da39-368f-41ab-9ee7-7290270482f2 tempest-VolumesListAdminTestJSON-1112347292 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 15:54:01 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-77e4da39-368f-41ab-9ee7-7290270482f2 tempest-VolumesListAdminTestJSON-1112347292 None] Deleted volume successfully. Jul 10 15:54:01 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-77e4da39-368f-41ab-9ee7-7290270482f2 tempest-VolumesListAdminTestJSON-1112347292 None] Lock "cinder-ace4e4cc-8de5-42af-96d3-3b6c46f44f76-delete_volume" released by "delete_volume" :: held 3.606s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:54:01 devstack sudo[93945]: pam_unix(sudo:session): session closed for user root Jul 10 15:54:01 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-1dcf5ed4-dda4-4cc8-8425-03e064eb63d8 tempest-VolumesListAdminTestJSON-967159459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a2ef3c92-1710-4d13-8ff7-b8645e69292a" returned: 0 in 0.965s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:54:01 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-1dcf5ed4-dda4-4cc8-8425-03e064eb63d8 tempest-VolumesListAdminTestJSON-967159459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a2ef3c92-1710-4d13-8ff7-b8645e69292a {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:54:01 devstack sudo[93964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a2ef3c92-1710-4d13-8ff7-b8645e69292a Jul 10 15:54:01 devstack sudo[93964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:54:02 devstack sudo[93964]: pam_unix(sudo:session): session closed for user root Jul 10 15:54:02 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-1dcf5ed4-dda4-4cc8-8425-03e064eb63d8 tempest-VolumesListAdminTestJSON-967159459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a2ef3c92-1710-4d13-8ff7-b8645e69292a" returned: 0 in 0.795s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:54:02 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-1dcf5ed4-dda4-4cc8-8425-03e064eb63d8 tempest-VolumesListAdminTestJSON-967159459 None] Lock "cinder-quobyte-a2ef3c92-1710-4d13-8ff7-b8645e69292a" released by "delete_volume" :: held 1.811s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:54:02 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-1dcf5ed4-dda4-4cc8-8425-03e064eb63d8 tempest-VolumesListAdminTestJSON-967159459 None] Created reservations ['ef664b9d-8069-493f-9779-e073ff3cb33c', '7f91e9f8-7e27-49a8-a328-c33584d623e3', 'c7be3346-95fc-405d-8c3d-7f1f47e9a416', 'f400e2a1-e0bf-4145-956c-0690080e6101'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 15:54:02 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-1dcf5ed4-dda4-4cc8-8425-03e064eb63d8 tempest-VolumesListAdminTestJSON-967159459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:54:02 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-1dcf5ed4-dda4-4cc8-8425-03e064eb63d8 tempest-VolumesListAdminTestJSON-967159459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:54:02 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-1dcf5ed4-dda4-4cc8-8425-03e064eb63d8 tempest-VolumesListAdminTestJSON-967159459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:54:02 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-1dcf5ed4-dda4-4cc8-8425-03e064eb63d8 tempest-VolumesListAdminTestJSON-967159459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:54:02 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-1dcf5ed4-dda4-4cc8-8425-03e064eb63d8 tempest-VolumesListAdminTestJSON-967159459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:54:02 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-1dcf5ed4-dda4-4cc8-8425-03e064eb63d8 tempest-VolumesListAdminTestJSON-967159459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:54:02 devstack sudo[93987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 15:54:02 devstack sudo[93987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:54:02 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-4d2492bb-b726-4e72-ad5c-d59d5604dd3a tempest-VolumesListAdminTestJSON-967159459 None] Acquiring lock "cinder-2588f38d-e901-4e77-9093-eeda7d732e34-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:54:02 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-4d2492bb-b726-4e72-ad5c-d59d5604dd3a tempest-VolumesListAdminTestJSON-967159459 None] Lock "cinder-2588f38d-e901-4e77-9093-eeda7d732e34-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:54:03 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-4d2492bb-b726-4e72-ad5c-d59d5604dd3a tempest-VolumesListAdminTestJSON-967159459 None] Acquiring lock "cinder-quobyte-2588f38d-e901-4e77-9093-eeda7d732e34" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:54:03 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-4d2492bb-b726-4e72-ad5c-d59d5604dd3a tempest-VolumesListAdminTestJSON-967159459 None] Lock "cinder-quobyte-2588f38d-e901-4e77-9093-eeda7d732e34" acquired by "delete_volume" :: waited 0.018s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:54:03 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[49c55702-4a3c-4629-8b72-51a80b3c8e42]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:54:03 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4d2492bb-b726-4e72-ad5c-d59d5604dd3a tempest-VolumesListAdminTestJSON-967159459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-2588f38d-e901-4e77-9093-eeda7d732e34 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:54:03 devstack sudo[94038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-2588f38d-e901-4e77-9093-eeda7d732e34 Jul 10 15:54:03 devstack sudo[94038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:54:03 devstack sudo[93987]: pam_unix(sudo:session): session closed for user root Jul 10 15:54:03 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-1dcf5ed4-dda4-4cc8-8425-03e064eb63d8 tempest-VolumesListAdminTestJSON-967159459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 1.053s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:54:03 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-1dcf5ed4-dda4-4cc8-8425-03e064eb63d8 tempest-VolumesListAdminTestJSON-967159459 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 15:54:03 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-1dcf5ed4-dda4-4cc8-8425-03e064eb63d8 tempest-VolumesListAdminTestJSON-967159459 None] Deleted volume successfully. Jul 10 15:54:03 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-1dcf5ed4-dda4-4cc8-8425-03e064eb63d8 tempest-VolumesListAdminTestJSON-967159459 None] Lock "cinder-a2ef3c92-1710-4d13-8ff7-b8645e69292a-delete_volume" released by "delete_volume" :: held 3.156s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:54:04 devstack sudo[94038]: pam_unix(sudo:session): session closed for user root Jul 10 15:54:04 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4d2492bb-b726-4e72-ad5c-d59d5604dd3a tempest-VolumesListAdminTestJSON-967159459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-2588f38d-e901-4e77-9093-eeda7d732e34" returned: 0 in 1.122s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:54:04 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4d2492bb-b726-4e72-ad5c-d59d5604dd3a tempest-VolumesListAdminTestJSON-967159459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-2588f38d-e901-4e77-9093-eeda7d732e34 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:54:04 devstack sudo[94061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-2588f38d-e901-4e77-9093-eeda7d732e34 Jul 10 15:54:04 devstack sudo[94061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:54:05 devstack sudo[94061]: pam_unix(sudo:session): session closed for user root Jul 10 15:54:05 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4d2492bb-b726-4e72-ad5c-d59d5604dd3a tempest-VolumesListAdminTestJSON-967159459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-2588f38d-e901-4e77-9093-eeda7d732e34" returned: 0 in 0.762s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:54:05 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-4d2492bb-b726-4e72-ad5c-d59d5604dd3a tempest-VolumesListAdminTestJSON-967159459 None] Lock "cinder-quobyte-2588f38d-e901-4e77-9093-eeda7d732e34" released by "delete_volume" :: held 1.982s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:54:05 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-4d2492bb-b726-4e72-ad5c-d59d5604dd3a tempest-VolumesListAdminTestJSON-967159459 None] Created reservations ['8fbc7098-37a9-48f6-8842-60307ff5ff79', '45a92df7-d450-4bf6-9dc7-c6bb619b9527', '87b796fd-4368-496f-b70b-1511cb3a2594', 'cab556af-7704-4c01-916c-9bfdb7d6ec77'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 15:54:05 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-4d2492bb-b726-4e72-ad5c-d59d5604dd3a tempest-VolumesListAdminTestJSON-967159459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:54:05 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-4d2492bb-b726-4e72-ad5c-d59d5604dd3a tempest-VolumesListAdminTestJSON-967159459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:54:05 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-4d2492bb-b726-4e72-ad5c-d59d5604dd3a tempest-VolumesListAdminTestJSON-967159459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:54:05 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-4d2492bb-b726-4e72-ad5c-d59d5604dd3a tempest-VolumesListAdminTestJSON-967159459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:54:05 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-4d2492bb-b726-4e72-ad5c-d59d5604dd3a tempest-VolumesListAdminTestJSON-967159459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:54:05 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4d2492bb-b726-4e72-ad5c-d59d5604dd3a tempest-VolumesListAdminTestJSON-967159459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:54:05 devstack sudo[94066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 15:54:05 devstack sudo[94066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:54:06 devstack sudo[94066]: pam_unix(sudo:session): session closed for user root Jul 10 15:54:06 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4d2492bb-b726-4e72-ad5c-d59d5604dd3a tempest-VolumesListAdminTestJSON-967159459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 1.243s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:54:06 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-4d2492bb-b726-4e72-ad5c-d59d5604dd3a tempest-VolumesListAdminTestJSON-967159459 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 15:54:06 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-4d2492bb-b726-4e72-ad5c-d59d5604dd3a tempest-VolumesListAdminTestJSON-967159459 None] Deleted volume successfully. Jul 10 15:54:06 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-4d2492bb-b726-4e72-ad5c-d59d5604dd3a tempest-VolumesListAdminTestJSON-967159459 None] Lock "cinder-2588f38d-e901-4e77-9093-eeda7d732e34-delete_volume" released by "delete_volume" :: held 3.610s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:54:11 devstack cinder-volume[87420]: INFO cinder.volume.manager [req-e68a6cf0-4d50-480a-a818-23b4523e85d6 req-b603b06d-3564-4473-9528-6ce2a94360ea tempest-ServerActionsTestOtherA-1627818978 None] Terminate volume connection completed successfully. Jul 10 15:54:11 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [req-e68a6cf0-4d50-480a-a818-23b4523e85d6 req-b603b06d-3564-4473-9528-6ce2a94360ea tempest-ServerActionsTestOtherA-1627818978 None] Deleting attachment 20604394-eebc-4b6e-9cc0-cdbefc9686f9. {{(pid=87420) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 15:54:17 devstack cinder-volume[87420]: DEBUG oslo_service.periodic_task [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87420) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 15:54:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:54:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:54:17 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:54:17 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:54:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:54:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:54:17 devstack sudo[94190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 15:54:17 devstack sudo[94190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:54:18 devstack sudo[94190]: pam_unix(sudo:session): session closed for user root Jul 10 15:54:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.950s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:54:18 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 15:54:18 devstack cinder-volume[87420]: DEBUG oslo_service.periodic_task [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Running periodic task VolumeManager._thread_info {{(pid=87420) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 15:54:18 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] thread count: 8 {{(pid=87420) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 15:54:18 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] thread info: [<_MainThread(MainThread, started 133639250378880)>, , , , , , , ] {{(pid=87420) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 15:54:21 devstack cinder-volume[87420]: DEBUG dbcounter [-] [87420] Writing DB stats cinder:SELECT=60,cinder:UPDATE=61,cinder:DELETE=4,cinder:INSERT=9 {{(pid=87420) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 15:54:21 devstack cinder-volume[87420]: DEBUG dbcounter [-] [87420] Writing DB stats cinder:SELECT=69,cinder:UPDATE=73,cinder:INSERT=17,cinder:DELETE=7 {{(pid=87420) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 15:54:23 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-5b1b709d-2f40-44ff-8765-6fc67192b387 tempest-ServerActionsTestOtherA-1627818978 None] Acquiring lock "cinder-3282387e-9817-4aa9-9920-a817fca74afa-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:54:23 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-5b1b709d-2f40-44ff-8765-6fc67192b387 tempest-ServerActionsTestOtherA-1627818978 None] Lock "cinder-3282387e-9817-4aa9-9920-a817fca74afa-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:54:23 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-5b1b709d-2f40-44ff-8765-6fc67192b387 tempest-ServerActionsTestOtherA-1627818978 None] Acquiring lock "cinder-quobyte-3282387e-9817-4aa9-9920-a817fca74afa" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:54:23 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-5b1b709d-2f40-44ff-8765-6fc67192b387 tempest-ServerActionsTestOtherA-1627818978 None] Lock "cinder-quobyte-3282387e-9817-4aa9-9920-a817fca74afa" acquired by "delete_volume" :: waited 0.027s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:54:23 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4175ac5-fdee-47c2-a66e-4a5f87aec9cc]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:54:23 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-5b1b709d-2f40-44ff-8765-6fc67192b387 tempest-ServerActionsTestOtherA-1627818978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3282387e-9817-4aa9-9920-a817fca74afa {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:54:23 devstack sudo[94199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3282387e-9817-4aa9-9920-a817fca74afa Jul 10 15:54:23 devstack sudo[94199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:54:23 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-e87e01cb-db1a-4397-9424-9a1b44e0b051 tempest-VolumesTransfersV357Test-1238531960 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 15:54:23 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-e87e01cb-db1a-4397-9424-9a1b44e0b051 tempest-VolumesTransfersV357Test-1238531960 None] Flow 'volume_create_manager' (1d819194-6734-493a-9054-76e417356e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:54:23 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-e87e01cb-db1a-4397-9424-9a1b44e0b051 tempest-VolumesTransfersV357Test-1238531960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18e93df1-2faf-4eb0-a916-2f1a92f457be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:54:23 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-e87e01cb-db1a-4397-9424-9a1b44e0b051 tempest-VolumesTransfersV357Test-1238531960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18e93df1-2faf-4eb0-a916-2f1a92f457be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:54:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-260044238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3537b809-439c-4ff4-8bea-67948f4e80b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e15d0aab9924529a2c2ff3d67134f3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:54:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:54:23Z,use_quota=True,user_id='b63031af1aac4766b47dfba9ddd6c3df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:54:23 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-e87e01cb-db1a-4397-9424-9a1b44e0b051 tempest-VolumesTransfersV357Test-1238531960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e85dce9c-aa54-43e2-892b-8681649b6e37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:54:23 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-e87e01cb-db1a-4397-9424-9a1b44e0b051 tempest-VolumesTransfersV357Test-1238531960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e85dce9c-aa54-43e2-892b-8681649b6e37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:54:23 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-e87e01cb-db1a-4397-9424-9a1b44e0b051 tempest-VolumesTransfersV357Test-1238531960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9300f5b0-a131-4962-8119-32a13da051e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:54:23 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-e87e01cb-db1a-4397-9424-9a1b44e0b051 tempest-VolumesTransfersV357Test-1238531960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9300f5b0-a131-4962-8119-32a13da051e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3537b809-439c-4ff4-8bea-67948f4e80b0', 'volume_name': 'volume-3537b809-439c-4ff4-8bea-67948f4e80b0', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:54:23 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-e87e01cb-db1a-4397-9424-9a1b44e0b051 tempest-VolumesTransfersV357Test-1238531960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (896da405-e12c-4151-93a1-abc4317b0f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:54:23 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-e87e01cb-db1a-4397-9424-9a1b44e0b051 tempest-VolumesTransfersV357Test-1238531960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (896da405-e12c-4151-93a1-abc4317b0f4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:54:23 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-e87e01cb-db1a-4397-9424-9a1b44e0b051 tempest-VolumesTransfersV357Test-1238531960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8237fecf-a003-498b-be83-35b5d2a5a74e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:54:23 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-e87e01cb-db1a-4397-9424-9a1b44e0b051 tempest-VolumesTransfersV357Test-1238531960 None] Volume 3537b809-439c-4ff4-8bea-67948f4e80b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3537b809-439c-4ff4-8bea-67948f4e80b0', 'volume_size': 1} Jul 10 15:54:23 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-e87e01cb-db1a-4397-9424-9a1b44e0b051 tempest-VolumesTransfersV357Test-1238531960 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:54:23 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-e87e01cb-db1a-4397-9424-9a1b44e0b051 tempest-VolumesTransfersV357Test-1238531960 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:54:23 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-e87e01cb-db1a-4397-9424-9a1b44e0b051 tempest-VolumesTransfersV357Test-1238531960 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:54:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-260044238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3537b809-439c-4ff4-8bea-67948f4e80b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e15d0aab9924529a2c2ff3d67134f3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:54:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:54:23Z,use_quota=True,user_id='b63031af1aac4766b47dfba9ddd6c3df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 15:54:23 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-e87e01cb-db1a-4397-9424-9a1b44e0b051 tempest-VolumesTransfersV357Test-1238531960 None] Creating volume 3537b809-439c-4ff4-8bea-67948f4e80b0 {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 15:54:23 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-e87e01cb-db1a-4397-9424-9a1b44e0b051 tempest-VolumesTransfersV357Test-1238531960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:54:23 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-e87e01cb-db1a-4397-9424-9a1b44e0b051 tempest-VolumesTransfersV357Test-1238531960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:54:23 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-e87e01cb-db1a-4397-9424-9a1b44e0b051 tempest-VolumesTransfersV357Test-1238531960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:54:23 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-e87e01cb-db1a-4397-9424-9a1b44e0b051 tempest-VolumesTransfersV357Test-1238531960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:54:23 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-e87e01cb-db1a-4397-9424-9a1b44e0b051 tempest-VolumesTransfersV357Test-1238531960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:54:23 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-e87e01cb-db1a-4397-9424-9a1b44e0b051 tempest-VolumesTransfersV357Test-1238531960 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 15:54:23 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-e87e01cb-db1a-4397-9424-9a1b44e0b051 tempest-VolumesTransfersV357Test-1238531960 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 15:54:23 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-e87e01cb-db1a-4397-9424-9a1b44e0b051 tempest-VolumesTransfersV357Test-1238531960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3537b809-439c-4ff4-8bea-67948f4e80b0 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:54:23 devstack sudo[94201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3537b809-439c-4ff4-8bea-67948f4e80b0 1073741824 Jul 10 15:54:23 devstack sudo[94201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:54:24 devstack sudo[94199]: pam_unix(sudo:session): session closed for user root Jul 10 15:54:24 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-5b1b709d-2f40-44ff-8765-6fc67192b387 tempest-ServerActionsTestOtherA-1627818978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3282387e-9817-4aa9-9920-a817fca74afa" returned: 0 in 0.923s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:54:24 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-5b1b709d-2f40-44ff-8765-6fc67192b387 tempest-ServerActionsTestOtherA-1627818978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3282387e-9817-4aa9-9920-a817fca74afa {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:54:24 devstack sudo[94211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3282387e-9817-4aa9-9920-a817fca74afa Jul 10 15:54:24 devstack sudo[94211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:54:24 devstack sudo[94201]: pam_unix(sudo:session): session closed for user root Jul 10 15:54:24 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-e87e01cb-db1a-4397-9424-9a1b44e0b051 tempest-VolumesTransfersV357Test-1238531960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3537b809-439c-4ff4-8bea-67948f4e80b0 1073741824" returned: 0 in 0.886s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:54:24 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-e87e01cb-db1a-4397-9424-9a1b44e0b051 tempest-VolumesTransfersV357Test-1238531960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3537b809-439c-4ff4-8bea-67948f4e80b0 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:54:24 devstack sudo[94215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3537b809-439c-4ff4-8bea-67948f4e80b0 Jul 10 15:54:24 devstack sudo[94215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:54:24 devstack sudo[94211]: pam_unix(sudo:session): session closed for user root Jul 10 15:54:24 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-5b1b709d-2f40-44ff-8765-6fc67192b387 tempest-ServerActionsTestOtherA-1627818978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3282387e-9817-4aa9-9920-a817fca74afa" returned: 0 in 0.715s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:54:24 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-5b1b709d-2f40-44ff-8765-6fc67192b387 tempest-ServerActionsTestOtherA-1627818978 None] Lock "cinder-quobyte-3282387e-9817-4aa9-9920-a817fca74afa" released by "delete_volume" :: held 1.701s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:54:25 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-5b1b709d-2f40-44ff-8765-6fc67192b387 tempest-ServerActionsTestOtherA-1627818978 None] Created reservations ['3d6297bd-9b63-4125-9de1-c06e3d086497', '1832a4a5-5ddf-45d1-9d6e-caf2efb2444d', '56562060-d531-4d0f-9672-9e7520f3dadc', '75ac7e1a-28cf-4bbf-861a-836478f6a2a0'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 15:54:25 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-5b1b709d-2f40-44ff-8765-6fc67192b387 tempest-ServerActionsTestOtherA-1627818978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:54:25 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-5b1b709d-2f40-44ff-8765-6fc67192b387 tempest-ServerActionsTestOtherA-1627818978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:54:25 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-5b1b709d-2f40-44ff-8765-6fc67192b387 tempest-ServerActionsTestOtherA-1627818978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:54:25 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-5b1b709d-2f40-44ff-8765-6fc67192b387 tempest-ServerActionsTestOtherA-1627818978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:54:25 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-5b1b709d-2f40-44ff-8765-6fc67192b387 tempest-ServerActionsTestOtherA-1627818978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:54:25 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-5b1b709d-2f40-44ff-8765-6fc67192b387 tempest-ServerActionsTestOtherA-1627818978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:54:25 devstack sudo[94215]: pam_unix(sudo:session): session closed for user root Jul 10 15:54:25 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-e87e01cb-db1a-4397-9424-9a1b44e0b051 tempest-VolumesTransfersV357Test-1238531960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3537b809-439c-4ff4-8bea-67948f4e80b0" returned: 0 in 0.670s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:54:25 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-e87e01cb-db1a-4397-9424-9a1b44e0b051 tempest-VolumesTransfersV357Test-1238531960 None] <== create_volume: return (1607ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 15:54:25 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-e87e01cb-db1a-4397-9424-9a1b44e0b051 tempest-VolumesTransfersV357Test-1238531960 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.610s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:54:25 devstack sudo[94219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 15:54:25 devstack sudo[94219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:54:25 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-e87e01cb-db1a-4397-9424-9a1b44e0b051 tempest-VolumesTransfersV357Test-1238531960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8237fecf-a003-498b-be83-35b5d2a5a74e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3537b809-439c-4ff4-8bea-67948f4e80b0', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:54:25 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-e87e01cb-db1a-4397-9424-9a1b44e0b051 tempest-VolumesTransfersV357Test-1238531960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a172788-5055-4158-9a52-cc6f293b6d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:54:25 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-e87e01cb-db1a-4397-9424-9a1b44e0b051 tempest-VolumesTransfersV357Test-1238531960 None] Volume volume-3537b809-439c-4ff4-8bea-67948f4e80b0 (3537b809-439c-4ff4-8bea-67948f4e80b0): created successfully Jul 10 15:54:25 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-e87e01cb-db1a-4397-9424-9a1b44e0b051 tempest-VolumesTransfersV357Test-1238531960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a172788-5055-4158-9a52-cc6f293b6d92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:54:25 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-e87e01cb-db1a-4397-9424-9a1b44e0b051 tempest-VolumesTransfersV357Test-1238531960 None] Flow 'volume_create_manager' (1d819194-6734-493a-9054-76e417356e4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:54:25 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-e87e01cb-db1a-4397-9424-9a1b44e0b051 tempest-VolumesTransfersV357Test-1238531960 None] Created volume successfully. Jul 10 15:54:26 devstack sudo[94219]: pam_unix(sudo:session): session closed for user root Jul 10 15:54:26 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-5b1b709d-2f40-44ff-8765-6fc67192b387 tempest-ServerActionsTestOtherA-1627818978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 1.122s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:54:26 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-5b1b709d-2f40-44ff-8765-6fc67192b387 tempest-ServerActionsTestOtherA-1627818978 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 15:54:26 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-5b1b709d-2f40-44ff-8765-6fc67192b387 tempest-ServerActionsTestOtherA-1627818978 None] Deleted volume successfully. Jul 10 15:54:26 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-5b1b709d-2f40-44ff-8765-6fc67192b387 tempest-ServerActionsTestOtherA-1627818978 None] Lock "cinder-3282387e-9817-4aa9-9920-a817fca74afa-delete_volume" released by "delete_volume" :: held 3.102s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:54:26 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-5117d53a-ae28-4900-b771-c1ab974895e9 tempest-VolumesTransfersV357Test-985855943 None] Transfer volume completed successfully. Jul 10 15:54:27 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-e1ba5289-eaf1-4ff1-ac30-1ef49c51699e tempest-VolumesTransfersV357Test-462092560 None] Acquiring lock "cinder-3537b809-439c-4ff4-8bea-67948f4e80b0-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:54:28 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-e1ba5289-eaf1-4ff1-ac30-1ef49c51699e tempest-VolumesTransfersV357Test-462092560 None] Lock "cinder-3537b809-439c-4ff4-8bea-67948f4e80b0-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:54:28 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-e1ba5289-eaf1-4ff1-ac30-1ef49c51699e tempest-VolumesTransfersV357Test-462092560 None] Acquiring lock "cinder-quobyte-3537b809-439c-4ff4-8bea-67948f4e80b0" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:54:28 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-e1ba5289-eaf1-4ff1-ac30-1ef49c51699e tempest-VolumesTransfersV357Test-462092560 None] Lock "cinder-quobyte-3537b809-439c-4ff4-8bea-67948f4e80b0" acquired by "delete_volume" :: waited 0.029s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:54:28 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[61fe9e62-8dc2-40b6-bfb6-a77996db484f]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:54:28 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-e1ba5289-eaf1-4ff1-ac30-1ef49c51699e tempest-VolumesTransfersV357Test-462092560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3537b809-439c-4ff4-8bea-67948f4e80b0 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:54:28 devstack sudo[94282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3537b809-439c-4ff4-8bea-67948f4e80b0 Jul 10 15:54:28 devstack sudo[94282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:54:29 devstack sudo[94282]: pam_unix(sudo:session): session closed for user root Jul 10 15:54:29 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-e1ba5289-eaf1-4ff1-ac30-1ef49c51699e tempest-VolumesTransfersV357Test-462092560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3537b809-439c-4ff4-8bea-67948f4e80b0" returned: 0 in 1.294s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:54:29 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-e1ba5289-eaf1-4ff1-ac30-1ef49c51699e tempest-VolumesTransfersV357Test-462092560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3537b809-439c-4ff4-8bea-67948f4e80b0 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:54:29 devstack sudo[94309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3537b809-439c-4ff4-8bea-67948f4e80b0 Jul 10 15:54:29 devstack sudo[94309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:54:30 devstack sudo[94309]: pam_unix(sudo:session): session closed for user root Jul 10 15:54:30 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-e1ba5289-eaf1-4ff1-ac30-1ef49c51699e tempest-VolumesTransfersV357Test-462092560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3537b809-439c-4ff4-8bea-67948f4e80b0" returned: 0 in 1.033s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:54:30 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-e1ba5289-eaf1-4ff1-ac30-1ef49c51699e tempest-VolumesTransfersV357Test-462092560 None] Lock "cinder-quobyte-3537b809-439c-4ff4-8bea-67948f4e80b0" released by "delete_volume" :: held 2.410s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:54:30 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-e1ba5289-eaf1-4ff1-ac30-1ef49c51699e tempest-VolumesTransfersV357Test-462092560 None] Created reservations ['8b5c6305-55c2-4aec-98ce-3f76bfac4078', '38a3df7d-1df5-432c-b8cf-2000669d4c48', '2079b211-7781-4084-a614-e38c52a214f9', 'ed345067-f9b9-44ca-b707-4192406aa032'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 15:54:30 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-e1ba5289-eaf1-4ff1-ac30-1ef49c51699e tempest-VolumesTransfersV357Test-462092560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:54:30 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-e1ba5289-eaf1-4ff1-ac30-1ef49c51699e tempest-VolumesTransfersV357Test-462092560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:54:30 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-e1ba5289-eaf1-4ff1-ac30-1ef49c51699e tempest-VolumesTransfersV357Test-462092560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:54:30 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-e1ba5289-eaf1-4ff1-ac30-1ef49c51699e tempest-VolumesTransfersV357Test-462092560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:54:30 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-e1ba5289-eaf1-4ff1-ac30-1ef49c51699e tempest-VolumesTransfersV357Test-462092560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:54:30 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-e1ba5289-eaf1-4ff1-ac30-1ef49c51699e tempest-VolumesTransfersV357Test-462092560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:54:30 devstack sudo[94333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 15:54:30 devstack sudo[94333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:54:31 devstack sudo[94333]: pam_unix(sudo:session): session closed for user root Jul 10 15:54:31 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-e1ba5289-eaf1-4ff1-ac30-1ef49c51699e tempest-VolumesTransfersV357Test-462092560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.669s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:54:31 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-e1ba5289-eaf1-4ff1-ac30-1ef49c51699e tempest-VolumesTransfersV357Test-462092560 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 15:54:31 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-e1ba5289-eaf1-4ff1-ac30-1ef49c51699e tempest-VolumesTransfersV357Test-462092560 None] Deleted volume successfully. Jul 10 15:54:31 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-e1ba5289-eaf1-4ff1-ac30-1ef49c51699e tempest-VolumesTransfersV357Test-462092560 None] Lock "cinder-3537b809-439c-4ff4-8bea-67948f4e80b0-delete_volume" released by "delete_volume" :: held 3.381s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:54:31 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-eedf2599-cef5-4efa-9b77-4b62e01d8654 tempest-VolumesTransfersV357Test-1238531960 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 15:54:31 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-eedf2599-cef5-4efa-9b77-4b62e01d8654 tempest-VolumesTransfersV357Test-1238531960 None] Flow 'volume_create_manager' (cd8c0a99-01fd-4fb4-af71-8fcbb97afb1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:54:31 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-eedf2599-cef5-4efa-9b77-4b62e01d8654 tempest-VolumesTransfersV357Test-1238531960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e708acd-7531-4519-925b-a3b4da8c133a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:54:32 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-eedf2599-cef5-4efa-9b77-4b62e01d8654 tempest-VolumesTransfersV357Test-1238531960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e708acd-7531-4519-925b-a3b4da8c133a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:54:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1680162443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d4bb381-e557-4e55-bca8-f8eeb4fcc0d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e15d0aab9924529a2c2ff3d67134f3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:54:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:54:32Z,use_quota=True,user_id='b63031af1aac4766b47dfba9ddd6c3df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:54:32 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-eedf2599-cef5-4efa-9b77-4b62e01d8654 tempest-VolumesTransfersV357Test-1238531960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67554704-c7c4-4ef4-afea-880adb82883e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:54:32 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-eedf2599-cef5-4efa-9b77-4b62e01d8654 tempest-VolumesTransfersV357Test-1238531960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67554704-c7c4-4ef4-afea-880adb82883e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:54:32 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-eedf2599-cef5-4efa-9b77-4b62e01d8654 tempest-VolumesTransfersV357Test-1238531960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbf1eb43-4736-4160-a94f-e436ae78efe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:54:32 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-eedf2599-cef5-4efa-9b77-4b62e01d8654 tempest-VolumesTransfersV357Test-1238531960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbf1eb43-4736-4160-a94f-e436ae78efe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d4bb381-e557-4e55-bca8-f8eeb4fcc0d2', 'volume_name': 'volume-8d4bb381-e557-4e55-bca8-f8eeb4fcc0d2', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:54:32 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-eedf2599-cef5-4efa-9b77-4b62e01d8654 tempest-VolumesTransfersV357Test-1238531960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b746c3e7-2c6f-45f0-8484-41e27eff7ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:54:32 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-eedf2599-cef5-4efa-9b77-4b62e01d8654 tempest-VolumesTransfersV357Test-1238531960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b746c3e7-2c6f-45f0-8484-41e27eff7ec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:54:32 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-eedf2599-cef5-4efa-9b77-4b62e01d8654 tempest-VolumesTransfersV357Test-1238531960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d669654-9e30-4e9c-b00a-a81cecdbb5a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:54:32 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-eedf2599-cef5-4efa-9b77-4b62e01d8654 tempest-VolumesTransfersV357Test-1238531960 None] Volume 8d4bb381-e557-4e55-bca8-f8eeb4fcc0d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d4bb381-e557-4e55-bca8-f8eeb4fcc0d2', 'volume_size': 1} Jul 10 15:54:32 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-eedf2599-cef5-4efa-9b77-4b62e01d8654 tempest-VolumesTransfersV357Test-1238531960 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:54:32 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-eedf2599-cef5-4efa-9b77-4b62e01d8654 tempest-VolumesTransfersV357Test-1238531960 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:54:32 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-eedf2599-cef5-4efa-9b77-4b62e01d8654 tempest-VolumesTransfersV357Test-1238531960 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:54:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1680162443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d4bb381-e557-4e55-bca8-f8eeb4fcc0d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e15d0aab9924529a2c2ff3d67134f3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:54:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:54:32Z,use_quota=True,user_id='b63031af1aac4766b47dfba9ddd6c3df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 15:54:32 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-eedf2599-cef5-4efa-9b77-4b62e01d8654 tempest-VolumesTransfersV357Test-1238531960 None] Creating volume 8d4bb381-e557-4e55-bca8-f8eeb4fcc0d2 {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 15:54:32 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-eedf2599-cef5-4efa-9b77-4b62e01d8654 tempest-VolumesTransfersV357Test-1238531960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:54:32 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-eedf2599-cef5-4efa-9b77-4b62e01d8654 tempest-VolumesTransfersV357Test-1238531960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:54:32 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-eedf2599-cef5-4efa-9b77-4b62e01d8654 tempest-VolumesTransfersV357Test-1238531960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:54:32 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-eedf2599-cef5-4efa-9b77-4b62e01d8654 tempest-VolumesTransfersV357Test-1238531960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:54:32 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-eedf2599-cef5-4efa-9b77-4b62e01d8654 tempest-VolumesTransfersV357Test-1238531960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:54:32 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-eedf2599-cef5-4efa-9b77-4b62e01d8654 tempest-VolumesTransfersV357Test-1238531960 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 15:54:32 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-eedf2599-cef5-4efa-9b77-4b62e01d8654 tempest-VolumesTransfersV357Test-1238531960 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 15:54:32 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-eedf2599-cef5-4efa-9b77-4b62e01d8654 tempest-VolumesTransfersV357Test-1238531960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-8d4bb381-e557-4e55-bca8-f8eeb4fcc0d2 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:54:32 devstack sudo[94337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-8d4bb381-e557-4e55-bca8-f8eeb4fcc0d2 1073741824 Jul 10 15:54:32 devstack sudo[94337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:54:32 devstack sudo[94337]: pam_unix(sudo:session): session closed for user root Jul 10 15:54:32 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-eedf2599-cef5-4efa-9b77-4b62e01d8654 tempest-VolumesTransfersV357Test-1238531960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-8d4bb381-e557-4e55-bca8-f8eeb4fcc0d2 1073741824" returned: 0 in 0.901s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:54:32 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-eedf2599-cef5-4efa-9b77-4b62e01d8654 tempest-VolumesTransfersV357Test-1238531960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-8d4bb381-e557-4e55-bca8-f8eeb4fcc0d2 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:54:33 devstack sudo[94345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-8d4bb381-e557-4e55-bca8-f8eeb4fcc0d2 Jul 10 15:54:33 devstack sudo[94345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:54:33 devstack sudo[94345]: pam_unix(sudo:session): session closed for user root Jul 10 15:54:33 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-eedf2599-cef5-4efa-9b77-4b62e01d8654 tempest-VolumesTransfersV357Test-1238531960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-8d4bb381-e557-4e55-bca8-f8eeb4fcc0d2" returned: 0 in 0.641s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:54:33 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-eedf2599-cef5-4efa-9b77-4b62e01d8654 tempest-VolumesTransfersV357Test-1238531960 None] <== create_volume: return (1584ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 15:54:33 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-eedf2599-cef5-4efa-9b77-4b62e01d8654 tempest-VolumesTransfersV357Test-1238531960 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.586s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:54:33 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-eedf2599-cef5-4efa-9b77-4b62e01d8654 tempest-VolumesTransfersV357Test-1238531960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d669654-9e30-4e9c-b00a-a81cecdbb5a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d4bb381-e557-4e55-bca8-f8eeb4fcc0d2', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:54:33 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-eedf2599-cef5-4efa-9b77-4b62e01d8654 tempest-VolumesTransfersV357Test-1238531960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (637e5391-9003-4c17-a660-940fcf015192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:54:33 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-eedf2599-cef5-4efa-9b77-4b62e01d8654 tempest-VolumesTransfersV357Test-1238531960 None] Volume volume-8d4bb381-e557-4e55-bca8-f8eeb4fcc0d2 (8d4bb381-e557-4e55-bca8-f8eeb4fcc0d2): created successfully Jul 10 15:54:33 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-eedf2599-cef5-4efa-9b77-4b62e01d8654 tempest-VolumesTransfersV357Test-1238531960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (637e5391-9003-4c17-a660-940fcf015192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:54:33 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-eedf2599-cef5-4efa-9b77-4b62e01d8654 tempest-VolumesTransfersV357Test-1238531960 None] Flow 'volume_create_manager' (cd8c0a99-01fd-4fb4-af71-8fcbb97afb1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:54:33 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-eedf2599-cef5-4efa-9b77-4b62e01d8654 tempest-VolumesTransfersV357Test-1238531960 None] Created volume successfully. Jul 10 15:54:34 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-19bc1e2e-5965-410d-bbd6-46ecde7d3d11 tempest-VolumesTransfersV357Test-462092560 None] Acquiring lock "cinder-8d4bb381-e557-4e55-bca8-f8eeb4fcc0d2-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:54:34 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-19bc1e2e-5965-410d-bbd6-46ecde7d3d11 tempest-VolumesTransfersV357Test-462092560 None] Lock "cinder-8d4bb381-e557-4e55-bca8-f8eeb4fcc0d2-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:54:34 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-19bc1e2e-5965-410d-bbd6-46ecde7d3d11 tempest-VolumesTransfersV357Test-462092560 None] Acquiring lock "cinder-quobyte-8d4bb381-e557-4e55-bca8-f8eeb4fcc0d2" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:54:34 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-19bc1e2e-5965-410d-bbd6-46ecde7d3d11 tempest-VolumesTransfersV357Test-462092560 None] Lock "cinder-quobyte-8d4bb381-e557-4e55-bca8-f8eeb4fcc0d2" acquired by "delete_volume" :: waited 0.021s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:54:34 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[12db1ebb-eead-49b6-ba3b-8fa77801c283]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:54:34 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-19bc1e2e-5965-410d-bbd6-46ecde7d3d11 tempest-VolumesTransfersV357Test-462092560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-8d4bb381-e557-4e55-bca8-f8eeb4fcc0d2 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:54:34 devstack sudo[94348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-8d4bb381-e557-4e55-bca8-f8eeb4fcc0d2 Jul 10 15:54:34 devstack sudo[94348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:54:35 devstack sudo[94348]: pam_unix(sudo:session): session closed for user root Jul 10 15:54:35 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-19bc1e2e-5965-410d-bbd6-46ecde7d3d11 tempest-VolumesTransfersV357Test-462092560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-8d4bb381-e557-4e55-bca8-f8eeb4fcc0d2" returned: 0 in 0.819s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:54:35 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-19bc1e2e-5965-410d-bbd6-46ecde7d3d11 tempest-VolumesTransfersV357Test-462092560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-8d4bb381-e557-4e55-bca8-f8eeb4fcc0d2 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:54:35 devstack sudo[94353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-8d4bb381-e557-4e55-bca8-f8eeb4fcc0d2 Jul 10 15:54:35 devstack sudo[94353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:54:36 devstack sudo[94353]: pam_unix(sudo:session): session closed for user root Jul 10 15:54:36 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-19bc1e2e-5965-410d-bbd6-46ecde7d3d11 tempest-VolumesTransfersV357Test-462092560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-8d4bb381-e557-4e55-bca8-f8eeb4fcc0d2" returned: 0 in 0.733s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:54:36 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-19bc1e2e-5965-410d-bbd6-46ecde7d3d11 tempest-VolumesTransfersV357Test-462092560 None] Lock "cinder-quobyte-8d4bb381-e557-4e55-bca8-f8eeb4fcc0d2" released by "delete_volume" :: held 1.611s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:54:36 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-19bc1e2e-5965-410d-bbd6-46ecde7d3d11 tempest-VolumesTransfersV357Test-462092560 None] Created reservations ['0d376084-da45-4ee4-8ef0-d67bfb2894f7', 'd14d4944-06a3-45ce-82d4-f41e8fdf97f9', '94b9956f-9d80-4cbe-b645-41261cdc82b7', '17156420-a03c-4f3d-bb78-fa0507454e8a'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 15:54:36 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-19bc1e2e-5965-410d-bbd6-46ecde7d3d11 tempest-VolumesTransfersV357Test-462092560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:54:36 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-19bc1e2e-5965-410d-bbd6-46ecde7d3d11 tempest-VolumesTransfersV357Test-462092560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:54:36 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-19bc1e2e-5965-410d-bbd6-46ecde7d3d11 tempest-VolumesTransfersV357Test-462092560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:54:36 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-19bc1e2e-5965-410d-bbd6-46ecde7d3d11 tempest-VolumesTransfersV357Test-462092560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:54:36 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-19bc1e2e-5965-410d-bbd6-46ecde7d3d11 tempest-VolumesTransfersV357Test-462092560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:54:36 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-19bc1e2e-5965-410d-bbd6-46ecde7d3d11 tempest-VolumesTransfersV357Test-462092560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:54:36 devstack sudo[94356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 15:54:36 devstack sudo[94356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:54:37 devstack sudo[94356]: pam_unix(sudo:session): session closed for user root Jul 10 15:54:37 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-19bc1e2e-5965-410d-bbd6-46ecde7d3d11 tempest-VolumesTransfersV357Test-462092560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.910s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:54:37 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-19bc1e2e-5965-410d-bbd6-46ecde7d3d11 tempest-VolumesTransfersV357Test-462092560 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 15:54:37 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-19bc1e2e-5965-410d-bbd6-46ecde7d3d11 tempest-VolumesTransfersV357Test-462092560 None] Deleted volume successfully. Jul 10 15:54:37 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-19bc1e2e-5965-410d-bbd6-46ecde7d3d11 tempest-VolumesTransfersV357Test-462092560 None] Lock "cinder-8d4bb381-e557-4e55-bca8-f8eeb4fcc0d2-delete_volume" released by "delete_volume" :: held 2.785s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:54:41 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-46c141f1-880f-47e3-b61b-2ebc29eedef8 tempest-AttachVolumeNegativeTest-1493731096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 15:54:41 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-46c141f1-880f-47e3-b61b-2ebc29eedef8 tempest-AttachVolumeNegativeTest-1493731096 None] Flow 'volume_create_manager' (ab2c896d-3dd5-44a3-af70-f6f55f62241a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:54:41 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-46c141f1-880f-47e3-b61b-2ebc29eedef8 tempest-AttachVolumeNegativeTest-1493731096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f43413b9-7fd2-41f7-860a-13b910eacb9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:54:41 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-46c141f1-880f-47e3-b61b-2ebc29eedef8 tempest-AttachVolumeNegativeTest-1493731096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f43413b9-7fd2-41f7-860a-13b910eacb9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:54:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1697972184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dd4f338-20da-4557-b862-2ff5b19c12fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2952153f098f446c9a2a3feb2ece06da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:54:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:54:42Z,use_quota=True,user_id='144bbba7ccc243468434455811e8982f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:54:41 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-46c141f1-880f-47e3-b61b-2ebc29eedef8 tempest-AttachVolumeNegativeTest-1493731096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b33eafce-397e-4544-aebc-edc8f40666b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:54:41 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-46c141f1-880f-47e3-b61b-2ebc29eedef8 tempest-AttachVolumeNegativeTest-1493731096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b33eafce-397e-4544-aebc-edc8f40666b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:54:41 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-46c141f1-880f-47e3-b61b-2ebc29eedef8 tempest-AttachVolumeNegativeTest-1493731096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2c44a54-7608-4733-86da-12955fe98efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:54:41 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-46c141f1-880f-47e3-b61b-2ebc29eedef8 tempest-AttachVolumeNegativeTest-1493731096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2c44a54-7608-4733-86da-12955fe98efd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7dd4f338-20da-4557-b862-2ff5b19c12fb', 'volume_name': 'volume-7dd4f338-20da-4557-b862-2ff5b19c12fb', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:54:41 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-46c141f1-880f-47e3-b61b-2ebc29eedef8 tempest-AttachVolumeNegativeTest-1493731096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2b8d93f-6a53-47df-9cd2-435fe3a923b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:54:41 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-46c141f1-880f-47e3-b61b-2ebc29eedef8 tempest-AttachVolumeNegativeTest-1493731096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2b8d93f-6a53-47df-9cd2-435fe3a923b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:54:41 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-46c141f1-880f-47e3-b61b-2ebc29eedef8 tempest-AttachVolumeNegativeTest-1493731096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87d64f39-ab78-476e-b53a-82ea64523144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:54:41 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-46c141f1-880f-47e3-b61b-2ebc29eedef8 tempest-AttachVolumeNegativeTest-1493731096 None] Volume 7dd4f338-20da-4557-b862-2ff5b19c12fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7dd4f338-20da-4557-b862-2ff5b19c12fb', 'volume_size': 1} Jul 10 15:54:41 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-46c141f1-880f-47e3-b61b-2ebc29eedef8 tempest-AttachVolumeNegativeTest-1493731096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:54:41 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-46c141f1-880f-47e3-b61b-2ebc29eedef8 tempest-AttachVolumeNegativeTest-1493731096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:54:41 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-46c141f1-880f-47e3-b61b-2ebc29eedef8 tempest-AttachVolumeNegativeTest-1493731096 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:54:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1697972184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dd4f338-20da-4557-b862-2ff5b19c12fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2952153f098f446c9a2a3feb2ece06da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:54:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:54:42Z,use_quota=True,user_id='144bbba7ccc243468434455811e8982f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 15:54:41 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-46c141f1-880f-47e3-b61b-2ebc29eedef8 tempest-AttachVolumeNegativeTest-1493731096 None] Creating volume 7dd4f338-20da-4557-b862-2ff5b19c12fb {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 15:54:41 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-46c141f1-880f-47e3-b61b-2ebc29eedef8 tempest-AttachVolumeNegativeTest-1493731096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:54:41 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-46c141f1-880f-47e3-b61b-2ebc29eedef8 tempest-AttachVolumeNegativeTest-1493731096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:54:41 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-46c141f1-880f-47e3-b61b-2ebc29eedef8 tempest-AttachVolumeNegativeTest-1493731096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:54:41 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-46c141f1-880f-47e3-b61b-2ebc29eedef8 tempest-AttachVolumeNegativeTest-1493731096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:54:41 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-46c141f1-880f-47e3-b61b-2ebc29eedef8 tempest-AttachVolumeNegativeTest-1493731096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:54:41 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-46c141f1-880f-47e3-b61b-2ebc29eedef8 tempest-AttachVolumeNegativeTest-1493731096 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 15:54:41 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-46c141f1-880f-47e3-b61b-2ebc29eedef8 tempest-AttachVolumeNegativeTest-1493731096 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 15:54:41 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-46c141f1-880f-47e3-b61b-2ebc29eedef8 tempest-AttachVolumeNegativeTest-1493731096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7dd4f338-20da-4557-b862-2ff5b19c12fb 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:54:41 devstack sudo[94367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7dd4f338-20da-4557-b862-2ff5b19c12fb 1073741824 Jul 10 15:54:41 devstack sudo[94367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:54:42 devstack sudo[94367]: pam_unix(sudo:session): session closed for user root Jul 10 15:54:42 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-46c141f1-880f-47e3-b61b-2ebc29eedef8 tempest-AttachVolumeNegativeTest-1493731096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7dd4f338-20da-4557-b862-2ff5b19c12fb 1073741824" returned: 0 in 1.026s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:54:42 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-46c141f1-880f-47e3-b61b-2ebc29eedef8 tempest-AttachVolumeNegativeTest-1493731096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7dd4f338-20da-4557-b862-2ff5b19c12fb {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:54:42 devstack sudo[94374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7dd4f338-20da-4557-b862-2ff5b19c12fb Jul 10 15:54:42 devstack sudo[94374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:54:43 devstack sudo[94374]: pam_unix(sudo:session): session closed for user root Jul 10 15:54:43 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-46c141f1-880f-47e3-b61b-2ebc29eedef8 tempest-AttachVolumeNegativeTest-1493731096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7dd4f338-20da-4557-b862-2ff5b19c12fb" returned: 0 in 0.755s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:54:43 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-46c141f1-880f-47e3-b61b-2ebc29eedef8 tempest-AttachVolumeNegativeTest-1493731096 None] <== create_volume: return (1832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 15:54:43 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-46c141f1-880f-47e3-b61b-2ebc29eedef8 tempest-AttachVolumeNegativeTest-1493731096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.834s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:54:43 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-46c141f1-880f-47e3-b61b-2ebc29eedef8 tempest-AttachVolumeNegativeTest-1493731096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87d64f39-ab78-476e-b53a-82ea64523144) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7dd4f338-20da-4557-b862-2ff5b19c12fb', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:54:43 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-46c141f1-880f-47e3-b61b-2ebc29eedef8 tempest-AttachVolumeNegativeTest-1493731096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e6b114f-6af7-4815-b4e9-ebb220399960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:54:43 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-46c141f1-880f-47e3-b61b-2ebc29eedef8 tempest-AttachVolumeNegativeTest-1493731096 None] Volume volume-7dd4f338-20da-4557-b862-2ff5b19c12fb (7dd4f338-20da-4557-b862-2ff5b19c12fb): created successfully Jul 10 15:54:43 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-46c141f1-880f-47e3-b61b-2ebc29eedef8 tempest-AttachVolumeNegativeTest-1493731096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e6b114f-6af7-4815-b4e9-ebb220399960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:54:43 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-46c141f1-880f-47e3-b61b-2ebc29eedef8 tempest-AttachVolumeNegativeTest-1493731096 None] Flow 'volume_create_manager' (ab2c896d-3dd5-44a3-af70-f6f55f62241a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:54:43 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-46c141f1-880f-47e3-b61b-2ebc29eedef8 tempest-AttachVolumeNegativeTest-1493731096 None] Created volume successfully. Jul 10 15:54:43 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [req-2591a310-8537-4f01-974e-6a506478a2df req-261ac346-9e26-470c-85a6-24e4b26d22a1 tempest-VolumesGetTestJSON-1539891603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 15:54:43 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [req-2591a310-8537-4f01-974e-6a506478a2df req-261ac346-9e26-470c-85a6-24e4b26d22a1 tempest-VolumesGetTestJSON-1539891603 None] Flow 'volume_create_manager' (24d4504c-3e37-477c-a6f4-d39af733e48d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:54:43 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [req-2591a310-8537-4f01-974e-6a506478a2df req-261ac346-9e26-470c-85a6-24e4b26d22a1 tempest-VolumesGetTestJSON-1539891603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6aa58068-fdea-40b9-8cfd-5a37574f25c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:54:43 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [req-2591a310-8537-4f01-974e-6a506478a2df req-261ac346-9e26-470c-85a6-24e4b26d22a1 tempest-VolumesGetTestJSON-1539891603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6aa58068-fdea-40b9-8cfd-5a37574f25c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:54:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-2093247826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=477895e8-478c-46c1-afab-85b374470df4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='77a94cd188664c8ba60a291d795e419f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:54:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:54:44Z,use_quota=True,user_id='715905ccb50342768514eb3f32395982',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:54:43 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [req-2591a310-8537-4f01-974e-6a506478a2df req-261ac346-9e26-470c-85a6-24e4b26d22a1 tempest-VolumesGetTestJSON-1539891603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (927dd832-073e-4088-acbd-9ea0a414ee19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:54:43 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [req-2591a310-8537-4f01-974e-6a506478a2df req-261ac346-9e26-470c-85a6-24e4b26d22a1 tempest-VolumesGetTestJSON-1539891603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (927dd832-073e-4088-acbd-9ea0a414ee19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:54:43 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [req-2591a310-8537-4f01-974e-6a506478a2df req-261ac346-9e26-470c-85a6-24e4b26d22a1 tempest-VolumesGetTestJSON-1539891603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1cbf264-412a-4aa1-9b1f-3ffaac9993bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:54:43 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [req-2591a310-8537-4f01-974e-6a506478a2df req-261ac346-9e26-470c-85a6-24e4b26d22a1 tempest-VolumesGetTestJSON-1539891603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1cbf264-412a-4aa1-9b1f-3ffaac9993bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '477895e8-478c-46c1-afab-85b374470df4', 'volume_name': 'volume-477895e8-478c-46c1-afab-85b374470df4', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:54:43 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [req-2591a310-8537-4f01-974e-6a506478a2df req-261ac346-9e26-470c-85a6-24e4b26d22a1 tempest-VolumesGetTestJSON-1539891603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a52f813-8131-4cf1-bab1-08526de0aece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:54:43 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [req-2591a310-8537-4f01-974e-6a506478a2df req-261ac346-9e26-470c-85a6-24e4b26d22a1 tempest-VolumesGetTestJSON-1539891603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a52f813-8131-4cf1-bab1-08526de0aece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:54:43 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [req-2591a310-8537-4f01-974e-6a506478a2df req-261ac346-9e26-470c-85a6-24e4b26d22a1 tempest-VolumesGetTestJSON-1539891603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c037985a-2478-4b3e-8053-fda831288adb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:54:43 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [req-2591a310-8537-4f01-974e-6a506478a2df req-261ac346-9e26-470c-85a6-24e4b26d22a1 tempest-VolumesGetTestJSON-1539891603 None] Volume 477895e8-478c-46c1-afab-85b374470df4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-477895e8-478c-46c1-afab-85b374470df4', 'volume_size': 1} Jul 10 15:54:43 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [req-2591a310-8537-4f01-974e-6a506478a2df req-261ac346-9e26-470c-85a6-24e4b26d22a1 tempest-VolumesGetTestJSON-1539891603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:54:43 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [req-2591a310-8537-4f01-974e-6a506478a2df req-261ac346-9e26-470c-85a6-24e4b26d22a1 tempest-VolumesGetTestJSON-1539891603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:54:43 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [req-2591a310-8537-4f01-974e-6a506478a2df req-261ac346-9e26-470c-85a6-24e4b26d22a1 tempest-VolumesGetTestJSON-1539891603 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:54:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-2093247826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=477895e8-478c-46c1-afab-85b374470df4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='77a94cd188664c8ba60a291d795e419f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:54:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:54:44Z,use_quota=True,user_id='715905ccb50342768514eb3f32395982',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 15:54:43 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [req-2591a310-8537-4f01-974e-6a506478a2df req-261ac346-9e26-470c-85a6-24e4b26d22a1 tempest-VolumesGetTestJSON-1539891603 None] Creating volume 477895e8-478c-46c1-afab-85b374470df4 {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 15:54:43 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [req-2591a310-8537-4f01-974e-6a506478a2df req-261ac346-9e26-470c-85a6-24e4b26d22a1 tempest-VolumesGetTestJSON-1539891603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:54:43 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [req-2591a310-8537-4f01-974e-6a506478a2df req-261ac346-9e26-470c-85a6-24e4b26d22a1 tempest-VolumesGetTestJSON-1539891603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:54:43 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [req-2591a310-8537-4f01-974e-6a506478a2df req-261ac346-9e26-470c-85a6-24e4b26d22a1 tempest-VolumesGetTestJSON-1539891603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:54:43 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [req-2591a310-8537-4f01-974e-6a506478a2df req-261ac346-9e26-470c-85a6-24e4b26d22a1 tempest-VolumesGetTestJSON-1539891603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:54:43 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [req-2591a310-8537-4f01-974e-6a506478a2df req-261ac346-9e26-470c-85a6-24e4b26d22a1 tempest-VolumesGetTestJSON-1539891603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:54:43 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [req-2591a310-8537-4f01-974e-6a506478a2df req-261ac346-9e26-470c-85a6-24e4b26d22a1 tempest-VolumesGetTestJSON-1539891603 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 15:54:43 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [req-2591a310-8537-4f01-974e-6a506478a2df req-261ac346-9e26-470c-85a6-24e4b26d22a1 tempest-VolumesGetTestJSON-1539891603 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 15:54:43 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [req-2591a310-8537-4f01-974e-6a506478a2df req-261ac346-9e26-470c-85a6-24e4b26d22a1 tempest-VolumesGetTestJSON-1539891603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-477895e8-478c-46c1-afab-85b374470df4 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:54:43 devstack sudo[94377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-477895e8-478c-46c1-afab-85b374470df4 1073741824 Jul 10 15:54:43 devstack sudo[94377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:54:44 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-f317d0c5-e472-4dbf-bc78-6eea41da1e64 tempest-VolumesExtendTest-811549292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 15:54:44 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f317d0c5-e472-4dbf-bc78-6eea41da1e64 tempest-VolumesExtendTest-811549292 None] Flow 'volume_create_manager' (a6d81dbe-bddd-4503-be64-cfba2e9003e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:54:44 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f317d0c5-e472-4dbf-bc78-6eea41da1e64 tempest-VolumesExtendTest-811549292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (698290cd-13b6-4d6c-9a84-9930e0fdb64b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:54:44 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f317d0c5-e472-4dbf-bc78-6eea41da1e64 tempest-VolumesExtendTest-811549292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (698290cd-13b6-4d6c-9a84-9930e0fdb64b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:54:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2015413813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d94f0061-bdaf-44d3-9e38-8b058ced9c91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5362398080014ae5a37b592fe4c11c0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:54:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:54:45Z,use_quota=True,user_id='f5eae745be434bf3b29491898558a731',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:54:44 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f317d0c5-e472-4dbf-bc78-6eea41da1e64 tempest-VolumesExtendTest-811549292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5297656-c2be-4bc7-b1f3-fd076fbbf43c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:54:44 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f317d0c5-e472-4dbf-bc78-6eea41da1e64 tempest-VolumesExtendTest-811549292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5297656-c2be-4bc7-b1f3-fd076fbbf43c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:54:44 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f317d0c5-e472-4dbf-bc78-6eea41da1e64 tempest-VolumesExtendTest-811549292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c0648a0-c763-4b3f-a92f-58a76fbf8894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:54:44 devstack cinder-volume[87420]: DEBUG cinder.image.glance [None req-f317d0c5-e472-4dbf-bc78-6eea41da1e64 tempest-VolumesExtendTest-811549292 None] Creating Keystone auth plugin from conf {{(pid=87420) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 10 15:54:44 devstack sudo[94377]: pam_unix(sudo:session): session closed for user root Jul 10 15:54:44 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [req-2591a310-8537-4f01-974e-6a506478a2df req-261ac346-9e26-470c-85a6-24e4b26d22a1 tempest-VolumesGetTestJSON-1539891603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-477895e8-478c-46c1-afab-85b374470df4 1073741824" returned: 0 in 1.000s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:54:44 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [req-2591a310-8537-4f01-974e-6a506478a2df req-261ac346-9e26-470c-85a6-24e4b26d22a1 tempest-VolumesGetTestJSON-1539891603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-477895e8-478c-46c1-afab-85b374470df4 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:54:44 devstack sudo[94389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-477895e8-478c-46c1-afab-85b374470df4 Jul 10 15:54:44 devstack sudo[94389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:54:45 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f317d0c5-e472-4dbf-bc78-6eea41da1e64 tempest-VolumesExtendTest-811549292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c0648a0-c763-4b3f-a92f-58a76fbf8894) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd94f0061-bdaf-44d3-9e38-8b058ced9c91', 'volume_name': 'volume-d94f0061-bdaf-44d3-9e38-8b058ced9c91', 'volume_size': 1, 'image_id': '980bf5e0-e973-48f3-bc1f-383f924c4467', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/980bf5e0-e973-48f3-bc1f-383f924c4467', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'de9cf234f3774db489ed55d5afcfc7bf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '980bf5e0-e973-48f3-bc1f-383f924c4467', 'created_at': datetime.datetime(2026, 7, 10, 13, 42, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 13, 42, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/980bf5e0-e973-48f3-bc1f-383f924c4467/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:54:45 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f317d0c5-e472-4dbf-bc78-6eea41da1e64 tempest-VolumesExtendTest-811549292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58168f02-a774-4345-9067-cff0c0659b62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:54:45 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f317d0c5-e472-4dbf-bc78-6eea41da1e64 tempest-VolumesExtendTest-811549292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58168f02-a774-4345-9067-cff0c0659b62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:54:45 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f317d0c5-e472-4dbf-bc78-6eea41da1e64 tempest-VolumesExtendTest-811549292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e6a92fb-5bca-4168-9cde-8f909faec1c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:54:45 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-f317d0c5-e472-4dbf-bc78-6eea41da1e64 tempest-VolumesExtendTest-811549292 None] Volume d94f0061-bdaf-44d3-9e38-8b058ced9c91: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d94f0061-bdaf-44d3-9e38-8b058ced9c91', 'volume_size': 1, 'image_id': '980bf5e0-e973-48f3-bc1f-383f924c4467', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/980bf5e0-e973-48f3-bc1f-383f924c4467', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'de9cf234f3774db489ed55d5afcfc7bf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '980bf5e0-e973-48f3-bc1f-383f924c4467', 'created_at': datetime.datetime(2026, 7, 10, 13, 42, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 13, 42, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/980bf5e0-e973-48f3-bc1f-383f924c4467/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 10 15:54:45 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-f317d0c5-e472-4dbf-bc78-6eea41da1e64 tempest-VolumesExtendTest-811549292 None] Trying to clone d94f0061-bdaf-44d3-9e38-8b058ced9c91 from image 980bf5e0-e973-48f3-bc1f-383f924c4467 at location (None, [{'url': 'file:///opt/stack/data/glance/images/980bf5e0-e973-48f3-bc1f-383f924c4467', 'metadata': {}}]). {{(pid=87420) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 10 15:54:45 devstack sudo[94389]: pam_unix(sudo:session): session closed for user root Jul 10 15:54:45 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [req-2591a310-8537-4f01-974e-6a506478a2df req-261ac346-9e26-470c-85a6-24e4b26d22a1 tempest-VolumesGetTestJSON-1539891603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-477895e8-478c-46c1-afab-85b374470df4" returned: 0 in 0.814s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:54:45 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [req-2591a310-8537-4f01-974e-6a506478a2df req-261ac346-9e26-470c-85a6-24e4b26d22a1 tempest-VolumesGetTestJSON-1539891603 None] <== create_volume: return (1881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 15:54:45 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [req-2591a310-8537-4f01-974e-6a506478a2df req-261ac346-9e26-470c-85a6-24e4b26d22a1 tempest-VolumesGetTestJSON-1539891603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.884s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:54:45 devstack cinder-volume[87420]: DEBUG cinder.image.image_utils [None req-f317d0c5-e472-4dbf-bc78-6eea41da1e64 tempest-VolumesExtendTest-811549292 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_980bf5e0-e973-48f3-bc1f-383f924c4467_dcj91p2tdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87420) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 10 15:54:45 devstack cinder-volume[87420]: INFO cinder.image.image_utils [None req-f317d0c5-e472-4dbf-bc78-6eea41da1e64 tempest-VolumesExtendTest-811549292 None] Image download 20.69 MB at 20.69 MB/s Jul 10 15:54:45 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [req-2591a310-8537-4f01-974e-6a506478a2df req-261ac346-9e26-470c-85a6-24e4b26d22a1 tempest-VolumesGetTestJSON-1539891603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c037985a-2478-4b3e-8053-fda831288adb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-477895e8-478c-46c1-afab-85b374470df4', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:54:45 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [req-2591a310-8537-4f01-974e-6a506478a2df req-261ac346-9e26-470c-85a6-24e4b26d22a1 tempest-VolumesGetTestJSON-1539891603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80b8673b-bbc7-4ee1-8b2f-400a01b20a1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:54:45 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[747a8526-169f-4e2d-969e-e6a12c9a98df]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:54:45 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f317d0c5-e472-4dbf-bc78-6eea41da1e64 tempest-VolumesExtendTest-811549292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_980bf5e0-e973-48f3-bc1f-383f924c4467_dcj91p2tdevstack@QuobyteHD {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:54:45 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [req-2591a310-8537-4f01-974e-6a506478a2df req-261ac346-9e26-470c-85a6-24e4b26d22a1 tempest-VolumesGetTestJSON-1539891603 None] Volume volume-477895e8-478c-46c1-afab-85b374470df4 (477895e8-478c-46c1-afab-85b374470df4): created successfully Jul 10 15:54:45 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [req-2591a310-8537-4f01-974e-6a506478a2df req-261ac346-9e26-470c-85a6-24e4b26d22a1 tempest-VolumesGetTestJSON-1539891603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80b8673b-bbc7-4ee1-8b2f-400a01b20a1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:54:45 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [req-2591a310-8537-4f01-974e-6a506478a2df req-261ac346-9e26-470c-85a6-24e4b26d22a1 tempest-VolumesGetTestJSON-1539891603 None] Flow 'volume_create_manager' (24d4504c-3e37-477c-a6f4-d39af733e48d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:54:45 devstack cinder-volume[87420]: INFO cinder.volume.manager [req-2591a310-8537-4f01-974e-6a506478a2df req-261ac346-9e26-470c-85a6-24e4b26d22a1 tempest-VolumesGetTestJSON-1539891603 None] Created volume successfully. Jul 10 15:54:46 devstack sudo[94417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_980bf5e0-e973-48f3-bc1f-383f924c4467_dcj91p2tdevstack@QuobyteHD Jul 10 15:54:46 devstack sudo[94417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:54:46 devstack cinder-volume[87420]: DEBUG cinder.coordination [req-8683ff15-e30d-493c-8628-d30a2cccf89b req-22342441-023e-45b8-9369-8481afb6c839 tempest-VolumesGetTestJSON-1539891603 None] Acquiring lock "cinder-477895e8-478c-46c1-afab-85b374470df4-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:54:46 devstack cinder-volume[87420]: DEBUG cinder.coordination [req-8683ff15-e30d-493c-8628-d30a2cccf89b req-22342441-023e-45b8-9369-8481afb6c839 tempest-VolumesGetTestJSON-1539891603 None] Lock "cinder-477895e8-478c-46c1-afab-85b374470df4-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:54:46 devstack sudo[94417]: pam_unix(sudo:session): session closed for user root Jul 10 15:54:46 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f317d0c5-e472-4dbf-bc78-6eea41da1e64 tempest-VolumesExtendTest-811549292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_980bf5e0-e973-48f3-bc1f-383f924c4467_dcj91p2tdevstack@QuobyteHD" returned: 0 in 0.847s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:54:46 devstack cinder-volume[87420]: DEBUG cinder.image.image_utils [None req-f317d0c5-e472-4dbf-bc78-6eea41da1e64 tempest-VolumesExtendTest-811549292 None] Temporary image 980bf5e0-e973-48f3-bc1f-383f924c4467 is fetched for user f5eae745be434bf3b29491898558a731. {{(pid=87420) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 10 15:54:46 devstack cinder-volume[87420]: DEBUG cinder.coordination [req-8683ff15-e30d-493c-8628-d30a2cccf89b req-22342441-023e-45b8-9369-8481afb6c839 tempest-VolumesGetTestJSON-1539891603 None] Acquiring lock "cinder-quobyte-477895e8-478c-46c1-afab-85b374470df4" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:54:46 devstack cinder-volume[87420]: DEBUG cinder.coordination [req-8683ff15-e30d-493c-8628-d30a2cccf89b req-22342441-023e-45b8-9369-8481afb6c839 tempest-VolumesGetTestJSON-1539891603 None] Lock "cinder-quobyte-477895e8-478c-46c1-afab-85b374470df4" acquired by "delete_volume" :: waited 0.027s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:54:46 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7c3fb04-11df-4065-9178-09908de9458a]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:54:46 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [req-8683ff15-e30d-493c-8628-d30a2cccf89b req-22342441-023e-45b8-9369-8481afb6c839 tempest-VolumesGetTestJSON-1539891603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-477895e8-478c-46c1-afab-85b374470df4 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:54:46 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[2136ddd1-2fb4-4203-a68e-4e5c5bba0237]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:54:46 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f317d0c5-e472-4dbf-bc78-6eea41da1e64 tempest-VolumesExtendTest-811549292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_980bf5e0-e973-48f3-bc1f-383f924c4467_dcj91p2tdevstack@QuobyteHD {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:54:46 devstack sudo[94423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-477895e8-478c-46c1-afab-85b374470df4 Jul 10 15:54:46 devstack sudo[94423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:54:47 devstack sudo[94424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_980bf5e0-e973-48f3-bc1f-383f924c4467_dcj91p2tdevstack@QuobyteHD Jul 10 15:54:47 devstack sudo[94424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:54:47 devstack sudo[94423]: pam_unix(sudo:session): session closed for user root Jul 10 15:54:47 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [req-8683ff15-e30d-493c-8628-d30a2cccf89b req-22342441-023e-45b8-9369-8481afb6c839 tempest-VolumesGetTestJSON-1539891603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-477895e8-478c-46c1-afab-85b374470df4" returned: 0 in 0.942s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:54:47 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [req-8683ff15-e30d-493c-8628-d30a2cccf89b req-22342441-023e-45b8-9369-8481afb6c839 tempest-VolumesGetTestJSON-1539891603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-477895e8-478c-46c1-afab-85b374470df4 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:54:47 devstack sudo[94447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-477895e8-478c-46c1-afab-85b374470df4 Jul 10 15:54:47 devstack sudo[94447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:54:47 devstack sudo[94424]: pam_unix(sudo:session): session closed for user root Jul 10 15:54:47 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f317d0c5-e472-4dbf-bc78-6eea41da1e64 tempest-VolumesExtendTest-811549292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_980bf5e0-e973-48f3-bc1f-383f924c4467_dcj91p2tdevstack@QuobyteHD" returned: 0 in 1.025s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:54:47 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-f317d0c5-e472-4dbf-bc78-6eea41da1e64 tempest-VolumesExtendTest-811549292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:54:47 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-f317d0c5-e472-4dbf-bc78-6eea41da1e64 tempest-VolumesExtendTest-811549292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:54:47 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-f317d0c5-e472-4dbf-bc78-6eea41da1e64 tempest-VolumesExtendTest-811549292 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:54:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2015413813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d94f0061-bdaf-44d3-9e38-8b058ced9c91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5362398080014ae5a37b592fe4c11c0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:54:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:54:45Z,use_quota=True,user_id='f5eae745be434bf3b29491898558a731',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 15:54:47 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-f317d0c5-e472-4dbf-bc78-6eea41da1e64 tempest-VolumesExtendTest-811549292 None] Creating volume d94f0061-bdaf-44d3-9e38-8b058ced9c91 {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 15:54:47 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-f317d0c5-e472-4dbf-bc78-6eea41da1e64 tempest-VolumesExtendTest-811549292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:54:47 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-f317d0c5-e472-4dbf-bc78-6eea41da1e64 tempest-VolumesExtendTest-811549292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:54:47 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-f317d0c5-e472-4dbf-bc78-6eea41da1e64 tempest-VolumesExtendTest-811549292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:54:47 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-f317d0c5-e472-4dbf-bc78-6eea41da1e64 tempest-VolumesExtendTest-811549292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:54:47 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-f317d0c5-e472-4dbf-bc78-6eea41da1e64 tempest-VolumesExtendTest-811549292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:54:47 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-f317d0c5-e472-4dbf-bc78-6eea41da1e64 tempest-VolumesExtendTest-811549292 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 15:54:47 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-f317d0c5-e472-4dbf-bc78-6eea41da1e64 tempest-VolumesExtendTest-811549292 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 15:54:47 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f317d0c5-e472-4dbf-bc78-6eea41da1e64 tempest-VolumesExtendTest-811549292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d94f0061-bdaf-44d3-9e38-8b058ced9c91 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:54:47 devstack sudo[94452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d94f0061-bdaf-44d3-9e38-8b058ced9c91 1073741824 Jul 10 15:54:47 devstack sudo[94452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:54:48 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [req-53ec87f9-17c9-41da-ab2d-81c212a21e57 req-fd5eaf5c-e6de-47b6-a7a5-84e8f9846250 tempest-AttachVolumeNegativeTest-1493731096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:54:48 devstack sudo[94447]: pam_unix(sudo:session): session closed for user root Jul 10 15:54:48 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [req-8683ff15-e30d-493c-8628-d30a2cccf89b req-22342441-023e-45b8-9369-8481afb6c839 tempest-VolumesGetTestJSON-1539891603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-477895e8-478c-46c1-afab-85b374470df4" returned: 0 in 0.679s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:54:48 devstack cinder-volume[87420]: DEBUG cinder.coordination [req-8683ff15-e30d-493c-8628-d30a2cccf89b req-22342441-023e-45b8-9369-8481afb6c839 tempest-VolumesGetTestJSON-1539891603 None] Lock "cinder-quobyte-477895e8-478c-46c1-afab-85b374470df4" released by "delete_volume" :: held 1.700s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:54:48 devstack cinder-volume[87420]: DEBUG cinder.quota [req-8683ff15-e30d-493c-8628-d30a2cccf89b req-22342441-023e-45b8-9369-8481afb6c839 tempest-VolumesGetTestJSON-1539891603 None] Created reservations ['3f3e644c-c526-4701-b6d7-2376b854b483', 'aba7e691-d222-49ae-90e6-02bd8b83777b', '2e1a3f1a-35e4-4828-8e01-de4d2c176af4', '581ec2af-c324-4094-89e7-bd826eeaecfb'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 15:54:48 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [req-8683ff15-e30d-493c-8628-d30a2cccf89b req-22342441-023e-45b8-9369-8481afb6c839 tempest-VolumesGetTestJSON-1539891603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:54:48 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [req-8683ff15-e30d-493c-8628-d30a2cccf89b req-22342441-023e-45b8-9369-8481afb6c839 tempest-VolumesGetTestJSON-1539891603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:54:48 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [req-8683ff15-e30d-493c-8628-d30a2cccf89b req-22342441-023e-45b8-9369-8481afb6c839 tempest-VolumesGetTestJSON-1539891603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:54:48 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [req-8683ff15-e30d-493c-8628-d30a2cccf89b req-22342441-023e-45b8-9369-8481afb6c839 tempest-VolumesGetTestJSON-1539891603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:54:48 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [req-8683ff15-e30d-493c-8628-d30a2cccf89b req-22342441-023e-45b8-9369-8481afb6c839 tempest-VolumesGetTestJSON-1539891603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:54:48 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [req-8683ff15-e30d-493c-8628-d30a2cccf89b req-22342441-023e-45b8-9369-8481afb6c839 tempest-VolumesGetTestJSON-1539891603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:54:48 devstack sudo[94467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 15:54:48 devstack sudo[94467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:54:48 devstack sudo[94452]: pam_unix(sudo:session): session closed for user root Jul 10 15:54:48 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f317d0c5-e472-4dbf-bc78-6eea41da1e64 tempest-VolumesExtendTest-811549292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d94f0061-bdaf-44d3-9e38-8b058ced9c91 1073741824" returned: 0 in 0.848s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:54:48 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f317d0c5-e472-4dbf-bc78-6eea41da1e64 tempest-VolumesExtendTest-811549292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d94f0061-bdaf-44d3-9e38-8b058ced9c91 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:54:48 devstack sudo[94470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d94f0061-bdaf-44d3-9e38-8b058ced9c91 Jul 10 15:54:48 devstack sudo[94470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:54:49 devstack sudo[94467]: pam_unix(sudo:session): session closed for user root Jul 10 15:54:49 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [req-8683ff15-e30d-493c-8628-d30a2cccf89b req-22342441-023e-45b8-9369-8481afb6c839 tempest-VolumesGetTestJSON-1539891603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.771s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:54:49 devstack cinder-volume[87420]: DEBUG cinder.manager [req-8683ff15-e30d-493c-8628-d30a2cccf89b req-22342441-023e-45b8-9369-8481afb6c839 tempest-VolumesGetTestJSON-1539891603 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 15:54:49 devstack cinder-volume[87420]: INFO cinder.volume.manager [req-8683ff15-e30d-493c-8628-d30a2cccf89b req-22342441-023e-45b8-9369-8481afb6c839 tempest-VolumesGetTestJSON-1539891603 None] Deleted volume successfully. Jul 10 15:54:49 devstack cinder-volume[87420]: DEBUG cinder.coordination [req-8683ff15-e30d-493c-8628-d30a2cccf89b req-22342441-023e-45b8-9369-8481afb6c839 tempest-VolumesGetTestJSON-1539891603 None] Lock "cinder-477895e8-478c-46c1-afab-85b374470df4-delete_volume" released by "delete_volume" :: held 2.742s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:54:49 devstack sudo[94470]: pam_unix(sudo:session): session closed for user root Jul 10 15:54:49 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f317d0c5-e472-4dbf-bc78-6eea41da1e64 tempest-VolumesExtendTest-811549292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d94f0061-bdaf-44d3-9e38-8b058ced9c91" returned: 0 in 0.745s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:54:49 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-f317d0c5-e472-4dbf-bc78-6eea41da1e64 tempest-VolumesExtendTest-811549292 None] <== create_volume: return (1654ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 15:54:49 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-f317d0c5-e472-4dbf-bc78-6eea41da1e64 tempest-VolumesExtendTest-811549292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.657s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:54:49 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [req-53ec87f9-17c9-41da-ab2d-81c212a21e57 req-fd5eaf5c-e6de-47b6-a7a5-84e8f9846250 tempest-AttachVolumeNegativeTest-1493731096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.310s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:54:49 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe0fb164-8bb7-4853-8c4b-1bccec168231]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:54:49 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [req-53ec87f9-17c9-41da-ab2d-81c212a21e57 req-fd5eaf5c-e6de-47b6-a7a5-84e8f9846250 tempest-AttachVolumeNegativeTest-1493731096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7dd4f338-20da-4557-b862-2ff5b19c12fb {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:54:49 devstack cinder-volume[87420]: DEBUG cinder.volume.volume_utils [None req-f317d0c5-e472-4dbf-bc78-6eea41da1e64 tempest-VolumesExtendTest-811549292 None] Attempting download of 980bf5e0-e973-48f3-bc1f-383f924c4467 ((None, [{'url': 'file:///opt/stack/data/glance/images/980bf5e0-e973-48f3-bc1f-383f924c4467', 'metadata': {}}])) to volume d94f0061-bdaf-44d3-9e38-8b058ced9c91. {{(pid=87420) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 10 15:54:49 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[3678d2ca-d190-494d-bcc4-f901a349c317]: (4, 'raw') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:54:49 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f317d0c5-e472-4dbf-bc78-6eea41da1e64 tempest-VolumesExtendTest-811549292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_980bf5e0-e973-48f3-bc1f-383f924c4467_1v0kkuv6 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:54:49 devstack sudo[94474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7dd4f338-20da-4557-b862-2ff5b19c12fb Jul 10 15:54:49 devstack sudo[94474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:54:49 devstack sudo[94475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_980bf5e0-e973-48f3-bc1f-383f924c4467_1v0kkuv6 Jul 10 15:54:49 devstack sudo[94475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:54:50 devstack sudo[94475]: pam_unix(sudo:session): session closed for user root Jul 10 15:54:50 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f317d0c5-e472-4dbf-bc78-6eea41da1e64 tempest-VolumesExtendTest-811549292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_980bf5e0-e973-48f3-bc1f-383f924c4467_1v0kkuv6" returned: 0 in 0.866s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:54:50 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f317d0c5-e472-4dbf-bc78-6eea41da1e64 tempest-VolumesExtendTest-811549292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_980bf5e0-e973-48f3-bc1f-383f924c4467_1v0kkuv6 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:54:50 devstack sudo[94474]: pam_unix(sudo:session): session closed for user root Jul 10 15:54:50 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [req-53ec87f9-17c9-41da-ab2d-81c212a21e57 req-fd5eaf5c-e6de-47b6-a7a5-84e8f9846250 tempest-AttachVolumeNegativeTest-1493731096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7dd4f338-20da-4557-b862-2ff5b19c12fb" returned: 0 in 0.978s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:54:50 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [req-53ec87f9-17c9-41da-ab2d-81c212a21e57 req-fd5eaf5c-e6de-47b6-a7a5-84e8f9846250 tempest-AttachVolumeNegativeTest-1493731096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.003s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:54:50 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [req-53ec87f9-17c9-41da-ab2d-81c212a21e57 req-fd5eaf5c-e6de-47b6-a7a5-84e8f9846250 tempest-AttachVolumeNegativeTest-1493731096 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80', 'name': 'volume-7dd4f338-20da-4557-b862-2ff5b19c12fb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '91da0a04-492c-4188-bf24-3016ed8f5b07', 'enforce_multipath': True} {{(pid=87420) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 15:54:50 devstack sudo[94483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_980bf5e0-e973-48f3-bc1f-383f924c4467_1v0kkuv6 Jul 10 15:54:50 devstack sudo[94483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:54:50 devstack cinder-volume[87420]: INFO cinder.volume.manager [req-53ec87f9-17c9-41da-ab2d-81c212a21e57 req-fd5eaf5c-e6de-47b6-a7a5-84e8f9846250 tempest-AttachVolumeNegativeTest-1493731096 None] attachment_update completed successfully. Jul 10 15:54:51 devstack sudo[94483]: pam_unix(sudo:session): session closed for user root Jul 10 15:54:51 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f317d0c5-e472-4dbf-bc78-6eea41da1e64 tempest-VolumesExtendTest-811549292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_980bf5e0-e973-48f3-bc1f-383f924c4467_1v0kkuv6" returned: 1 in 1.181s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:54:51 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f317d0c5-e472-4dbf-bc78-6eea41da1e64 tempest-VolumesExtendTest-811549292 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_980bf5e0-e973-48f3-bc1f-383f924c4467_1v0kkuv6' failed. Not Retrying. {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 15:54:51 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc6392c3-b1fd-4349-bd6c-d3748250cae3]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:54:51 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f317d0c5-e472-4dbf-bc78-6eea41da1e64 tempest-VolumesExtendTest-811549292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_980bf5e0-e973-48f3-bc1f-383f924c4467_dcj91p2tdevstack@QuobyteHD {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:54:51 devstack sudo[94595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_980bf5e0-e973-48f3-bc1f-383f924c4467_dcj91p2tdevstack@QuobyteHD Jul 10 15:54:51 devstack sudo[94595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:54:52 devstack sudo[94595]: pam_unix(sudo:session): session closed for user root Jul 10 15:54:52 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f317d0c5-e472-4dbf-bc78-6eea41da1e64 tempest-VolumesExtendTest-811549292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_980bf5e0-e973-48f3-bc1f-383f924c4467_dcj91p2tdevstack@QuobyteHD" returned: 0 in 0.988s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:54:52 devstack cinder-volume[87420]: DEBUG cinder.image.image_utils [None req-f317d0c5-e472-4dbf-bc78-6eea41da1e64 tempest-VolumesExtendTest-811549292 None] 980bf5e0-e973-48f3-bc1f-383f924c4467 was qcow2, converting to raw {{(pid=87420) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 10 15:54:52 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f317d0c5-e472-4dbf-bc78-6eea41da1e64 tempest-VolumesExtendTest-811549292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_980bf5e0-e973-48f3-bc1f-383f924c4467_dcj91p2tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d94f0061-bdaf-44d3-9e38-8b058ced9c91 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:54:52 devstack sudo[94940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_980bf5e0-e973-48f3-bc1f-383f924c4467_dcj91p2tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d94f0061-bdaf-44d3-9e38-8b058ced9c91 Jul 10 15:54:52 devstack sudo[94940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:54:54 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-f8cd05d9-738a-44e5-b5da-16fb8c9325b2 tempest-GroupSnapshotsV319Test-1868439518 None] Group tempest-GroupSnapshotsV319Test-Group-940483347: creating Jul 10 15:54:54 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-f8cd05d9-738a-44e5-b5da-16fb8c9325b2 tempest-GroupSnapshotsV319Test-1868439518 None] Group tempest-GroupSnapshotsV319Test-Group-940483347: created successfully Jul 10 15:54:54 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-f8cd05d9-738a-44e5-b5da-16fb8c9325b2 tempest-GroupSnapshotsV319Test-1868439518 None] Create group completed successfully. Jul 10 15:54:55 devstack sudo[94940]: pam_unix(sudo:session): session closed for user root Jul 10 15:54:55 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f317d0c5-e472-4dbf-bc78-6eea41da1e64 tempest-VolumesExtendTest-811549292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_980bf5e0-e973-48f3-bc1f-383f924c4467_dcj91p2tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d94f0061-bdaf-44d3-9e38-8b058ced9c91" returned: 0 in 2.475s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:54:55 devstack cinder-volume[87420]: DEBUG cinder.image.image_utils [None req-f317d0c5-e472-4dbf-bc78-6eea41da1e64 tempest-VolumesExtendTest-811549292 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_980bf5e0-e973-48f3-bc1f-383f924c4467_dcj91p2tdevstack@QuobyteHD, size 112.00 MB, duration 2.48 sec, destination /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d94f0061-bdaf-44d3-9e38-8b058ced9c91 {{(pid=87420) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 15:54:55 devstack cinder-volume[87420]: INFO cinder.image.image_utils [None req-f317d0c5-e472-4dbf-bc78-6eea41da1e64 tempest-VolumesExtendTest-811549292 None] Converted 112.00 MB image at 45.23 MB/s Jul 10 15:54:55 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f317d0c5-e472-4dbf-bc78-6eea41da1e64 tempest-VolumesExtendTest-811549292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d94f0061-bdaf-44d3-9e38-8b058ced9c91 1G {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:54:55 devstack sudo[94950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d94f0061-bdaf-44d3-9e38-8b058ced9c91 1G Jul 10 15:54:55 devstack sudo[94950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:54:56 devstack sudo[94950]: pam_unix(sudo:session): session closed for user root Jul 10 15:54:56 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f317d0c5-e472-4dbf-bc78-6eea41da1e64 tempest-VolumesExtendTest-811549292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d94f0061-bdaf-44d3-9e38-8b058ced9c91 1G" returned: 0 in 0.875s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:54:56 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[5deb2d6c-d27d-480d-8efc-a982549ad903]: (4, 'raw') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:54:56 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f317d0c5-e472-4dbf-bc78-6eea41da1e64 tempest-VolumesExtendTest-811549292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d94f0061-bdaf-44d3-9e38-8b058ced9c91 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:54:56 devstack sudo[94956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d94f0061-bdaf-44d3-9e38-8b058ced9c91 Jul 10 15:54:56 devstack sudo[94956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:54:56 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3e42588-3ab4-45d5-9aa1-35388ec60cee tempest-GroupSnapshotsV319Test-1868439518 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 15:54:56 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-e3e42588-3ab4-45d5-9aa1-35388ec60cee tempest-GroupSnapshotsV319Test-1868439518 None] Flow 'volume_create_manager' (12020495-53ab-44c0-b672-a7fddb1d310b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:54:56 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-e3e42588-3ab4-45d5-9aa1-35388ec60cee tempest-GroupSnapshotsV319Test-1868439518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6405d4f-ecf0-4c7c-a802-c9aa6ca6e0b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:54:56 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-e3e42588-3ab4-45d5-9aa1-35388ec60cee tempest-GroupSnapshotsV319Test-1868439518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6405d4f-ecf0-4c7c-a802-c9aa6ca6e0b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:54:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-579875168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d52604dd-14ca-4d34-95ba-0cd2b45eb5a1,host='devstack@QuobyteHD#QuobyteHD',id=798770e5-14d3-417d-9b5a-78f9d29010a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37ae928c109c4431b30b2dc73d24e9c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:54:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:54:57Z,use_quota=True,user_id='3d87d28908334e0a8470b6900ec855d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1c0930ee-5459-48d1-9bca-1d2df534883b),volume_type_id=1c0930ee-5459-48d1-9bca-1d2df534883b)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:54:56 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-e3e42588-3ab4-45d5-9aa1-35388ec60cee tempest-GroupSnapshotsV319Test-1868439518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (836aa3b9-cc4b-4a39-85d6-e6354e1d5e7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:54:56 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-e3e42588-3ab4-45d5-9aa1-35388ec60cee tempest-GroupSnapshotsV319Test-1868439518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (836aa3b9-cc4b-4a39-85d6-e6354e1d5e7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:54:56 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-e3e42588-3ab4-45d5-9aa1-35388ec60cee tempest-GroupSnapshotsV319Test-1868439518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6aed2742-6e29-4504-bff4-1517164ec0c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:54:56 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-e3e42588-3ab4-45d5-9aa1-35388ec60cee tempest-GroupSnapshotsV319Test-1868439518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6aed2742-6e29-4504-bff4-1517164ec0c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '798770e5-14d3-417d-9b5a-78f9d29010a7', 'volume_name': 'volume-798770e5-14d3-417d-9b5a-78f9d29010a7', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:54:56 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-e3e42588-3ab4-45d5-9aa1-35388ec60cee tempest-GroupSnapshotsV319Test-1868439518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d97417d2-1207-491e-b7f9-c8f96f7d858d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:54:56 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-e3e42588-3ab4-45d5-9aa1-35388ec60cee tempest-GroupSnapshotsV319Test-1868439518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d97417d2-1207-491e-b7f9-c8f96f7d858d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:54:56 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-e3e42588-3ab4-45d5-9aa1-35388ec60cee tempest-GroupSnapshotsV319Test-1868439518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ff8eb70-f400-47bf-b995-afb080199d1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:54:56 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-e3e42588-3ab4-45d5-9aa1-35388ec60cee tempest-GroupSnapshotsV319Test-1868439518 None] Volume 798770e5-14d3-417d-9b5a-78f9d29010a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-798770e5-14d3-417d-9b5a-78f9d29010a7', 'volume_size': 1} Jul 10 15:54:56 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-e3e42588-3ab4-45d5-9aa1-35388ec60cee tempest-GroupSnapshotsV319Test-1868439518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:54:56 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-e3e42588-3ab4-45d5-9aa1-35388ec60cee tempest-GroupSnapshotsV319Test-1868439518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:54:56 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-e3e42588-3ab4-45d5-9aa1-35388ec60cee tempest-GroupSnapshotsV319Test-1868439518 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d52604dd-14ca-4d34-95ba-0cd2b45eb5a1,created_at=2026-07-10T13:54:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-579875168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d52604dd-14ca-4d34-95ba-0cd2b45eb5a1,host='devstack@QuobyteHD#QuobyteHD',id=798770e5-14d3-417d-9b5a-78f9d29010a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37ae928c109c4431b30b2dc73d24e9c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:54:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:54:57Z,use_quota=True,user_id='3d87d28908334e0a8470b6900ec855d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1c0930ee-5459-48d1-9bca-1d2df534883b),volume_type_id=1c0930ee-5459-48d1-9bca-1d2df534883b)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 15:54:56 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-e3e42588-3ab4-45d5-9aa1-35388ec60cee tempest-GroupSnapshotsV319Test-1868439518 None] Creating volume 798770e5-14d3-417d-9b5a-78f9d29010a7 {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 15:54:56 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-e3e42588-3ab4-45d5-9aa1-35388ec60cee tempest-GroupSnapshotsV319Test-1868439518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:54:56 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-e3e42588-3ab4-45d5-9aa1-35388ec60cee tempest-GroupSnapshotsV319Test-1868439518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:54:56 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-e3e42588-3ab4-45d5-9aa1-35388ec60cee tempest-GroupSnapshotsV319Test-1868439518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:54:56 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-e3e42588-3ab4-45d5-9aa1-35388ec60cee tempest-GroupSnapshotsV319Test-1868439518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:54:56 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-e3e42588-3ab4-45d5-9aa1-35388ec60cee tempest-GroupSnapshotsV319Test-1868439518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:54:56 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-e3e42588-3ab4-45d5-9aa1-35388ec60cee tempest-GroupSnapshotsV319Test-1868439518 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 15:54:56 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-e3e42588-3ab4-45d5-9aa1-35388ec60cee tempest-GroupSnapshotsV319Test-1868439518 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 15:54:56 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-e3e42588-3ab4-45d5-9aa1-35388ec60cee tempest-GroupSnapshotsV319Test-1868439518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-798770e5-14d3-417d-9b5a-78f9d29010a7 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:54:56 devstack sudo[94958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-798770e5-14d3-417d-9b5a-78f9d29010a7 1073741824 Jul 10 15:54:56 devstack sudo[94958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:54:57 devstack sudo[94956]: pam_unix(sudo:session): session closed for user root Jul 10 15:54:57 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f317d0c5-e472-4dbf-bc78-6eea41da1e64 tempest-VolumesExtendTest-811549292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d94f0061-bdaf-44d3-9e38-8b058ced9c91" returned: 0 in 1.136s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:54:57 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f317d0c5-e472-4dbf-bc78-6eea41da1e64 tempest-VolumesExtendTest-811549292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d94f0061-bdaf-44d3-9e38-8b058ced9c91 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:54:57 devstack sudo[94962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d94f0061-bdaf-44d3-9e38-8b058ced9c91 Jul 10 15:54:57 devstack sudo[94962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:54:57 devstack cinder-volume[87420]: INFO cinder.volume.manager [req-b1b82d9a-81b7-437b-9f85-886ee3e18c49 req-5f6c1081-71bb-4d09-9778-46bdb0462d2d tempest-AttachVolumeNegativeTest-1493731096 None] Terminate volume connection completed successfully. Jul 10 15:54:57 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [req-b1b82d9a-81b7-437b-9f85-886ee3e18c49 req-5f6c1081-71bb-4d09-9778-46bdb0462d2d tempest-AttachVolumeNegativeTest-1493731096 None] Deleting attachment 91da0a04-492c-4188-bf24-3016ed8f5b07. {{(pid=87420) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 15:54:58 devstack sudo[94958]: pam_unix(sudo:session): session closed for user root Jul 10 15:54:58 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-e3e42588-3ab4-45d5-9aa1-35388ec60cee tempest-GroupSnapshotsV319Test-1868439518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-798770e5-14d3-417d-9b5a-78f9d29010a7 1073741824" returned: 0 in 1.220s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:54:58 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-e3e42588-3ab4-45d5-9aa1-35388ec60cee tempest-GroupSnapshotsV319Test-1868439518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-798770e5-14d3-417d-9b5a-78f9d29010a7 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:54:58 devstack sudo[94998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-798770e5-14d3-417d-9b5a-78f9d29010a7 Jul 10 15:54:58 devstack sudo[94998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:54:58 devstack sudo[94962]: pam_unix(sudo:session): session closed for user root Jul 10 15:54:58 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f317d0c5-e472-4dbf-bc78-6eea41da1e64 tempest-VolumesExtendTest-811549292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d94f0061-bdaf-44d3-9e38-8b058ced9c91" returned: 1 in 1.147s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:54:58 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f317d0c5-e472-4dbf-bc78-6eea41da1e64 tempest-VolumesExtendTest-811549292 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d94f0061-bdaf-44d3-9e38-8b058ced9c91' failed. Not Retrying. {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 15:54:58 devstack cinder-volume[87420]: DEBUG cinder.volume.volume_utils [None req-f317d0c5-e472-4dbf-bc78-6eea41da1e64 tempest-VolumesExtendTest-811549292 None] Downloaded image 980bf5e0-e973-48f3-bc1f-383f924c4467 ((None, [{'url': 'file:///opt/stack/data/glance/images/980bf5e0-e973-48f3-bc1f-383f924c4467', 'metadata': {}}])) to volume d94f0061-bdaf-44d3-9e38-8b058ced9c91 successfully. {{(pid=87420) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 10 15:54:58 devstack cinder-volume[87420]: DEBUG cinder.image.image_utils [None req-f317d0c5-e472-4dbf-bc78-6eea41da1e64 tempest-VolumesExtendTest-811549292 None] Temporary image 980bf5e0-e973-48f3-bc1f-383f924c4467 for user f5eae745be434bf3b29491898558a731 is deleted. {{(pid=87420) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 10 15:54:58 devstack cinder-volume[87420]: DEBUG cinder.volume.volume_utils [None req-f317d0c5-e472-4dbf-bc78-6eea41da1e64 tempest-VolumesExtendTest-811549292 None] Marking volume d94f0061-bdaf-44d3-9e38-8b058ced9c91 as bootable. {{(pid=87420) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 10 15:54:58 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-f317d0c5-e472-4dbf-bc78-6eea41da1e64 tempest-VolumesExtendTest-811549292 None] Copying metadata from image 980bf5e0-e973-48f3-bc1f-383f924c4467 to d94f0061-bdaf-44d3-9e38-8b058ced9c91. {{(pid=87420) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 10 15:54:58 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-f317d0c5-e472-4dbf-bc78-6eea41da1e64 tempest-VolumesExtendTest-811549292 None] Creating volume glance metadata for volume d94f0061-bdaf-44d3-9e38-8b058ced9c91 backed by image 980bf5e0-e973-48f3-bc1f-383f924c4467 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '980bf5e0-e973-48f3-bc1f-383f924c4467', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87420) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 10 15:54:58 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f317d0c5-e472-4dbf-bc78-6eea41da1e64 tempest-VolumesExtendTest-811549292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e6a92fb-5bca-4168-9cde-8f909faec1c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d94f0061-bdaf-44d3-9e38-8b058ced9c91', 'volume_size': 1, 'image_id': '980bf5e0-e973-48f3-bc1f-383f924c4467', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/980bf5e0-e973-48f3-bc1f-383f924c4467', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'de9cf234f3774db489ed55d5afcfc7bf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '980bf5e0-e973-48f3-bc1f-383f924c4467', 'created_at': datetime.datetime(2026, 7, 10, 13, 42, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 13, 42, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/980bf5e0-e973-48f3-bc1f-383f924c4467/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:54:58 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f317d0c5-e472-4dbf-bc78-6eea41da1e64 tempest-VolumesExtendTest-811549292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ad065ff-2d4b-4ef8-8915-66aa8097232a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:54:58 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-f317d0c5-e472-4dbf-bc78-6eea41da1e64 tempest-VolumesExtendTest-811549292 None] Volume volume-d94f0061-bdaf-44d3-9e38-8b058ced9c91 (d94f0061-bdaf-44d3-9e38-8b058ced9c91): created successfully Jul 10 15:54:58 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f317d0c5-e472-4dbf-bc78-6eea41da1e64 tempest-VolumesExtendTest-811549292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ad065ff-2d4b-4ef8-8915-66aa8097232a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:54:58 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f317d0c5-e472-4dbf-bc78-6eea41da1e64 tempest-VolumesExtendTest-811549292 None] Flow 'volume_create_manager' (a6d81dbe-bddd-4503-be64-cfba2e9003e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:54:58 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-f317d0c5-e472-4dbf-bc78-6eea41da1e64 tempest-VolumesExtendTest-811549292 None] Created volume successfully. Jul 10 15:54:58 devstack sudo[94998]: pam_unix(sudo:session): session closed for user root Jul 10 15:54:58 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-e3e42588-3ab4-45d5-9aa1-35388ec60cee tempest-GroupSnapshotsV319Test-1868439518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-798770e5-14d3-417d-9b5a-78f9d29010a7" returned: 0 in 0.908s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:54:58 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-e3e42588-3ab4-45d5-9aa1-35388ec60cee tempest-GroupSnapshotsV319Test-1868439518 None] <== create_volume: return (2201ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 15:54:58 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-e3e42588-3ab4-45d5-9aa1-35388ec60cee tempest-GroupSnapshotsV319Test-1868439518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.205s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:54:59 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-e3e42588-3ab4-45d5-9aa1-35388ec60cee tempest-GroupSnapshotsV319Test-1868439518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ff8eb70-f400-47bf-b995-afb080199d1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-798770e5-14d3-417d-9b5a-78f9d29010a7', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:54:59 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-e3e42588-3ab4-45d5-9aa1-35388ec60cee tempest-GroupSnapshotsV319Test-1868439518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a173fa9-b2ef-40d3-b463-ce485d2b52e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:54:59 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-e3e42588-3ab4-45d5-9aa1-35388ec60cee tempest-GroupSnapshotsV319Test-1868439518 None] Volume volume-798770e5-14d3-417d-9b5a-78f9d29010a7 (798770e5-14d3-417d-9b5a-78f9d29010a7): created successfully Jul 10 15:54:59 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-e3e42588-3ab4-45d5-9aa1-35388ec60cee tempest-GroupSnapshotsV319Test-1868439518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a173fa9-b2ef-40d3-b463-ce485d2b52e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:54:59 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-e3e42588-3ab4-45d5-9aa1-35388ec60cee tempest-GroupSnapshotsV319Test-1868439518 None] Flow 'volume_create_manager' (12020495-53ab-44c0-b672-a7fddb1d310b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:54:59 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-e3e42588-3ab4-45d5-9aa1-35388ec60cee tempest-GroupSnapshotsV319Test-1868439518 None] Created volume successfully. Jul 10 15:54:59 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-6b737d31-190f-4353-bc6a-fdf5c77818bd tempest-VolumesExtendTest-811549292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:54:59 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-6b737d31-190f-4353-bc6a-fdf5c77818bd tempest-VolumesExtendTest-811549292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:54:59 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2de78b7-8e5c-4b4c-8966-911b6d3c4970]: (4, 'raw') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:54:59 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6b737d31-190f-4353-bc6a-fdf5c77818bd tempest-VolumesExtendTest-811549292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d94f0061-bdaf-44d3-9e38-8b058ced9c91 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:54:59 devstack sudo[95005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d94f0061-bdaf-44d3-9e38-8b058ced9c91 Jul 10 15:54:59 devstack sudo[95005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:55:00 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-de293c85-cd87-45f7-bd51-17ffbca6452d tempest-GroupSnapshotsV319Test-1868439518 None] GroupSnapshot 63a5f060-b06c-41a8-9ec4-f545ac3464ab: creating. Jul 10 15:55:00 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-de293c85-cd87-45f7-bd51-17ffbca6452d tempest-GroupSnapshotsV319Test-1868439518 None] Group snapshot 63a5f060-b06c-41a8-9ec4-f545ac3464ab: creating. {{(pid=87420) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 10 15:55:00 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-de293c85-cd87-45f7-bd51-17ffbca6452d tempest-GroupSnapshotsV319Test-1868439518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:55:00 devstack sudo[95005]: pam_unix(sudo:session): session closed for user root Jul 10 15:55:00 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6b737d31-190f-4353-bc6a-fdf5c77818bd tempest-VolumesExtendTest-811549292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d94f0061-bdaf-44d3-9e38-8b058ced9c91" returned: 0 in 1.342s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:55:00 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6b737d31-190f-4353-bc6a-fdf5c77818bd tempest-VolumesExtendTest-811549292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d94f0061-bdaf-44d3-9e38-8b058ced9c91 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:55:00 devstack sudo[95010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d94f0061-bdaf-44d3-9e38-8b058ced9c91 Jul 10 15:55:00 devstack sudo[95010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:55:01 devstack sudo[95010]: pam_unix(sudo:session): session closed for user root Jul 10 15:55:01 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6b737d31-190f-4353-bc6a-fdf5c77818bd tempest-VolumesExtendTest-811549292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d94f0061-bdaf-44d3-9e38-8b058ced9c91" returned: 1 in 0.948s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:55:01 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6b737d31-190f-4353-bc6a-fdf5c77818bd tempest-VolumesExtendTest-811549292 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d94f0061-bdaf-44d3-9e38-8b058ced9c91' failed. Not Retrying. {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 15:55:01 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6b737d31-190f-4353-bc6a-fdf5c77818bd tempest-VolumesExtendTest-811549292 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d94f0061-bdaf-44d3-9e38-8b058ced9c91 2G {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:55:01 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6b737d31-190f-4353-bc6a-fdf5c77818bd tempest-VolumesExtendTest-811549292 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d94f0061-bdaf-44d3-9e38-8b058ced9c91 2G" returned: 0 in 0.068s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:55:01 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-6b737d31-190f-4353-bc6a-fdf5c77818bd tempest-VolumesExtendTest-811549292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 2.427s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:55:01 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-de293c85-cd87-45f7-bd51-17ffbca6452d tempest-GroupSnapshotsV319Test-1868439518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.545s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:55:01 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-de293c85-cd87-45f7-bd51-17ffbca6452d tempest-GroupSnapshotsV319Test-1868439518 None] Creating offline snapshot 5da781e1-d9dd-4cd3-b8a3-64b6eb1a9d35 of volume 798770e5-14d3-417d-9b5a-78f9d29010a7 {{(pid=87420) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 15:55:01 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[5759b17a-bed4-4a63-8058-3ec78fe6e753]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:55:01 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-de293c85-cd87-45f7-bd51-17ffbca6452d tempest-GroupSnapshotsV319Test-1868439518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-798770e5-14d3-417d-9b5a-78f9d29010a7 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:55:01 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-6b737d31-190f-4353-bc6a-fdf5c77818bd tempest-VolumesExtendTest-811549292 None] Extend volume completed successfully. Jul 10 15:55:02 devstack sudo[95330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-798770e5-14d3-417d-9b5a-78f9d29010a7 Jul 10 15:55:02 devstack sudo[95330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:55:02 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-34d5ff60-cb29-41e7-b147-1342b17dbfd7 tempest-VolumesExtendTest-811549292 None] Acquiring lock "cinder-d94f0061-bdaf-44d3-9e38-8b058ced9c91-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:55:02 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-34d5ff60-cb29-41e7-b147-1342b17dbfd7 tempest-VolumesExtendTest-811549292 None] Lock "cinder-d94f0061-bdaf-44d3-9e38-8b058ced9c91-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:55:03 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-34d5ff60-cb29-41e7-b147-1342b17dbfd7 tempest-VolumesExtendTest-811549292 None] Acquiring lock "cinder-quobyte-d94f0061-bdaf-44d3-9e38-8b058ced9c91" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:55:03 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-34d5ff60-cb29-41e7-b147-1342b17dbfd7 tempest-VolumesExtendTest-811549292 None] Lock "cinder-quobyte-d94f0061-bdaf-44d3-9e38-8b058ced9c91" acquired by "delete_volume" :: waited 0.021s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:55:03 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[328658e0-c1cc-4101-b1ae-dc0a8d999026]: (4, 'raw') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:55:03 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-34d5ff60-cb29-41e7-b147-1342b17dbfd7 tempest-VolumesExtendTest-811549292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d94f0061-bdaf-44d3-9e38-8b058ced9c91 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:55:03 devstack sudo[95330]: pam_unix(sudo:session): session closed for user root Jul 10 15:55:03 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-de293c85-cd87-45f7-bd51-17ffbca6452d tempest-GroupSnapshotsV319Test-1868439518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-798770e5-14d3-417d-9b5a-78f9d29010a7" returned: 0 in 1.448s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:55:03 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-de293c85-cd87-45f7-bd51-17ffbca6452d tempest-GroupSnapshotsV319Test-1868439518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-798770e5-14d3-417d-9b5a-78f9d29010a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-798770e5-14d3-417d-9b5a-78f9d29010a7.5da781e1-d9dd-4cd3-b8a3-64b6eb1a9d35 1G {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:55:03 devstack sudo[95380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d94f0061-bdaf-44d3-9e38-8b058ced9c91 Jul 10 15:55:03 devstack sudo[95380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:55:03 devstack sudo[95381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-798770e5-14d3-417d-9b5a-78f9d29010a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-798770e5-14d3-417d-9b5a-78f9d29010a7.5da781e1-d9dd-4cd3-b8a3-64b6eb1a9d35 1G Jul 10 15:55:03 devstack sudo[95381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:55:04 devstack sudo[95380]: pam_unix(sudo:session): session closed for user root Jul 10 15:55:04 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-34d5ff60-cb29-41e7-b147-1342b17dbfd7 tempest-VolumesExtendTest-811549292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d94f0061-bdaf-44d3-9e38-8b058ced9c91" returned: 0 in 1.150s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:55:04 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-34d5ff60-cb29-41e7-b147-1342b17dbfd7 tempest-VolumesExtendTest-811549292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d94f0061-bdaf-44d3-9e38-8b058ced9c91 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:55:04 devstack sudo[95381]: pam_unix(sudo:session): session closed for user root Jul 10 15:55:04 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-de293c85-cd87-45f7-bd51-17ffbca6452d tempest-GroupSnapshotsV319Test-1868439518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-798770e5-14d3-417d-9b5a-78f9d29010a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-798770e5-14d3-417d-9b5a-78f9d29010a7.5da781e1-d9dd-4cd3-b8a3-64b6eb1a9d35 1G" returned: 0 in 1.126s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:55:04 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-de293c85-cd87-45f7-bd51-17ffbca6452d tempest-GroupSnapshotsV319Test-1868439518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-798770e5-14d3-417d-9b5a-78f9d29010a7 -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-798770e5-14d3-417d-9b5a-78f9d29010a7.5da781e1-d9dd-4cd3-b8a3-64b6eb1a9d35 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:55:04 devstack sudo[95400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-798770e5-14d3-417d-9b5a-78f9d29010a7 -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-798770e5-14d3-417d-9b5a-78f9d29010a7.5da781e1-d9dd-4cd3-b8a3-64b6eb1a9d35 Jul 10 15:55:04 devstack sudo[95400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:55:04 devstack sudo[95399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d94f0061-bdaf-44d3-9e38-8b058ced9c91 Jul 10 15:55:04 devstack sudo[95399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:55:05 devstack sudo[95399]: pam_unix(sudo:session): session closed for user root Jul 10 15:55:05 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-34d5ff60-cb29-41e7-b147-1342b17dbfd7 tempest-VolumesExtendTest-811549292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d94f0061-bdaf-44d3-9e38-8b058ced9c91" returned: 1 in 1.190s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:55:05 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-34d5ff60-cb29-41e7-b147-1342b17dbfd7 tempest-VolumesExtendTest-811549292 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d94f0061-bdaf-44d3-9e38-8b058ced9c91' failed. Not Retrying. {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 15:55:05 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-34d5ff60-cb29-41e7-b147-1342b17dbfd7 tempest-VolumesExtendTest-811549292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d94f0061-bdaf-44d3-9e38-8b058ced9c91 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:55:05 devstack sudo[95410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d94f0061-bdaf-44d3-9e38-8b058ced9c91 Jul 10 15:55:05 devstack sudo[95410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:55:05 devstack sudo[95400]: pam_unix(sudo:session): session closed for user root Jul 10 15:55:05 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-de293c85-cd87-45f7-bd51-17ffbca6452d tempest-GroupSnapshotsV319Test-1868439518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-798770e5-14d3-417d-9b5a-78f9d29010a7 -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-798770e5-14d3-417d-9b5a-78f9d29010a7.5da781e1-d9dd-4cd3-b8a3-64b6eb1a9d35" returned: 0 in 1.176s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:55:05 devstack cinder-volume[87420]: WARNING cinder.volume.drivers.remotefs [None req-de293c85-cd87-45f7-bd51-17ffbca6452d tempest-GroupSnapshotsV319Test-1868439518 None] /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-798770e5-14d3-417d-9b5a-78f9d29010a7.5da781e1-d9dd-4cd3-b8a3-64b6eb1a9d35 is being set with open permissions: ugo+rw: NotImplementedError Jul 10 15:55:05 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-de293c85-cd87-45f7-bd51-17ffbca6452d tempest-GroupSnapshotsV319Test-1868439518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-798770e5-14d3-417d-9b5a-78f9d29010a7.5da781e1-d9dd-4cd3-b8a3-64b6eb1a9d35 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:55:05 devstack sudo[95412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-798770e5-14d3-417d-9b5a-78f9d29010a7.5da781e1-d9dd-4cd3-b8a3-64b6eb1a9d35 Jul 10 15:55:05 devstack sudo[95412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:55:06 devstack sudo[95410]: pam_unix(sudo:session): session closed for user root Jul 10 15:55:06 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-34d5ff60-cb29-41e7-b147-1342b17dbfd7 tempest-VolumesExtendTest-811549292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d94f0061-bdaf-44d3-9e38-8b058ced9c91" returned: 0 in 0.716s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:55:06 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-34d5ff60-cb29-41e7-b147-1342b17dbfd7 tempest-VolumesExtendTest-811549292 None] Lock "cinder-quobyte-d94f0061-bdaf-44d3-9e38-8b058ced9c91" released by "delete_volume" :: held 3.138s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:55:06 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-34d5ff60-cb29-41e7-b147-1342b17dbfd7 tempest-VolumesExtendTest-811549292 None] Created reservations ['78825946-336f-4a9c-96ea-9e160cee6ddf', '41083426-7beb-4208-ac22-30529fce647a', '92f2662e-3787-43a1-911c-9e40c926e378', '6860f1c5-7109-47e8-9ed0-288c766d30ac'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 15:55:06 devstack sudo[95412]: pam_unix(sudo:session): session closed for user root Jul 10 15:55:06 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-de293c85-cd87-45f7-bd51-17ffbca6452d tempest-GroupSnapshotsV319Test-1868439518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-798770e5-14d3-417d-9b5a-78f9d29010a7.5da781e1-d9dd-4cd3-b8a3-64b6eb1a9d35" returned: 0 in 0.735s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:55:06 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-de293c85-cd87-45f7-bd51-17ffbca6452d tempest-GroupSnapshotsV319Test-1868439518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-798770e5-14d3-417d-9b5a-78f9d29010a7.info {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:55:06 devstack sudo[95430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-798770e5-14d3-417d-9b5a-78f9d29010a7.info Jul 10 15:55:06 devstack sudo[95430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:55:06 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-34d5ff60-cb29-41e7-b147-1342b17dbfd7 tempest-VolumesExtendTest-811549292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:55:06 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-34d5ff60-cb29-41e7-b147-1342b17dbfd7 tempest-VolumesExtendTest-811549292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:55:06 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-34d5ff60-cb29-41e7-b147-1342b17dbfd7 tempest-VolumesExtendTest-811549292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:55:06 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-34d5ff60-cb29-41e7-b147-1342b17dbfd7 tempest-VolumesExtendTest-811549292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:55:06 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-34d5ff60-cb29-41e7-b147-1342b17dbfd7 tempest-VolumesExtendTest-811549292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:55:06 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-34d5ff60-cb29-41e7-b147-1342b17dbfd7 tempest-VolumesExtendTest-811549292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:55:06 devstack sudo[95432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 15:55:06 devstack sudo[95432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:55:06 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-939b7e30-e03b-4f1c-8a05-ecd024c0fa91 tempest-VolumesExtendTest-811549292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 15:55:06 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-939b7e30-e03b-4f1c-8a05-ecd024c0fa91 tempest-VolumesExtendTest-811549292 None] Flow 'volume_create_manager' (c08ef2cb-d878-41ff-99c3-d7a1544f49f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:55:06 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-939b7e30-e03b-4f1c-8a05-ecd024c0fa91 tempest-VolumesExtendTest-811549292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5d09629-8a3d-49b0-a4c4-5a95bf13b32b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:55:06 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-939b7e30-e03b-4f1c-8a05-ecd024c0fa91 tempest-VolumesExtendTest-811549292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5d09629-8a3d-49b0-a4c4-5a95bf13b32b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:55:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1102453168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5193b91b-af28-473f-a4fb-70f05e0bc6a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5362398080014ae5a37b592fe4c11c0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:55:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:55:07Z,use_quota=True,user_id='f5eae745be434bf3b29491898558a731',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:55:06 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-939b7e30-e03b-4f1c-8a05-ecd024c0fa91 tempest-VolumesExtendTest-811549292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a87629ab-f493-4c9a-9879-31791083bb4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:55:06 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-939b7e30-e03b-4f1c-8a05-ecd024c0fa91 tempest-VolumesExtendTest-811549292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a87629ab-f493-4c9a-9879-31791083bb4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:55:07 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-939b7e30-e03b-4f1c-8a05-ecd024c0fa91 tempest-VolumesExtendTest-811549292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1738754b-1642-4e7e-9141-01c263246e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:55:07 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-939b7e30-e03b-4f1c-8a05-ecd024c0fa91 tempest-VolumesExtendTest-811549292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1738754b-1642-4e7e-9141-01c263246e5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5193b91b-af28-473f-a4fb-70f05e0bc6a9', 'volume_name': 'volume-5193b91b-af28-473f-a4fb-70f05e0bc6a9', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:55:07 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-939b7e30-e03b-4f1c-8a05-ecd024c0fa91 tempest-VolumesExtendTest-811549292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (beebb0a7-ee02-4eba-a06a-0dca2ceba8e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:55:07 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-939b7e30-e03b-4f1c-8a05-ecd024c0fa91 tempest-VolumesExtendTest-811549292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (beebb0a7-ee02-4eba-a06a-0dca2ceba8e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:55:07 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-939b7e30-e03b-4f1c-8a05-ecd024c0fa91 tempest-VolumesExtendTest-811549292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (155179fd-4783-417c-84c4-ad5cb606a67e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:55:07 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-939b7e30-e03b-4f1c-8a05-ecd024c0fa91 tempest-VolumesExtendTest-811549292 None] Volume 5193b91b-af28-473f-a4fb-70f05e0bc6a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5193b91b-af28-473f-a4fb-70f05e0bc6a9', 'volume_size': 1} Jul 10 15:55:07 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-939b7e30-e03b-4f1c-8a05-ecd024c0fa91 tempest-VolumesExtendTest-811549292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:55:07 devstack sudo[95432]: pam_unix(sudo:session): session closed for user root Jul 10 15:55:07 devstack sudo[95430]: pam_unix(sudo:session): session closed for user root Jul 10 15:55:07 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-34d5ff60-cb29-41e7-b147-1342b17dbfd7 tempest-VolumesExtendTest-811549292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.701s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:55:07 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-34d5ff60-cb29-41e7-b147-1342b17dbfd7 tempest-VolumesExtendTest-811549292 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 15:55:07 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-de293c85-cd87-45f7-bd51-17ffbca6452d tempest-GroupSnapshotsV319Test-1868439518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-798770e5-14d3-417d-9b5a-78f9d29010a7.info" returned: 0 in 0.772s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:55:07 devstack cinder-volume[87420]: WARNING cinder.volume.drivers.remotefs [None req-de293c85-cd87-45f7-bd51-17ffbca6452d tempest-GroupSnapshotsV319Test-1868439518 None] /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-798770e5-14d3-417d-9b5a-78f9d29010a7.info is being set with open permissions: ugo+rw: NotImplementedError Jul 10 15:55:07 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-de293c85-cd87-45f7-bd51-17ffbca6452d tempest-GroupSnapshotsV319Test-1868439518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-798770e5-14d3-417d-9b5a-78f9d29010a7.info {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:55:07 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-34d5ff60-cb29-41e7-b147-1342b17dbfd7 tempest-VolumesExtendTest-811549292 None] Deleted volume successfully. Jul 10 15:55:07 devstack sudo[95436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-798770e5-14d3-417d-9b5a-78f9d29010a7.info Jul 10 15:55:07 devstack sudo[95436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:55:07 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-34d5ff60-cb29-41e7-b147-1342b17dbfd7 tempest-VolumesExtendTest-811549292 None] Lock "cinder-d94f0061-bdaf-44d3-9e38-8b058ced9c91-delete_volume" released by "delete_volume" :: held 4.129s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:55:07 devstack sudo[95436]: pam_unix(sudo:session): session closed for user root Jul 10 15:55:07 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-de293c85-cd87-45f7-bd51-17ffbca6452d tempest-GroupSnapshotsV319Test-1868439518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-798770e5-14d3-417d-9b5a-78f9d29010a7.info" returned: 0 in 0.660s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:55:07 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-de293c85-cd87-45f7-bd51-17ffbca6452d tempest-GroupSnapshotsV319Test-1868439518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.038s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:55:07 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-939b7e30-e03b-4f1c-8a05-ecd024c0fa91 tempest-VolumesExtendTest-811549292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.698s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:55:07 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-939b7e30-e03b-4f1c-8a05-ecd024c0fa91 tempest-VolumesExtendTest-811549292 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:55:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1102453168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5193b91b-af28-473f-a4fb-70f05e0bc6a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5362398080014ae5a37b592fe4c11c0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:55:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:55:07Z,use_quota=True,user_id='f5eae745be434bf3b29491898558a731',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 15:55:07 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-939b7e30-e03b-4f1c-8a05-ecd024c0fa91 tempest-VolumesExtendTest-811549292 None] Creating volume 5193b91b-af28-473f-a4fb-70f05e0bc6a9 {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 15:55:07 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-939b7e30-e03b-4f1c-8a05-ecd024c0fa91 tempest-VolumesExtendTest-811549292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:55:07 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-939b7e30-e03b-4f1c-8a05-ecd024c0fa91 tempest-VolumesExtendTest-811549292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:55:07 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-939b7e30-e03b-4f1c-8a05-ecd024c0fa91 tempest-VolumesExtendTest-811549292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:55:07 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-939b7e30-e03b-4f1c-8a05-ecd024c0fa91 tempest-VolumesExtendTest-811549292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:55:07 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-939b7e30-e03b-4f1c-8a05-ecd024c0fa91 tempest-VolumesExtendTest-811549292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:55:07 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-939b7e30-e03b-4f1c-8a05-ecd024c0fa91 tempest-VolumesExtendTest-811549292 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 15:55:07 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-939b7e30-e03b-4f1c-8a05-ecd024c0fa91 tempest-VolumesExtendTest-811549292 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 15:55:07 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-939b7e30-e03b-4f1c-8a05-ecd024c0fa91 tempest-VolumesExtendTest-811549292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-5193b91b-af28-473f-a4fb-70f05e0bc6a9 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:55:07 devstack sudo[95439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-5193b91b-af28-473f-a4fb-70f05e0bc6a9 1073741824 Jul 10 15:55:07 devstack sudo[95439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:55:07 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-de293c85-cd87-45f7-bd51-17ffbca6452d tempest-GroupSnapshotsV319Test-1868439518 None] group_snapshot 63a5f060-b06c-41a8-9ec4-f545ac3464ab: created successfully Jul 10 15:55:08 devstack sudo[95439]: pam_unix(sudo:session): session closed for user root Jul 10 15:55:08 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-939b7e30-e03b-4f1c-8a05-ecd024c0fa91 tempest-VolumesExtendTest-811549292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-5193b91b-af28-473f-a4fb-70f05e0bc6a9 1073741824" returned: 0 in 0.893s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:55:08 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-939b7e30-e03b-4f1c-8a05-ecd024c0fa91 tempest-VolumesExtendTest-811549292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-5193b91b-af28-473f-a4fb-70f05e0bc6a9 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:55:08 devstack sudo[95444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-5193b91b-af28-473f-a4fb-70f05e0bc6a9 Jul 10 15:55:08 devstack sudo[95444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:55:08 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-f512d889-ac41-43a5-96f0-1b2b9c38de53 tempest-GroupSnapshotsV319Test-1868439518 None] group_snapshot 63a5f060-b06c-41a8-9ec4-f545ac3464ab: deleting Jul 10 15:55:09 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f512d889-ac41-43a5-96f0-1b2b9c38de53 tempest-GroupSnapshotsV319Test-1868439518 None] group_snapshot 63a5f060-b06c-41a8-9ec4-f545ac3464ab: deleting {{(pid=87420) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 10 15:55:09 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-f512d889-ac41-43a5-96f0-1b2b9c38de53 tempest-GroupSnapshotsV319Test-1868439518 None] Acquiring lock "cinder-quobyte-798770e5-14d3-417d-9b5a-78f9d29010a7" by "delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:55:09 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-f512d889-ac41-43a5-96f0-1b2b9c38de53 tempest-GroupSnapshotsV319Test-1868439518 None] Lock "cinder-quobyte-798770e5-14d3-417d-9b5a-78f9d29010a7" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:55:09 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-f512d889-ac41-43a5-96f0-1b2b9c38de53 tempest-GroupSnapshotsV319Test-1868439518 None] Acquiring lock "cinder-quobyte-5da781e1-d9dd-4cd3-b8a3-64b6eb1a9d35" by "_delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:55:09 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-f512d889-ac41-43a5-96f0-1b2b9c38de53 tempest-GroupSnapshotsV319Test-1868439518 None] Lock "cinder-quobyte-5da781e1-d9dd-4cd3-b8a3-64b6eb1a9d35" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:55:09 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-f512d889-ac41-43a5-96f0-1b2b9c38de53 tempest-GroupSnapshotsV319Test-1868439518 None] Deleting offline snapshot 5da781e1-d9dd-4cd3-b8a3-64b6eb1a9d35 of volume 798770e5-14d3-417d-9b5a-78f9d29010a7 {{(pid=87420) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 15:55:09 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-f512d889-ac41-43a5-96f0-1b2b9c38de53 tempest-GroupSnapshotsV319Test-1868439518 None] snapshot_file for this snap is: volume-798770e5-14d3-417d-9b5a-78f9d29010a7.5da781e1-d9dd-4cd3-b8a3-64b6eb1a9d35 {{(pid=87420) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 15:55:09 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[e26be07d-5733-4441-9a56-535f06503ff8]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:55:09 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f512d889-ac41-43a5-96f0-1b2b9c38de53 tempest-GroupSnapshotsV319Test-1868439518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-798770e5-14d3-417d-9b5a-78f9d29010a7.5da781e1-d9dd-4cd3-b8a3-64b6eb1a9d35 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:55:09 devstack sudo[95446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-798770e5-14d3-417d-9b5a-78f9d29010a7.5da781e1-d9dd-4cd3-b8a3-64b6eb1a9d35 Jul 10 15:55:09 devstack sudo[95446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:55:09 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-737967a8-bbbd-4a76-ad34-7d485c1ca730 tempest-AttachVolumeNegativeTest-1493731096 None] Acquiring lock "cinder-7dd4f338-20da-4557-b862-2ff5b19c12fb-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:55:09 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-737967a8-bbbd-4a76-ad34-7d485c1ca730 tempest-AttachVolumeNegativeTest-1493731096 None] Lock "cinder-7dd4f338-20da-4557-b862-2ff5b19c12fb-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:55:09 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-737967a8-bbbd-4a76-ad34-7d485c1ca730 tempest-AttachVolumeNegativeTest-1493731096 None] Acquiring lock "cinder-quobyte-7dd4f338-20da-4557-b862-2ff5b19c12fb" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:55:09 devstack sudo[95444]: pam_unix(sudo:session): session closed for user root Jul 10 15:55:09 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-939b7e30-e03b-4f1c-8a05-ecd024c0fa91 tempest-VolumesExtendTest-811549292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-5193b91b-af28-473f-a4fb-70f05e0bc6a9" returned: 0 in 0.801s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:55:09 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-939b7e30-e03b-4f1c-8a05-ecd024c0fa91 tempest-VolumesExtendTest-811549292 None] <== create_volume: return (1743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 15:55:09 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-939b7e30-e03b-4f1c-8a05-ecd024c0fa91 tempest-VolumesExtendTest-811549292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.748s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:55:09 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-939b7e30-e03b-4f1c-8a05-ecd024c0fa91 tempest-VolumesExtendTest-811549292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (155179fd-4783-417c-84c4-ad5cb606a67e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5193b91b-af28-473f-a4fb-70f05e0bc6a9', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:55:09 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-939b7e30-e03b-4f1c-8a05-ecd024c0fa91 tempest-VolumesExtendTest-811549292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d40e090-168c-40eb-bead-8a5a6d1154f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:55:09 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-737967a8-bbbd-4a76-ad34-7d485c1ca730 tempest-AttachVolumeNegativeTest-1493731096 None] Lock "cinder-quobyte-7dd4f338-20da-4557-b862-2ff5b19c12fb" acquired by "delete_volume" :: waited 0.041s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:55:09 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[526454f7-4627-4dcf-80d5-b77a92d0087f]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:55:09 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-737967a8-bbbd-4a76-ad34-7d485c1ca730 tempest-AttachVolumeNegativeTest-1493731096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7dd4f338-20da-4557-b862-2ff5b19c12fb {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:55:09 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-939b7e30-e03b-4f1c-8a05-ecd024c0fa91 tempest-VolumesExtendTest-811549292 None] Volume volume-5193b91b-af28-473f-a4fb-70f05e0bc6a9 (5193b91b-af28-473f-a4fb-70f05e0bc6a9): created successfully Jul 10 15:55:09 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-939b7e30-e03b-4f1c-8a05-ecd024c0fa91 tempest-VolumesExtendTest-811549292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d40e090-168c-40eb-bead-8a5a6d1154f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:55:09 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-939b7e30-e03b-4f1c-8a05-ecd024c0fa91 tempest-VolumesExtendTest-811549292 None] Flow 'volume_create_manager' (c08ef2cb-d878-41ff-99c3-d7a1544f49f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:55:09 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-939b7e30-e03b-4f1c-8a05-ecd024c0fa91 tempest-VolumesExtendTest-811549292 None] Created volume successfully. Jul 10 15:55:09 devstack sudo[95449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7dd4f338-20da-4557-b862-2ff5b19c12fb Jul 10 15:55:09 devstack sudo[95449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:55:09 devstack sudo[95446]: pam_unix(sudo:session): session closed for user root Jul 10 15:55:09 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f512d889-ac41-43a5-96f0-1b2b9c38de53 tempest-GroupSnapshotsV319Test-1868439518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-798770e5-14d3-417d-9b5a-78f9d29010a7.5da781e1-d9dd-4cd3-b8a3-64b6eb1a9d35" returned: 0 in 0.874s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:55:09 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-f512d889-ac41-43a5-96f0-1b2b9c38de53 tempest-GroupSnapshotsV319Test-1868439518 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-798770e5-14d3-417d-9b5a-78f9d29010a7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87420) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 15:55:10 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fdf552a-58c8-4b61-b262-e2164dc100d7]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:55:10 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f512d889-ac41-43a5-96f0-1b2b9c38de53 tempest-GroupSnapshotsV319Test-1868439518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-798770e5-14d3-417d-9b5a-78f9d29010a7 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:55:10 devstack sudo[95454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-798770e5-14d3-417d-9b5a-78f9d29010a7 Jul 10 15:55:10 devstack sudo[95454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:55:10 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-181e1661-8fe3-441e-a4bf-29366e291a38 tempest-VolumesExtendTest-811549292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:55:10 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-181e1661-8fe3-441e-a4bf-29366e291a38 tempest-VolumesExtendTest-811549292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:55:10 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-181e1661-8fe3-441e-a4bf-29366e291a38 tempest-VolumesExtendTest-811549292 None] Creating offline snapshot 84bedcef-5d8a-4828-bae9-19a77eb921de of volume 5193b91b-af28-473f-a4fb-70f05e0bc6a9 {{(pid=87420) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 15:55:10 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ac04b7-1b71-49a1-975f-f8a7ec655bd8]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:55:10 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-181e1661-8fe3-441e-a4bf-29366e291a38 tempest-VolumesExtendTest-811549292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-5193b91b-af28-473f-a4fb-70f05e0bc6a9 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:55:10 devstack sudo[95449]: pam_unix(sudo:session): session closed for user root Jul 10 15:55:10 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-737967a8-bbbd-4a76-ad34-7d485c1ca730 tempest-AttachVolumeNegativeTest-1493731096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7dd4f338-20da-4557-b862-2ff5b19c12fb" returned: 0 in 0.832s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:55:10 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-737967a8-bbbd-4a76-ad34-7d485c1ca730 tempest-AttachVolumeNegativeTest-1493731096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7dd4f338-20da-4557-b862-2ff5b19c12fb {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:55:10 devstack sudo[95460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7dd4f338-20da-4557-b862-2ff5b19c12fb Jul 10 15:55:10 devstack sudo[95460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:55:10 devstack sudo[95459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-5193b91b-af28-473f-a4fb-70f05e0bc6a9 Jul 10 15:55:10 devstack sudo[95459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:55:10 devstack sudo[95454]: pam_unix(sudo:session): session closed for user root Jul 10 15:55:10 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f512d889-ac41-43a5-96f0-1b2b9c38de53 tempest-GroupSnapshotsV319Test-1868439518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-798770e5-14d3-417d-9b5a-78f9d29010a7" returned: 0 in 0.844s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:55:10 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f512d889-ac41-43a5-96f0-1b2b9c38de53 tempest-GroupSnapshotsV319Test-1868439518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-798770e5-14d3-417d-9b5a-78f9d29010a7.5da781e1-d9dd-4cd3-b8a3-64b6eb1a9d35 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:55:10 devstack sudo[95466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-798770e5-14d3-417d-9b5a-78f9d29010a7.5da781e1-d9dd-4cd3-b8a3-64b6eb1a9d35 Jul 10 15:55:10 devstack sudo[95466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:55:11 devstack sudo[95460]: pam_unix(sudo:session): session closed for user root Jul 10 15:55:11 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-737967a8-bbbd-4a76-ad34-7d485c1ca730 tempest-AttachVolumeNegativeTest-1493731096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7dd4f338-20da-4557-b862-2ff5b19c12fb" returned: 0 in 0.677s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:55:11 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-737967a8-bbbd-4a76-ad34-7d485c1ca730 tempest-AttachVolumeNegativeTest-1493731096 None] Lock "cinder-quobyte-7dd4f338-20da-4557-b862-2ff5b19c12fb" released by "delete_volume" :: held 1.554s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:55:11 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-737967a8-bbbd-4a76-ad34-7d485c1ca730 tempest-AttachVolumeNegativeTest-1493731096 None] Created reservations ['b47789db-dd7e-43b1-adc5-f2ee0ceb466e', 'eb18f8db-3dcf-4663-95bc-e9c8de2ed572', 'd927c3e7-0828-4daf-a155-2e0dba552728', '9358b702-c1cd-45ad-a449-896510f0e1af'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 15:55:11 devstack sudo[95459]: pam_unix(sudo:session): session closed for user root Jul 10 15:55:11 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-181e1661-8fe3-441e-a4bf-29366e291a38 tempest-VolumesExtendTest-811549292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-5193b91b-af28-473f-a4fb-70f05e0bc6a9" returned: 0 in 0.804s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:55:11 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-181e1661-8fe3-441e-a4bf-29366e291a38 tempest-VolumesExtendTest-811549292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-5193b91b-af28-473f-a4fb-70f05e0bc6a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-5193b91b-af28-473f-a4fb-70f05e0bc6a9.84bedcef-5d8a-4828-bae9-19a77eb921de 1G {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:55:11 devstack sudo[95472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-5193b91b-af28-473f-a4fb-70f05e0bc6a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-5193b91b-af28-473f-a4fb-70f05e0bc6a9.84bedcef-5d8a-4828-bae9-19a77eb921de 1G Jul 10 15:55:11 devstack sudo[95472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:55:11 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-737967a8-bbbd-4a76-ad34-7d485c1ca730 tempest-AttachVolumeNegativeTest-1493731096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:55:11 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-737967a8-bbbd-4a76-ad34-7d485c1ca730 tempest-AttachVolumeNegativeTest-1493731096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:55:11 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-737967a8-bbbd-4a76-ad34-7d485c1ca730 tempest-AttachVolumeNegativeTest-1493731096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:55:11 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-737967a8-bbbd-4a76-ad34-7d485c1ca730 tempest-AttachVolumeNegativeTest-1493731096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:55:11 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-737967a8-bbbd-4a76-ad34-7d485c1ca730 tempest-AttachVolumeNegativeTest-1493731096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:55:11 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-737967a8-bbbd-4a76-ad34-7d485c1ca730 tempest-AttachVolumeNegativeTest-1493731096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:55:11 devstack sudo[95474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 15:55:11 devstack sudo[95474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:55:11 devstack sudo[95466]: pam_unix(sudo:session): session closed for user root Jul 10 15:55:11 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f512d889-ac41-43a5-96f0-1b2b9c38de53 tempest-GroupSnapshotsV319Test-1868439518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-798770e5-14d3-417d-9b5a-78f9d29010a7.5da781e1-d9dd-4cd3-b8a3-64b6eb1a9d35" returned: 0 in 0.826s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:55:11 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f512d889-ac41-43a5-96f0-1b2b9c38de53 tempest-GroupSnapshotsV319Test-1868439518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-798770e5-14d3-417d-9b5a-78f9d29010a7.5da781e1-d9dd-4cd3-b8a3-64b6eb1a9d35 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:55:11 devstack sudo[95565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-798770e5-14d3-417d-9b5a-78f9d29010a7.5da781e1-d9dd-4cd3-b8a3-64b6eb1a9d35 Jul 10 15:55:11 devstack sudo[95565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:55:11 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-5dcc28da-0caa-454e-be81-a0fecd7c7e33 tempest-AttachVolumeNegativeTest-1493731096 None] Acquiring lock "cinder-f3ff47dd-d0f3-47d8-9139-3b254f020454-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:55:11 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-5dcc28da-0caa-454e-be81-a0fecd7c7e33 tempest-AttachVolumeNegativeTest-1493731096 None] Lock "cinder-f3ff47dd-d0f3-47d8-9139-3b254f020454-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:55:11 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-5dcc28da-0caa-454e-be81-a0fecd7c7e33 tempest-AttachVolumeNegativeTest-1493731096 None] Acquiring lock "cinder-quobyte-f3ff47dd-d0f3-47d8-9139-3b254f020454" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:55:11 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-5dcc28da-0caa-454e-be81-a0fecd7c7e33 tempest-AttachVolumeNegativeTest-1493731096 None] Lock "cinder-quobyte-f3ff47dd-d0f3-47d8-9139-3b254f020454" acquired by "delete_volume" :: waited 0.021s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:55:11 devstack sudo[95474]: pam_unix(sudo:session): session closed for user root Jul 10 15:55:11 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-737967a8-bbbd-4a76-ad34-7d485c1ca730 tempest-AttachVolumeNegativeTest-1493731096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.734s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:55:11 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-737967a8-bbbd-4a76-ad34-7d485c1ca730 tempest-AttachVolumeNegativeTest-1493731096 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 15:55:11 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-737967a8-bbbd-4a76-ad34-7d485c1ca730 tempest-AttachVolumeNegativeTest-1493731096 None] Deleted volume successfully. Jul 10 15:55:11 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e2946c1-6bc6-4a3d-8d65-3ef936b5b7f6]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:55:11 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-5dcc28da-0caa-454e-be81-a0fecd7c7e33 tempest-AttachVolumeNegativeTest-1493731096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f3ff47dd-d0f3-47d8-9139-3b254f020454 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:55:11 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-737967a8-bbbd-4a76-ad34-7d485c1ca730 tempest-AttachVolumeNegativeTest-1493731096 None] Lock "cinder-7dd4f338-20da-4557-b862-2ff5b19c12fb-delete_volume" released by "delete_volume" :: held 2.585s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:55:12 devstack sudo[95573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f3ff47dd-d0f3-47d8-9139-3b254f020454 Jul 10 15:55:12 devstack sudo[95573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:55:12 devstack sudo[95472]: pam_unix(sudo:session): session closed for user root Jul 10 15:55:12 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-181e1661-8fe3-441e-a4bf-29366e291a38 tempest-VolumesExtendTest-811549292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-5193b91b-af28-473f-a4fb-70f05e0bc6a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-5193b91b-af28-473f-a4fb-70f05e0bc6a9.84bedcef-5d8a-4828-bae9-19a77eb921de 1G" returned: 0 in 1.048s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:55:12 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-181e1661-8fe3-441e-a4bf-29366e291a38 tempest-VolumesExtendTest-811549292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5193b91b-af28-473f-a4fb-70f05e0bc6a9 -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-5193b91b-af28-473f-a4fb-70f05e0bc6a9.84bedcef-5d8a-4828-bae9-19a77eb921de {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:55:12 devstack sudo[95576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5193b91b-af28-473f-a4fb-70f05e0bc6a9 -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-5193b91b-af28-473f-a4fb-70f05e0bc6a9.84bedcef-5d8a-4828-bae9-19a77eb921de Jul 10 15:55:12 devstack sudo[95576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:55:12 devstack sudo[95565]: pam_unix(sudo:session): session closed for user root Jul 10 15:55:12 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f512d889-ac41-43a5-96f0-1b2b9c38de53 tempest-GroupSnapshotsV319Test-1868439518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-798770e5-14d3-417d-9b5a-78f9d29010a7.5da781e1-d9dd-4cd3-b8a3-64b6eb1a9d35" returned: 0 in 0.886s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:55:12 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-f512d889-ac41-43a5-96f0-1b2b9c38de53 tempest-GroupSnapshotsV319Test-1868439518 None] Lock "cinder-quobyte-5da781e1-d9dd-4cd3-b8a3-64b6eb1a9d35" released by "_delete_snapshot" :: held 3.555s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:55:12 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-f512d889-ac41-43a5-96f0-1b2b9c38de53 tempest-GroupSnapshotsV319Test-1868439518 None] Lock "cinder-quobyte-798770e5-14d3-417d-9b5a-78f9d29010a7" released by "delete_snapshot" :: held 3.584s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:55:12 devstack cinder-volume[87420]: WARNING cinder.quota [None req-f512d889-ac41-43a5-96f0-1b2b9c38de53 tempest-GroupSnapshotsV319Test-1868439518 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-2052321238 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-2052321238, it is now deprecated. Please use the default quota class for default quota. Jul 10 15:55:12 devstack cinder-volume[87420]: WARNING cinder.quota [None req-f512d889-ac41-43a5-96f0-1b2b9c38de53 tempest-GroupSnapshotsV319Test-1868439518 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-2052321238 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-2052321238, it is now deprecated. Please use the default quota class for default quota. Jul 10 15:55:12 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-f512d889-ac41-43a5-96f0-1b2b9c38de53 tempest-GroupSnapshotsV319Test-1868439518 None] Created reservations ['5482aef4-9124-4293-82f1-ab1c492cc909', 'ad44f3e4-4427-42e2-b018-f7f2183665ee', '5ca5f8cc-606a-4400-a4ab-1df09d64f13f', '3fa4c2e3-7c0b-41e1-87bb-f1c43e3ac854'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 15:55:12 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-f512d889-ac41-43a5-96f0-1b2b9c38de53 tempest-GroupSnapshotsV319Test-1868439518 None] group_snapshot 63a5f060-b06c-41a8-9ec4-f545ac3464ab: deleted successfully Jul 10 15:55:12 devstack sudo[95573]: pam_unix(sudo:session): session closed for user root Jul 10 15:55:12 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-5dcc28da-0caa-454e-be81-a0fecd7c7e33 tempest-AttachVolumeNegativeTest-1493731096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f3ff47dd-d0f3-47d8-9139-3b254f020454" returned: 0 in 0.978s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:55:12 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-5dcc28da-0caa-454e-be81-a0fecd7c7e33 tempest-AttachVolumeNegativeTest-1493731096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f3ff47dd-d0f3-47d8-9139-3b254f020454 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:55:12 devstack sudo[95586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f3ff47dd-d0f3-47d8-9139-3b254f020454 Jul 10 15:55:12 devstack sudo[95586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:55:12 devstack sudo[95576]: pam_unix(sudo:session): session closed for user root Jul 10 15:55:12 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-181e1661-8fe3-441e-a4bf-29366e291a38 tempest-VolumesExtendTest-811549292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5193b91b-af28-473f-a4fb-70f05e0bc6a9 -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-5193b91b-af28-473f-a4fb-70f05e0bc6a9.84bedcef-5d8a-4828-bae9-19a77eb921de" returned: 0 in 0.791s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:55:12 devstack cinder-volume[87420]: WARNING cinder.volume.drivers.remotefs [None req-181e1661-8fe3-441e-a4bf-29366e291a38 tempest-VolumesExtendTest-811549292 None] /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-5193b91b-af28-473f-a4fb-70f05e0bc6a9.84bedcef-5d8a-4828-bae9-19a77eb921de is being set with open permissions: ugo+rw Jul 10 15:55:12 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-181e1661-8fe3-441e-a4bf-29366e291a38 tempest-VolumesExtendTest-811549292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-5193b91b-af28-473f-a4fb-70f05e0bc6a9.84bedcef-5d8a-4828-bae9-19a77eb921de {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:55:12 devstack sudo[95588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-5193b91b-af28-473f-a4fb-70f05e0bc6a9.84bedcef-5d8a-4828-bae9-19a77eb921de Jul 10 15:55:12 devstack sudo[95588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:55:13 devstack sudo[95586]: pam_unix(sudo:session): session closed for user root Jul 10 15:55:13 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-5dcc28da-0caa-454e-be81-a0fecd7c7e33 tempest-AttachVolumeNegativeTest-1493731096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f3ff47dd-d0f3-47d8-9139-3b254f020454" returned: 0 in 0.714s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:55:13 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-5dcc28da-0caa-454e-be81-a0fecd7c7e33 tempest-AttachVolumeNegativeTest-1493731096 None] Lock "cinder-quobyte-f3ff47dd-d0f3-47d8-9139-3b254f020454" released by "delete_volume" :: held 1.752s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:55:13 devstack sudo[95588]: pam_unix(sudo:session): session closed for user root Jul 10 15:55:13 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-181e1661-8fe3-441e-a4bf-29366e291a38 tempest-VolumesExtendTest-811549292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-5193b91b-af28-473f-a4fb-70f05e0bc6a9.84bedcef-5d8a-4828-bae9-19a77eb921de" returned: 0 in 0.732s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:55:13 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-5dcc28da-0caa-454e-be81-a0fecd7c7e33 tempest-AttachVolumeNegativeTest-1493731096 None] Created reservations ['944f3fd4-95ea-421a-9b87-7e9c9a50c606', 'fc96fddd-da88-48d4-aaed-9695337b23b7', '1a423422-d692-48dd-bff2-75b377a08f89', '7c1ee121-967c-4ed5-ad35-449e2ea1ecc1'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 15:55:13 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-181e1661-8fe3-441e-a4bf-29366e291a38 tempest-VolumesExtendTest-811549292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-5193b91b-af28-473f-a4fb-70f05e0bc6a9.info {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:55:13 devstack sudo[95592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-5193b91b-af28-473f-a4fb-70f05e0bc6a9.info Jul 10 15:55:13 devstack sudo[95592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:55:13 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-5f4d43d2-9634-461b-bf49-1c591464b2c2 tempest-GroupSnapshotsV319Test-1868439518 None] Acquiring lock "cinder-quobyte-798770e5-14d3-417d-9b5a-78f9d29010a7" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:55:13 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-5dcc28da-0caa-454e-be81-a0fecd7c7e33 tempest-AttachVolumeNegativeTest-1493731096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:55:13 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-5dcc28da-0caa-454e-be81-a0fecd7c7e33 tempest-AttachVolumeNegativeTest-1493731096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:55:13 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-5dcc28da-0caa-454e-be81-a0fecd7c7e33 tempest-AttachVolumeNegativeTest-1493731096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:55:13 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-5dcc28da-0caa-454e-be81-a0fecd7c7e33 tempest-AttachVolumeNegativeTest-1493731096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:55:13 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-5dcc28da-0caa-454e-be81-a0fecd7c7e33 tempest-AttachVolumeNegativeTest-1493731096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:55:13 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-5dcc28da-0caa-454e-be81-a0fecd7c7e33 tempest-AttachVolumeNegativeTest-1493731096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:55:13 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-5f4d43d2-9634-461b-bf49-1c591464b2c2 tempest-GroupSnapshotsV319Test-1868439518 None] Lock "cinder-quobyte-798770e5-14d3-417d-9b5a-78f9d29010a7" acquired by "delete_volume" :: waited 0.043s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:55:13 devstack sudo[95595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 15:55:13 devstack sudo[95595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:55:13 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d7b3402-6dd5-44dd-bbf3-f6fb2ea42353]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:55:13 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-5f4d43d2-9634-461b-bf49-1c591464b2c2 tempest-GroupSnapshotsV319Test-1868439518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-798770e5-14d3-417d-9b5a-78f9d29010a7 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:55:14 devstack sudo[95597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-798770e5-14d3-417d-9b5a-78f9d29010a7 Jul 10 15:55:14 devstack sudo[95597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:55:14 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-3f487a8e-9d08-4dd2-9152-cb49535a34ff tempest-AttachVolumeNegativeTest-1493731096 None] Acquiring lock "cinder-d379d9ec-b303-49c3-882c-2b898db59f2d-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:55:14 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-3f487a8e-9d08-4dd2-9152-cb49535a34ff tempest-AttachVolumeNegativeTest-1493731096 None] Lock "cinder-d379d9ec-b303-49c3-882c-2b898db59f2d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:55:14 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-3f487a8e-9d08-4dd2-9152-cb49535a34ff tempest-AttachVolumeNegativeTest-1493731096 None] Acquiring lock "cinder-quobyte-d379d9ec-b303-49c3-882c-2b898db59f2d" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:55:14 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-3f487a8e-9d08-4dd2-9152-cb49535a34ff tempest-AttachVolumeNegativeTest-1493731096 None] Lock "cinder-quobyte-d379d9ec-b303-49c3-882c-2b898db59f2d" acquired by "delete_volume" :: waited 0.023s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:55:14 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[a73d0924-637a-4248-8628-e20f309b34dd]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:55:14 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-3f487a8e-9d08-4dd2-9152-cb49535a34ff tempest-AttachVolumeNegativeTest-1493731096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d379d9ec-b303-49c3-882c-2b898db59f2d {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:55:14 devstack sudo[95600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d379d9ec-b303-49c3-882c-2b898db59f2d Jul 10 15:55:14 devstack sudo[95600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:55:14 devstack sudo[95592]: pam_unix(sudo:session): session closed for user root Jul 10 15:55:14 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-181e1661-8fe3-441e-a4bf-29366e291a38 tempest-VolumesExtendTest-811549292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-5193b91b-af28-473f-a4fb-70f05e0bc6a9.info" returned: 0 in 0.810s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:55:14 devstack cinder-volume[87420]: WARNING cinder.volume.drivers.remotefs [None req-181e1661-8fe3-441e-a4bf-29366e291a38 tempest-VolumesExtendTest-811549292 None] /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-5193b91b-af28-473f-a4fb-70f05e0bc6a9.info is being set with open permissions: ugo+rw Jul 10 15:55:14 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-181e1661-8fe3-441e-a4bf-29366e291a38 tempest-VolumesExtendTest-811549292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-5193b91b-af28-473f-a4fb-70f05e0bc6a9.info {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:55:14 devstack sudo[95604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-5193b91b-af28-473f-a4fb-70f05e0bc6a9.info Jul 10 15:55:14 devstack sudo[95604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:55:14 devstack sudo[95595]: pam_unix(sudo:session): session closed for user root Jul 10 15:55:14 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-5dcc28da-0caa-454e-be81-a0fecd7c7e33 tempest-AttachVolumeNegativeTest-1493731096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.799s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:55:14 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-5dcc28da-0caa-454e-be81-a0fecd7c7e33 tempest-AttachVolumeNegativeTest-1493731096 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 15:55:14 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-5dcc28da-0caa-454e-be81-a0fecd7c7e33 tempest-AttachVolumeNegativeTest-1493731096 None] Deleted volume successfully. Jul 10 15:55:14 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-5dcc28da-0caa-454e-be81-a0fecd7c7e33 tempest-AttachVolumeNegativeTest-1493731096 None] Lock "cinder-f3ff47dd-d0f3-47d8-9139-3b254f020454-delete_volume" released by "delete_volume" :: held 2.920s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:55:14 devstack sudo[95597]: pam_unix(sudo:session): session closed for user root Jul 10 15:55:14 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-5f4d43d2-9634-461b-bf49-1c591464b2c2 tempest-GroupSnapshotsV319Test-1868439518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-798770e5-14d3-417d-9b5a-78f9d29010a7" returned: 0 in 0.892s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:55:14 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-5f4d43d2-9634-461b-bf49-1c591464b2c2 tempest-GroupSnapshotsV319Test-1868439518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-798770e5-14d3-417d-9b5a-78f9d29010a7 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:55:14 devstack sudo[95609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-798770e5-14d3-417d-9b5a-78f9d29010a7 Jul 10 15:55:14 devstack sudo[95609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:55:15 devstack sudo[95600]: pam_unix(sudo:session): session closed for user root Jul 10 15:55:15 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-3f487a8e-9d08-4dd2-9152-cb49535a34ff tempest-AttachVolumeNegativeTest-1493731096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d379d9ec-b303-49c3-882c-2b898db59f2d" returned: 0 in 0.820s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:55:15 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-3f487a8e-9d08-4dd2-9152-cb49535a34ff tempest-AttachVolumeNegativeTest-1493731096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d379d9ec-b303-49c3-882c-2b898db59f2d {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:55:15 devstack sudo[95615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d379d9ec-b303-49c3-882c-2b898db59f2d Jul 10 15:55:15 devstack sudo[95615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:55:15 devstack sudo[95604]: pam_unix(sudo:session): session closed for user root Jul 10 15:55:15 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-181e1661-8fe3-441e-a4bf-29366e291a38 tempest-VolumesExtendTest-811549292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-5193b91b-af28-473f-a4fb-70f05e0bc6a9.info" returned: 0 in 0.685s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:55:15 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-181e1661-8fe3-441e-a4bf-29366e291a38 tempest-VolumesExtendTest-811549292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.064s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:55:15 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-181e1661-8fe3-441e-a4bf-29366e291a38 tempest-VolumesExtendTest-811549292 None] Create snapshot completed successfully Jul 10 15:55:15 devstack sudo[95609]: pam_unix(sudo:session): session closed for user root Jul 10 15:55:15 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-5f4d43d2-9634-461b-bf49-1c591464b2c2 tempest-GroupSnapshotsV319Test-1868439518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-798770e5-14d3-417d-9b5a-78f9d29010a7" returned: 0 in 0.698s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:55:15 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-5f4d43d2-9634-461b-bf49-1c591464b2c2 tempest-GroupSnapshotsV319Test-1868439518 None] Lock "cinder-quobyte-798770e5-14d3-417d-9b5a-78f9d29010a7" released by "delete_volume" :: held 1.683s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:55:15 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-a9393112-e634-48f1-b8d2-bd1a65bf4b7f tempest-VolumesExtendTest-811549292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:55:15 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-a9393112-e634-48f1-b8d2-bd1a65bf4b7f tempest-VolumesExtendTest-811549292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:55:15 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[95862e2b-9b1d-4da3-912a-1103bc2f78c6]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:55:15 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a9393112-e634-48f1-b8d2-bd1a65bf4b7f tempest-VolumesExtendTest-811549292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-5193b91b-af28-473f-a4fb-70f05e0bc6a9 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:55:15 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-5f4d43d2-9634-461b-bf49-1c591464b2c2 tempest-GroupSnapshotsV319Test-1868439518 None] Created reservations ['721dfa22-9c8d-48df-bc29-bf56703112fa'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 15:55:15 devstack cinder-volume[87420]: WARNING cinder.quota [None req-5f4d43d2-9634-461b-bf49-1c591464b2c2 tempest-GroupSnapshotsV319Test-1868439518 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-2052321238 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-2052321238, it is now deprecated. Please use the default quota class for default quota. Jul 10 15:55:15 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-5f4d43d2-9634-461b-bf49-1c591464b2c2 tempest-GroupSnapshotsV319Test-1868439518 None] Created reservations ['eb3026cb-309e-4707-8574-6b9a0f0df757', 'dbd55d74-31fa-4cff-805c-c17b85419675', 'bae85765-dd85-4e5d-8468-cbf3a72bbf1f', '22167af9-84c4-4031-aded-40cd7ef29698'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 15:55:15 devstack sudo[95619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-5193b91b-af28-473f-a4fb-70f05e0bc6a9 Jul 10 15:55:15 devstack sudo[95619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:55:15 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-5f4d43d2-9634-461b-bf49-1c591464b2c2 tempest-GroupSnapshotsV319Test-1868439518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:55:15 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-5f4d43d2-9634-461b-bf49-1c591464b2c2 tempest-GroupSnapshotsV319Test-1868439518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:55:15 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-5f4d43d2-9634-461b-bf49-1c591464b2c2 tempest-GroupSnapshotsV319Test-1868439518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:55:15 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-5f4d43d2-9634-461b-bf49-1c591464b2c2 tempest-GroupSnapshotsV319Test-1868439518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:55:15 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-5f4d43d2-9634-461b-bf49-1c591464b2c2 tempest-GroupSnapshotsV319Test-1868439518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:55:15 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-5f4d43d2-9634-461b-bf49-1c591464b2c2 tempest-GroupSnapshotsV319Test-1868439518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:55:15 devstack sudo[95622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 15:55:15 devstack sudo[95622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:55:15 devstack sudo[95615]: pam_unix(sudo:session): session closed for user root Jul 10 15:55:15 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-3f487a8e-9d08-4dd2-9152-cb49535a34ff tempest-AttachVolumeNegativeTest-1493731096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d379d9ec-b303-49c3-882c-2b898db59f2d" returned: 0 in 0.731s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:55:15 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-3f487a8e-9d08-4dd2-9152-cb49535a34ff tempest-AttachVolumeNegativeTest-1493731096 None] Lock "cinder-quobyte-d379d9ec-b303-49c3-882c-2b898db59f2d" released by "delete_volume" :: held 1.607s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:55:15 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-3f487a8e-9d08-4dd2-9152-cb49535a34ff tempest-AttachVolumeNegativeTest-1493731096 None] Created reservations ['0e193ed9-a78e-4823-ab9b-8837ae757605', '833d99a9-3087-4f36-aff5-c41de0090f54', 'edb383b6-cf0b-4c49-bec1-de18e42ee6bd', '0a633f54-f1e9-4be2-8047-72a15e4509a6'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 15:55:16 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-3f487a8e-9d08-4dd2-9152-cb49535a34ff tempest-AttachVolumeNegativeTest-1493731096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:55:16 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-3f487a8e-9d08-4dd2-9152-cb49535a34ff tempest-AttachVolumeNegativeTest-1493731096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:55:16 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-3f487a8e-9d08-4dd2-9152-cb49535a34ff tempest-AttachVolumeNegativeTest-1493731096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:55:16 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-3f487a8e-9d08-4dd2-9152-cb49535a34ff tempest-AttachVolumeNegativeTest-1493731096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:55:16 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-3f487a8e-9d08-4dd2-9152-cb49535a34ff tempest-AttachVolumeNegativeTest-1493731096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:55:16 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-3f487a8e-9d08-4dd2-9152-cb49535a34ff tempest-AttachVolumeNegativeTest-1493731096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:55:16 devstack sudo[95624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 15:55:16 devstack sudo[95624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:55:16 devstack sudo[95619]: pam_unix(sudo:session): session closed for user root Jul 10 15:55:16 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a9393112-e634-48f1-b8d2-bd1a65bf4b7f tempest-VolumesExtendTest-811549292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-5193b91b-af28-473f-a4fb-70f05e0bc6a9" returned: 0 in 0.912s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:55:16 devstack sudo[95622]: pam_unix(sudo:session): session closed for user root Jul 10 15:55:16 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a9393112-e634-48f1-b8d2-bd1a65bf4b7f tempest-VolumesExtendTest-811549292 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-5193b91b-af28-473f-a4fb-70f05e0bc6a9.84bedcef-5d8a-4828-bae9-19a77eb921de 2G {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:55:16 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-5f4d43d2-9634-461b-bf49-1c591464b2c2 tempest-GroupSnapshotsV319Test-1868439518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.753s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:55:16 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-5f4d43d2-9634-461b-bf49-1c591464b2c2 tempest-GroupSnapshotsV319Test-1868439518 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 15:55:16 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-5f4d43d2-9634-461b-bf49-1c591464b2c2 tempest-GroupSnapshotsV319Test-1868439518 None] Delete group completed successfully. Jul 10 15:55:16 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a9393112-e634-48f1-b8d2-bd1a65bf4b7f tempest-VolumesExtendTest-811549292 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-5193b91b-af28-473f-a4fb-70f05e0bc6a9.84bedcef-5d8a-4828-bae9-19a77eb921de 2G" returned: 0 in 0.184s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:55:16 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-a9393112-e634-48f1-b8d2-bd1a65bf4b7f tempest-VolumesExtendTest-811549292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.145s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:55:16 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-a9393112-e634-48f1-b8d2-bd1a65bf4b7f tempest-VolumesExtendTest-811549292 None] Extend volume completed successfully. Jul 10 15:55:16 devstack sudo[95624]: pam_unix(sudo:session): session closed for user root Jul 10 15:55:16 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-3f487a8e-9d08-4dd2-9152-cb49535a34ff tempest-AttachVolumeNegativeTest-1493731096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.885s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:55:16 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-3f487a8e-9d08-4dd2-9152-cb49535a34ff tempest-AttachVolumeNegativeTest-1493731096 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 15:55:16 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-3f487a8e-9d08-4dd2-9152-cb49535a34ff tempest-AttachVolumeNegativeTest-1493731096 None] Deleted volume successfully. Jul 10 15:55:16 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-3f487a8e-9d08-4dd2-9152-cb49535a34ff tempest-AttachVolumeNegativeTest-1493731096 None] Lock "cinder-d379d9ec-b303-49c3-882c-2b898db59f2d-delete_volume" released by "delete_volume" :: held 2.710s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:55:17 devstack cinder-volume[87420]: DEBUG oslo_service.periodic_task [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87420) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 15:55:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:55:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:55:17 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:55:17 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:55:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:55:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:55:17 devstack sudo[95635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 15:55:17 devstack sudo[95635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:55:18 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-54a97f36-55e2-4f64-882b-91e467ccf1d0 tempest-VolumesExtendTest-811549292 None] Acquiring lock "cinder-84bedcef-5d8a-4828-bae9-19a77eb921de-delete_snapshot" by "delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:55:18 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-54a97f36-55e2-4f64-882b-91e467ccf1d0 tempest-VolumesExtendTest-811549292 None] Lock "cinder-84bedcef-5d8a-4828-bae9-19a77eb921de-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:55:18 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-54a97f36-55e2-4f64-882b-91e467ccf1d0 tempest-VolumesExtendTest-811549292 None] Acquiring lock "cinder-quobyte-5193b91b-af28-473f-a4fb-70f05e0bc6a9" by "delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:55:18 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-54a97f36-55e2-4f64-882b-91e467ccf1d0 tempest-VolumesExtendTest-811549292 None] Lock "cinder-quobyte-5193b91b-af28-473f-a4fb-70f05e0bc6a9" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:55:18 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-54a97f36-55e2-4f64-882b-91e467ccf1d0 tempest-VolumesExtendTest-811549292 None] Acquiring lock "cinder-quobyte-84bedcef-5d8a-4828-bae9-19a77eb921de" by "_delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:55:18 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-54a97f36-55e2-4f64-882b-91e467ccf1d0 tempest-VolumesExtendTest-811549292 None] Lock "cinder-quobyte-84bedcef-5d8a-4828-bae9-19a77eb921de" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:55:18 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-54a97f36-55e2-4f64-882b-91e467ccf1d0 tempest-VolumesExtendTest-811549292 None] Deleting offline snapshot 84bedcef-5d8a-4828-bae9-19a77eb921de of volume 5193b91b-af28-473f-a4fb-70f05e0bc6a9 {{(pid=87420) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 15:55:18 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-54a97f36-55e2-4f64-882b-91e467ccf1d0 tempest-VolumesExtendTest-811549292 None] snapshot_file for this snap is: volume-5193b91b-af28-473f-a4fb-70f05e0bc6a9.84bedcef-5d8a-4828-bae9-19a77eb921de {{(pid=87420) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 15:55:18 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcb6ea5c-21d2-4d75-80ec-f730d4b0ad91]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:55:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-54a97f36-55e2-4f64-882b-91e467ccf1d0 tempest-VolumesExtendTest-811549292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-5193b91b-af28-473f-a4fb-70f05e0bc6a9.84bedcef-5d8a-4828-bae9-19a77eb921de {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:55:18 devstack sudo[95635]: pam_unix(sudo:session): session closed for user root Jul 10 15:55:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.986s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:55:18 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 15:55:18 devstack cinder-volume[87420]: DEBUG oslo_service.periodic_task [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Running periodic task VolumeManager._thread_info {{(pid=87420) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 15:55:18 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] thread count: 28 {{(pid=87420) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 15:55:18 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] thread info: [<_MainThread(MainThread, started 133639250378880)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87420) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 15:55:18 devstack sudo[95641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-5193b91b-af28-473f-a4fb-70f05e0bc6a9.84bedcef-5d8a-4828-bae9-19a77eb921de Jul 10 15:55:18 devstack sudo[95641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:55:18 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4eca1f6-0418-44f6-9029-e4a6c9883601 tempest-AttachVolumeTestJSON-927521694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 15:55:18 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f4eca1f6-0418-44f6-9029-e4a6c9883601 tempest-AttachVolumeTestJSON-927521694 None] Flow 'volume_create_manager' (767a856a-b3f6-476c-8cc8-b0fbce816980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:55:18 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f4eca1f6-0418-44f6-9029-e4a6c9883601 tempest-AttachVolumeTestJSON-927521694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd64f628-9cd7-4d41-8e7c-0d132c7fdd46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:55:18 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f4eca1f6-0418-44f6-9029-e4a6c9883601 tempest-AttachVolumeTestJSON-927521694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd64f628-9cd7-4d41-8e7c-0d132c7fdd46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:55:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-531532898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b754da21-8f5a-45d9-9967-0fc4f7d47dc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea67c374aa3346b2aad4092e92ea0fb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:55:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:55:19Z,use_quota=True,user_id='435cd5d215bb400995f051c97e8de689',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:55:18 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f4eca1f6-0418-44f6-9029-e4a6c9883601 tempest-AttachVolumeTestJSON-927521694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (407af30f-fcbb-4bf5-a8a2-fea09fb4a026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:55:18 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f4eca1f6-0418-44f6-9029-e4a6c9883601 tempest-AttachVolumeTestJSON-927521694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (407af30f-fcbb-4bf5-a8a2-fea09fb4a026) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:55:18 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f4eca1f6-0418-44f6-9029-e4a6c9883601 tempest-AttachVolumeTestJSON-927521694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90687f31-0a58-424a-9d77-ea759c9dd7d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:55:18 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f4eca1f6-0418-44f6-9029-e4a6c9883601 tempest-AttachVolumeTestJSON-927521694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90687f31-0a58-424a-9d77-ea759c9dd7d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b754da21-8f5a-45d9-9967-0fc4f7d47dc5', 'volume_name': 'volume-b754da21-8f5a-45d9-9967-0fc4f7d47dc5', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:55:18 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f4eca1f6-0418-44f6-9029-e4a6c9883601 tempest-AttachVolumeTestJSON-927521694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbc47858-d7b5-46e0-a55f-aad2b59de3aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:55:18 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f4eca1f6-0418-44f6-9029-e4a6c9883601 tempest-AttachVolumeTestJSON-927521694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbc47858-d7b5-46e0-a55f-aad2b59de3aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:55:18 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f4eca1f6-0418-44f6-9029-e4a6c9883601 tempest-AttachVolumeTestJSON-927521694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a907bdff-0c7b-49c7-aad5-34479cc66d75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:55:18 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-f4eca1f6-0418-44f6-9029-e4a6c9883601 tempest-AttachVolumeTestJSON-927521694 None] Volume b754da21-8f5a-45d9-9967-0fc4f7d47dc5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b754da21-8f5a-45d9-9967-0fc4f7d47dc5', 'volume_size': 1} Jul 10 15:55:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-f4eca1f6-0418-44f6-9029-e4a6c9883601 tempest-AttachVolumeTestJSON-927521694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:55:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-f4eca1f6-0418-44f6-9029-e4a6c9883601 tempest-AttachVolumeTestJSON-927521694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:55:18 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-f4eca1f6-0418-44f6-9029-e4a6c9883601 tempest-AttachVolumeTestJSON-927521694 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:55:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-531532898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b754da21-8f5a-45d9-9967-0fc4f7d47dc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea67c374aa3346b2aad4092e92ea0fb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:55:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:55:19Z,use_quota=True,user_id='435cd5d215bb400995f051c97e8de689',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 15:55:18 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-f4eca1f6-0418-44f6-9029-e4a6c9883601 tempest-AttachVolumeTestJSON-927521694 None] Creating volume b754da21-8f5a-45d9-9967-0fc4f7d47dc5 {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 15:55:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-f4eca1f6-0418-44f6-9029-e4a6c9883601 tempest-AttachVolumeTestJSON-927521694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:55:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-f4eca1f6-0418-44f6-9029-e4a6c9883601 tempest-AttachVolumeTestJSON-927521694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:55:18 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-f4eca1f6-0418-44f6-9029-e4a6c9883601 tempest-AttachVolumeTestJSON-927521694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:55:18 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-f4eca1f6-0418-44f6-9029-e4a6c9883601 tempest-AttachVolumeTestJSON-927521694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:55:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-f4eca1f6-0418-44f6-9029-e4a6c9883601 tempest-AttachVolumeTestJSON-927521694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:55:18 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-f4eca1f6-0418-44f6-9029-e4a6c9883601 tempest-AttachVolumeTestJSON-927521694 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 15:55:18 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-f4eca1f6-0418-44f6-9029-e4a6c9883601 tempest-AttachVolumeTestJSON-927521694 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 15:55:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f4eca1f6-0418-44f6-9029-e4a6c9883601 tempest-AttachVolumeTestJSON-927521694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b754da21-8f5a-45d9-9967-0fc4f7d47dc5 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:55:18 devstack sudo[95644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b754da21-8f5a-45d9-9967-0fc4f7d47dc5 1073741824 Jul 10 15:55:18 devstack sudo[95644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:55:19 devstack sudo[95641]: pam_unix(sudo:session): session closed for user root Jul 10 15:55:19 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-54a97f36-55e2-4f64-882b-91e467ccf1d0 tempest-VolumesExtendTest-811549292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-5193b91b-af28-473f-a4fb-70f05e0bc6a9.84bedcef-5d8a-4828-bae9-19a77eb921de" returned: 0 in 0.959s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:55:19 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-54a97f36-55e2-4f64-882b-91e467ccf1d0 tempest-VolumesExtendTest-811549292 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5193b91b-af28-473f-a4fb-70f05e0bc6a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87420) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 15:55:19 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d98a23-ac72-42a6-8cea-33fdf554a860]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:55:19 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-54a97f36-55e2-4f64-882b-91e467ccf1d0 tempest-VolumesExtendTest-811549292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-5193b91b-af28-473f-a4fb-70f05e0bc6a9 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:55:19 devstack sudo[95649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-5193b91b-af28-473f-a4fb-70f05e0bc6a9 Jul 10 15:55:19 devstack sudo[95649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:55:19 devstack sudo[95644]: pam_unix(sudo:session): session closed for user root Jul 10 15:55:19 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f4eca1f6-0418-44f6-9029-e4a6c9883601 tempest-AttachVolumeTestJSON-927521694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b754da21-8f5a-45d9-9967-0fc4f7d47dc5 1073741824" returned: 0 in 1.116s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:55:19 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f4eca1f6-0418-44f6-9029-e4a6c9883601 tempest-AttachVolumeTestJSON-927521694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b754da21-8f5a-45d9-9967-0fc4f7d47dc5 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:55:20 devstack sudo[95654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b754da21-8f5a-45d9-9967-0fc4f7d47dc5 Jul 10 15:55:20 devstack sudo[95654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:55:20 devstack sudo[95649]: pam_unix(sudo:session): session closed for user root Jul 10 15:55:20 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-54a97f36-55e2-4f64-882b-91e467ccf1d0 tempest-VolumesExtendTest-811549292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-5193b91b-af28-473f-a4fb-70f05e0bc6a9" returned: 0 in 1.128s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:55:20 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-54a97f36-55e2-4f64-882b-91e467ccf1d0 tempest-VolumesExtendTest-811549292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-5193b91b-af28-473f-a4fb-70f05e0bc6a9.84bedcef-5d8a-4828-bae9-19a77eb921de {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:55:20 devstack sudo[95659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-5193b91b-af28-473f-a4fb-70f05e0bc6a9.84bedcef-5d8a-4828-bae9-19a77eb921de Jul 10 15:55:20 devstack sudo[95659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:55:20 devstack sudo[95654]: pam_unix(sudo:session): session closed for user root Jul 10 15:55:20 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f4eca1f6-0418-44f6-9029-e4a6c9883601 tempest-AttachVolumeTestJSON-927521694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b754da21-8f5a-45d9-9967-0fc4f7d47dc5" returned: 0 in 0.899s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:55:20 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-f4eca1f6-0418-44f6-9029-e4a6c9883601 tempest-AttachVolumeTestJSON-927521694 None] <== create_volume: return (2073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 15:55:20 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-f4eca1f6-0418-44f6-9029-e4a6c9883601 tempest-AttachVolumeTestJSON-927521694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.076s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:55:20 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f4eca1f6-0418-44f6-9029-e4a6c9883601 tempest-AttachVolumeTestJSON-927521694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a907bdff-0c7b-49c7-aad5-34479cc66d75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b754da21-8f5a-45d9-9967-0fc4f7d47dc5', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:55:20 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f4eca1f6-0418-44f6-9029-e4a6c9883601 tempest-AttachVolumeTestJSON-927521694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22169747-c2a9-4df5-af36-9aafc693465d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:55:20 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-f4eca1f6-0418-44f6-9029-e4a6c9883601 tempest-AttachVolumeTestJSON-927521694 None] Volume volume-b754da21-8f5a-45d9-9967-0fc4f7d47dc5 (b754da21-8f5a-45d9-9967-0fc4f7d47dc5): created successfully Jul 10 15:55:20 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f4eca1f6-0418-44f6-9029-e4a6c9883601 tempest-AttachVolumeTestJSON-927521694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22169747-c2a9-4df5-af36-9aafc693465d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:55:20 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f4eca1f6-0418-44f6-9029-e4a6c9883601 tempest-AttachVolumeTestJSON-927521694 None] Flow 'volume_create_manager' (767a856a-b3f6-476c-8cc8-b0fbce816980) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:55:20 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-f4eca1f6-0418-44f6-9029-e4a6c9883601 tempest-AttachVolumeTestJSON-927521694 None] Created volume successfully. Jul 10 15:55:21 devstack sudo[95659]: pam_unix(sudo:session): session closed for user root Jul 10 15:55:21 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-54a97f36-55e2-4f64-882b-91e467ccf1d0 tempest-VolumesExtendTest-811549292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-5193b91b-af28-473f-a4fb-70f05e0bc6a9.84bedcef-5d8a-4828-bae9-19a77eb921de" returned: 0 in 1.145s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:55:21 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-54a97f36-55e2-4f64-882b-91e467ccf1d0 tempest-VolumesExtendTest-811549292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-5193b91b-af28-473f-a4fb-70f05e0bc6a9.84bedcef-5d8a-4828-bae9-19a77eb921de {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:55:21 devstack sudo[95667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-5193b91b-af28-473f-a4fb-70f05e0bc6a9.84bedcef-5d8a-4828-bae9-19a77eb921de Jul 10 15:55:21 devstack sudo[95667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:55:22 devstack sudo[95667]: pam_unix(sudo:session): session closed for user root Jul 10 15:55:22 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-54a97f36-55e2-4f64-882b-91e467ccf1d0 tempest-VolumesExtendTest-811549292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-5193b91b-af28-473f-a4fb-70f05e0bc6a9.84bedcef-5d8a-4828-bae9-19a77eb921de" returned: 0 in 0.708s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:55:22 devstack cinder-volume[87420]: DEBUG dbcounter [-] [87420] Writing DB stats cinder:SELECT=113,cinder:UPDATE=113,cinder:INSERT=25,cinder:DELETE=11 {{(pid=87420) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 15:55:22 devstack cinder-volume[87420]: DEBUG dbcounter [-] [87420] Writing DB stats cinder:SELECT=89,cinder:UPDATE=123,cinder:INSERT=39,cinder:DELETE=6 {{(pid=87420) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 15:55:22 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-54a97f36-55e2-4f64-882b-91e467ccf1d0 tempest-VolumesExtendTest-811549292 None] Lock "cinder-quobyte-84bedcef-5d8a-4828-bae9-19a77eb921de" released by "_delete_snapshot" :: held 4.099s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:55:22 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-54a97f36-55e2-4f64-882b-91e467ccf1d0 tempest-VolumesExtendTest-811549292 None] Lock "cinder-quobyte-5193b91b-af28-473f-a4fb-70f05e0bc6a9" released by "delete_snapshot" :: held 4.148s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:55:22 devstack cinder-volume[87420]: WARNING cinder.quota [None req-54a97f36-55e2-4f64-882b-91e467ccf1d0 tempest-VolumesExtendTest-811549292 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 10 15:55:22 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-54a97f36-55e2-4f64-882b-91e467ccf1d0 tempest-VolumesExtendTest-811549292 None] Created reservations ['43b42d53-6125-4ba4-843a-79ffa12f6599', '3c5d8c4a-aaf7-4c6a-b8c2-43e78472d52e', '6639f294-3f79-4885-af60-3c190d9865a7', '5caed521-11e2-47a6-b200-bb68528569e4'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 15:55:22 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-54a97f36-55e2-4f64-882b-91e467ccf1d0 tempest-VolumesExtendTest-811549292 None] Delete snapshot completed successfully. Jul 10 15:55:22 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-54a97f36-55e2-4f64-882b-91e467ccf1d0 tempest-VolumesExtendTest-811549292 None] Lock "cinder-84bedcef-5d8a-4828-bae9-19a77eb921de-delete_snapshot" released by "delete_snapshot" :: held 4.384s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:55:23 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-6229f714-f799-4739-a092-4c4dcaa504e5 tempest-VolumesExtendTest-811549292 None] Acquiring lock "cinder-5193b91b-af28-473f-a4fb-70f05e0bc6a9-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:55:23 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-6229f714-f799-4739-a092-4c4dcaa504e5 tempest-VolumesExtendTest-811549292 None] Lock "cinder-5193b91b-af28-473f-a4fb-70f05e0bc6a9-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:55:23 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-6229f714-f799-4739-a092-4c4dcaa504e5 tempest-VolumesExtendTest-811549292 None] Acquiring lock "cinder-quobyte-5193b91b-af28-473f-a4fb-70f05e0bc6a9" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:55:23 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-6229f714-f799-4739-a092-4c4dcaa504e5 tempest-VolumesExtendTest-811549292 None] Lock "cinder-quobyte-5193b91b-af28-473f-a4fb-70f05e0bc6a9" acquired by "delete_volume" :: waited 0.015s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:55:23 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[8570d233-6c45-4e93-aac0-ed20bd347d16]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:55:23 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6229f714-f799-4739-a092-4c4dcaa504e5 tempest-VolumesExtendTest-811549292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-5193b91b-af28-473f-a4fb-70f05e0bc6a9 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:55:23 devstack sudo[95676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-5193b91b-af28-473f-a4fb-70f05e0bc6a9 Jul 10 15:55:23 devstack sudo[95676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:55:24 devstack sudo[95676]: pam_unix(sudo:session): session closed for user root Jul 10 15:55:24 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6229f714-f799-4739-a092-4c4dcaa504e5 tempest-VolumesExtendTest-811549292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-5193b91b-af28-473f-a4fb-70f05e0bc6a9" returned: 0 in 1.039s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:55:24 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6229f714-f799-4739-a092-4c4dcaa504e5 tempest-VolumesExtendTest-811549292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-5193b91b-af28-473f-a4fb-70f05e0bc6a9 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:55:24 devstack sudo[95683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-5193b91b-af28-473f-a4fb-70f05e0bc6a9 Jul 10 15:55:24 devstack sudo[95683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:55:25 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [req-8bc0cd57-147b-4c45-ac0d-4657f596f8d7 req-108f40c8-83f3-400e-b600-014f3b009268 tempest-AttachVolumeTestJSON-927521694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:55:25 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [req-8bc0cd57-147b-4c45-ac0d-4657f596f8d7 req-108f40c8-83f3-400e-b600-014f3b009268 tempest-AttachVolumeTestJSON-927521694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:55:25 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[7687f0cd-b46a-474d-bcb0-40f35052a185]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:55:25 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [req-8bc0cd57-147b-4c45-ac0d-4657f596f8d7 req-108f40c8-83f3-400e-b600-014f3b009268 tempest-AttachVolumeTestJSON-927521694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b754da21-8f5a-45d9-9967-0fc4f7d47dc5 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:55:25 devstack sudo[95693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b754da21-8f5a-45d9-9967-0fc4f7d47dc5 Jul 10 15:55:25 devstack sudo[95693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:55:25 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [req-5da59cad-6de6-46c8-9f9a-4d36692d9c2d req-01fa5442-e9ae-4d8b-8ee1-f9043fcaf302 tempest-VolumesSnapshotsTestJSON-327621538 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 15:55:25 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [req-5da59cad-6de6-46c8-9f9a-4d36692d9c2d req-01fa5442-e9ae-4d8b-8ee1-f9043fcaf302 tempest-VolumesSnapshotsTestJSON-327621538 None] Flow 'volume_create_manager' (27185cbe-5c69-4cd7-a1a1-c7c031814b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:55:25 devstack sudo[95683]: pam_unix(sudo:session): session closed for user root Jul 10 15:55:25 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [req-5da59cad-6de6-46c8-9f9a-4d36692d9c2d req-01fa5442-e9ae-4d8b-8ee1-f9043fcaf302 tempest-VolumesSnapshotsTestJSON-327621538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf59aa3b-ec31-4256-b15b-04c30cc1ca3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:55:25 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6229f714-f799-4739-a092-4c4dcaa504e5 tempest-VolumesExtendTest-811549292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-5193b91b-af28-473f-a4fb-70f05e0bc6a9" returned: 0 in 0.955s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:55:25 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [req-5da59cad-6de6-46c8-9f9a-4d36692d9c2d req-01fa5442-e9ae-4d8b-8ee1-f9043fcaf302 tempest-VolumesSnapshotsTestJSON-327621538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf59aa3b-ec31-4256-b15b-04c30cc1ca3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:55:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1518579863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d91e9878-7122-4191-99ba-b430df1ca82a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ea28d7c55824eba9596789b72a33e58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:55:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:55:26Z,use_quota=True,user_id='02c4b770d59e422dab211960f87395cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:55:25 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [req-5da59cad-6de6-46c8-9f9a-4d36692d9c2d req-01fa5442-e9ae-4d8b-8ee1-f9043fcaf302 tempest-VolumesSnapshotsTestJSON-327621538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9801ca3a-54cd-4ec6-a102-f0db3bd25c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:55:25 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [req-5da59cad-6de6-46c8-9f9a-4d36692d9c2d req-01fa5442-e9ae-4d8b-8ee1-f9043fcaf302 tempest-VolumesSnapshotsTestJSON-327621538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9801ca3a-54cd-4ec6-a102-f0db3bd25c5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:55:25 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [req-5da59cad-6de6-46c8-9f9a-4d36692d9c2d req-01fa5442-e9ae-4d8b-8ee1-f9043fcaf302 tempest-VolumesSnapshotsTestJSON-327621538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9141a781-9493-4e98-a28c-6df6e2192472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:55:25 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [req-5da59cad-6de6-46c8-9f9a-4d36692d9c2d req-01fa5442-e9ae-4d8b-8ee1-f9043fcaf302 tempest-VolumesSnapshotsTestJSON-327621538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9141a781-9493-4e98-a28c-6df6e2192472) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd91e9878-7122-4191-99ba-b430df1ca82a', 'volume_name': 'volume-d91e9878-7122-4191-99ba-b430df1ca82a', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:55:25 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [req-5da59cad-6de6-46c8-9f9a-4d36692d9c2d req-01fa5442-e9ae-4d8b-8ee1-f9043fcaf302 tempest-VolumesSnapshotsTestJSON-327621538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34539671-0c81-4cf0-96a3-b757b56ad757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:55:25 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [req-5da59cad-6de6-46c8-9f9a-4d36692d9c2d req-01fa5442-e9ae-4d8b-8ee1-f9043fcaf302 tempest-VolumesSnapshotsTestJSON-327621538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34539671-0c81-4cf0-96a3-b757b56ad757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:55:25 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [req-5da59cad-6de6-46c8-9f9a-4d36692d9c2d req-01fa5442-e9ae-4d8b-8ee1-f9043fcaf302 tempest-VolumesSnapshotsTestJSON-327621538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4229b18f-6cfe-47ad-9541-e69ac6d5ddd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:55:25 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [req-5da59cad-6de6-46c8-9f9a-4d36692d9c2d req-01fa5442-e9ae-4d8b-8ee1-f9043fcaf302 tempest-VolumesSnapshotsTestJSON-327621538 None] Volume d91e9878-7122-4191-99ba-b430df1ca82a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d91e9878-7122-4191-99ba-b430df1ca82a', 'volume_size': 1} Jul 10 15:55:25 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [req-5da59cad-6de6-46c8-9f9a-4d36692d9c2d req-01fa5442-e9ae-4d8b-8ee1-f9043fcaf302 tempest-VolumesSnapshotsTestJSON-327621538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:55:25 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-6229f714-f799-4739-a092-4c4dcaa504e5 tempest-VolumesExtendTest-811549292 None] Lock "cinder-quobyte-5193b91b-af28-473f-a4fb-70f05e0bc6a9" released by "delete_volume" :: held 2.117s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:55:25 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-6229f714-f799-4739-a092-4c4dcaa504e5 tempest-VolumesExtendTest-811549292 None] Created reservations ['198609d5-4dfa-4278-9f22-3be95c64dbe9', '007e9084-e137-4df6-9df9-6937e8d182d2', '46c52d9e-45dc-4dda-9627-d58c648710cc', '0b853c76-e6b3-4976-9507-6151884cc1d9'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 15:55:25 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-6229f714-f799-4739-a092-4c4dcaa504e5 tempest-VolumesExtendTest-811549292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:55:25 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-6229f714-f799-4739-a092-4c4dcaa504e5 tempest-VolumesExtendTest-811549292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:55:25 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-6229f714-f799-4739-a092-4c4dcaa504e5 tempest-VolumesExtendTest-811549292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:55:25 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-6229f714-f799-4739-a092-4c4dcaa504e5 tempest-VolumesExtendTest-811549292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:55:25 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-6229f714-f799-4739-a092-4c4dcaa504e5 tempest-VolumesExtendTest-811549292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:55:25 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6229f714-f799-4739-a092-4c4dcaa504e5 tempest-VolumesExtendTest-811549292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:55:25 devstack sudo[95696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 15:55:25 devstack sudo[95696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:55:26 devstack sudo[95693]: pam_unix(sudo:session): session closed for user root Jul 10 15:55:26 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [req-8bc0cd57-147b-4c45-ac0d-4657f596f8d7 req-108f40c8-83f3-400e-b600-014f3b009268 tempest-AttachVolumeTestJSON-927521694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b754da21-8f5a-45d9-9967-0fc4f7d47dc5" returned: 0 in 1.128s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:55:26 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [req-8bc0cd57-147b-4c45-ac0d-4657f596f8d7 req-108f40c8-83f3-400e-b600-014f3b009268 tempest-AttachVolumeTestJSON-927521694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.151s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:55:26 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [req-5da59cad-6de6-46c8-9f9a-4d36692d9c2d req-01fa5442-e9ae-4d8b-8ee1-f9043fcaf302 tempest-VolumesSnapshotsTestJSON-327621538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.496s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:55:26 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [req-5da59cad-6de6-46c8-9f9a-4d36692d9c2d req-01fa5442-e9ae-4d8b-8ee1-f9043fcaf302 tempest-VolumesSnapshotsTestJSON-327621538 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:55:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1518579863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d91e9878-7122-4191-99ba-b430df1ca82a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ea28d7c55824eba9596789b72a33e58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:55:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:55:26Z,use_quota=True,user_id='02c4b770d59e422dab211960f87395cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 15:55:26 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [req-5da59cad-6de6-46c8-9f9a-4d36692d9c2d req-01fa5442-e9ae-4d8b-8ee1-f9043fcaf302 tempest-VolumesSnapshotsTestJSON-327621538 None] Creating volume d91e9878-7122-4191-99ba-b430df1ca82a {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 15:55:26 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [req-5da59cad-6de6-46c8-9f9a-4d36692d9c2d req-01fa5442-e9ae-4d8b-8ee1-f9043fcaf302 tempest-VolumesSnapshotsTestJSON-327621538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:55:26 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [req-5da59cad-6de6-46c8-9f9a-4d36692d9c2d req-01fa5442-e9ae-4d8b-8ee1-f9043fcaf302 tempest-VolumesSnapshotsTestJSON-327621538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:55:26 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [req-5da59cad-6de6-46c8-9f9a-4d36692d9c2d req-01fa5442-e9ae-4d8b-8ee1-f9043fcaf302 tempest-VolumesSnapshotsTestJSON-327621538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:55:26 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [req-5da59cad-6de6-46c8-9f9a-4d36692d9c2d req-01fa5442-e9ae-4d8b-8ee1-f9043fcaf302 tempest-VolumesSnapshotsTestJSON-327621538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:55:26 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [req-5da59cad-6de6-46c8-9f9a-4d36692d9c2d req-01fa5442-e9ae-4d8b-8ee1-f9043fcaf302 tempest-VolumesSnapshotsTestJSON-327621538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:55:26 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [req-5da59cad-6de6-46c8-9f9a-4d36692d9c2d req-01fa5442-e9ae-4d8b-8ee1-f9043fcaf302 tempest-VolumesSnapshotsTestJSON-327621538 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 15:55:26 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [req-5da59cad-6de6-46c8-9f9a-4d36692d9c2d req-01fa5442-e9ae-4d8b-8ee1-f9043fcaf302 tempest-VolumesSnapshotsTestJSON-327621538 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 15:55:26 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [req-5da59cad-6de6-46c8-9f9a-4d36692d9c2d req-01fa5442-e9ae-4d8b-8ee1-f9043fcaf302 tempest-VolumesSnapshotsTestJSON-327621538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d91e9878-7122-4191-99ba-b430df1ca82a 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:55:26 devstack sudo[95701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d91e9878-7122-4191-99ba-b430df1ca82a 1073741824 Jul 10 15:55:26 devstack sudo[95701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:55:26 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [req-8bc0cd57-147b-4c45-ac0d-4657f596f8d7 req-108f40c8-83f3-400e-b600-014f3b009268 tempest-AttachVolumeTestJSON-927521694 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80', 'name': 'volume-b754da21-8f5a-45d9-9967-0fc4f7d47dc5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '883c3a5e-2702-4615-8640-e050d0938c07', 'enforce_multipath': True} {{(pid=87420) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 15:55:26 devstack cinder-volume[87420]: INFO cinder.volume.manager [req-8bc0cd57-147b-4c45-ac0d-4657f596f8d7 req-108f40c8-83f3-400e-b600-014f3b009268 tempest-AttachVolumeTestJSON-927521694 None] attachment_update completed successfully. Jul 10 15:55:26 devstack sudo[95696]: pam_unix(sudo:session): session closed for user root Jul 10 15:55:26 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6229f714-f799-4739-a092-4c4dcaa504e5 tempest-VolumesExtendTest-811549292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.780s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:55:26 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-6229f714-f799-4739-a092-4c4dcaa504e5 tempest-VolumesExtendTest-811549292 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 15:55:26 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-6229f714-f799-4739-a092-4c4dcaa504e5 tempest-VolumesExtendTest-811549292 None] Deleted volume successfully. Jul 10 15:55:26 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-6229f714-f799-4739-a092-4c4dcaa504e5 tempest-VolumesExtendTest-811549292 None] Lock "cinder-5193b91b-af28-473f-a4fb-70f05e0bc6a9-delete_volume" released by "delete_volume" :: held 3.127s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:55:27 devstack sudo[95701]: pam_unix(sudo:session): session closed for user root Jul 10 15:55:27 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [req-5da59cad-6de6-46c8-9f9a-4d36692d9c2d req-01fa5442-e9ae-4d8b-8ee1-f9043fcaf302 tempest-VolumesSnapshotsTestJSON-327621538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d91e9878-7122-4191-99ba-b430df1ca82a 1073741824" returned: 0 in 1.040s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:55:27 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [req-5da59cad-6de6-46c8-9f9a-4d36692d9c2d req-01fa5442-e9ae-4d8b-8ee1-f9043fcaf302 tempest-VolumesSnapshotsTestJSON-327621538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d91e9878-7122-4191-99ba-b430df1ca82a {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:55:27 devstack sudo[95775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d91e9878-7122-4191-99ba-b430df1ca82a Jul 10 15:55:27 devstack sudo[95775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:55:28 devstack sudo[95775]: pam_unix(sudo:session): session closed for user root Jul 10 15:55:28 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [req-5da59cad-6de6-46c8-9f9a-4d36692d9c2d req-01fa5442-e9ae-4d8b-8ee1-f9043fcaf302 tempest-VolumesSnapshotsTestJSON-327621538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d91e9878-7122-4191-99ba-b430df1ca82a" returned: 0 in 0.923s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:55:28 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [req-5da59cad-6de6-46c8-9f9a-4d36692d9c2d req-01fa5442-e9ae-4d8b-8ee1-f9043fcaf302 tempest-VolumesSnapshotsTestJSON-327621538 None] <== create_volume: return (2010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 15:55:28 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [req-5da59cad-6de6-46c8-9f9a-4d36692d9c2d req-01fa5442-e9ae-4d8b-8ee1-f9043fcaf302 tempest-VolumesSnapshotsTestJSON-327621538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.012s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:55:28 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [req-5da59cad-6de6-46c8-9f9a-4d36692d9c2d req-01fa5442-e9ae-4d8b-8ee1-f9043fcaf302 tempest-VolumesSnapshotsTestJSON-327621538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4229b18f-6cfe-47ad-9541-e69ac6d5ddd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d91e9878-7122-4191-99ba-b430df1ca82a', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:55:28 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [req-5da59cad-6de6-46c8-9f9a-4d36692d9c2d req-01fa5442-e9ae-4d8b-8ee1-f9043fcaf302 tempest-VolumesSnapshotsTestJSON-327621538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e99698e-2d8d-4889-be0d-603bc5214a79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:55:28 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [req-5da59cad-6de6-46c8-9f9a-4d36692d9c2d req-01fa5442-e9ae-4d8b-8ee1-f9043fcaf302 tempest-VolumesSnapshotsTestJSON-327621538 None] Volume volume-d91e9878-7122-4191-99ba-b430df1ca82a (d91e9878-7122-4191-99ba-b430df1ca82a): created successfully Jul 10 15:55:28 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [req-5da59cad-6de6-46c8-9f9a-4d36692d9c2d req-01fa5442-e9ae-4d8b-8ee1-f9043fcaf302 tempest-VolumesSnapshotsTestJSON-327621538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e99698e-2d8d-4889-be0d-603bc5214a79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:55:28 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [req-5da59cad-6de6-46c8-9f9a-4d36692d9c2d req-01fa5442-e9ae-4d8b-8ee1-f9043fcaf302 tempest-VolumesSnapshotsTestJSON-327621538 None] Flow 'volume_create_manager' (27185cbe-5c69-4cd7-a1a1-c7c031814b5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:55:28 devstack cinder-volume[87420]: INFO cinder.volume.manager [req-5da59cad-6de6-46c8-9f9a-4d36692d9c2d req-01fa5442-e9ae-4d8b-8ee1-f9043fcaf302 tempest-VolumesSnapshotsTestJSON-327621538 None] Created volume successfully. Jul 10 15:55:29 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [req-a8772252-fb70-466d-89ed-9684919b18bf req-07b67b4f-3bfc-4ae1-80e8-84427c450491 tempest-VolumesSnapshotsTestJSON-327621538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:55:29 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [req-a8772252-fb70-466d-89ed-9684919b18bf req-07b67b4f-3bfc-4ae1-80e8-84427c450491 tempest-VolumesSnapshotsTestJSON-327621538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:55:29 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [req-a8772252-fb70-466d-89ed-9684919b18bf req-07b67b4f-3bfc-4ae1-80e8-84427c450491 tempest-VolumesSnapshotsTestJSON-327621538 None] Creating offline snapshot 0ef273d3-1525-4583-b956-a61a1f98ad1f of volume d91e9878-7122-4191-99ba-b430df1ca82a {{(pid=87420) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 15:55:29 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c715f91-e678-48bf-935d-60a6f76edf54]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:55:29 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [req-a8772252-fb70-466d-89ed-9684919b18bf req-07b67b4f-3bfc-4ae1-80e8-84427c450491 tempest-VolumesSnapshotsTestJSON-327621538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d91e9878-7122-4191-99ba-b430df1ca82a {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:55:29 devstack sudo[96129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d91e9878-7122-4191-99ba-b430df1ca82a Jul 10 15:55:29 devstack sudo[96129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:55:30 devstack sudo[96129]: pam_unix(sudo:session): session closed for user root Jul 10 15:55:30 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [req-a8772252-fb70-466d-89ed-9684919b18bf req-07b67b4f-3bfc-4ae1-80e8-84427c450491 tempest-VolumesSnapshotsTestJSON-327621538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d91e9878-7122-4191-99ba-b430df1ca82a" returned: 0 in 0.926s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:55:30 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [req-a8772252-fb70-466d-89ed-9684919b18bf req-07b67b4f-3bfc-4ae1-80e8-84427c450491 tempest-VolumesSnapshotsTestJSON-327621538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d91e9878-7122-4191-99ba-b430df1ca82a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d91e9878-7122-4191-99ba-b430df1ca82a.0ef273d3-1525-4583-b956-a61a1f98ad1f 1G {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:55:30 devstack sudo[96134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d91e9878-7122-4191-99ba-b430df1ca82a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d91e9878-7122-4191-99ba-b430df1ca82a.0ef273d3-1525-4583-b956-a61a1f98ad1f 1G Jul 10 15:55:30 devstack sudo[96134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:55:31 devstack sudo[96134]: pam_unix(sudo:session): session closed for user root Jul 10 15:55:31 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [req-a8772252-fb70-466d-89ed-9684919b18bf req-07b67b4f-3bfc-4ae1-80e8-84427c450491 tempest-VolumesSnapshotsTestJSON-327621538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d91e9878-7122-4191-99ba-b430df1ca82a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d91e9878-7122-4191-99ba-b430df1ca82a.0ef273d3-1525-4583-b956-a61a1f98ad1f 1G" returned: 0 in 0.995s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:55:31 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [req-a8772252-fb70-466d-89ed-9684919b18bf req-07b67b4f-3bfc-4ae1-80e8-84427c450491 tempest-VolumesSnapshotsTestJSON-327621538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d91e9878-7122-4191-99ba-b430df1ca82a -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d91e9878-7122-4191-99ba-b430df1ca82a.0ef273d3-1525-4583-b956-a61a1f98ad1f {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:55:31 devstack sudo[96140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d91e9878-7122-4191-99ba-b430df1ca82a -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d91e9878-7122-4191-99ba-b430df1ca82a.0ef273d3-1525-4583-b956-a61a1f98ad1f Jul 10 15:55:31 devstack sudo[96140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:55:32 devstack sudo[96140]: pam_unix(sudo:session): session closed for user root Jul 10 15:55:32 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [req-a8772252-fb70-466d-89ed-9684919b18bf req-07b67b4f-3bfc-4ae1-80e8-84427c450491 tempest-VolumesSnapshotsTestJSON-327621538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d91e9878-7122-4191-99ba-b430df1ca82a -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d91e9878-7122-4191-99ba-b430df1ca82a.0ef273d3-1525-4583-b956-a61a1f98ad1f" returned: 0 in 1.006s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:55:32 devstack cinder-volume[87420]: WARNING cinder.volume.drivers.remotefs [req-a8772252-fb70-466d-89ed-9684919b18bf req-07b67b4f-3bfc-4ae1-80e8-84427c450491 tempest-VolumesSnapshotsTestJSON-327621538 None] /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d91e9878-7122-4191-99ba-b430df1ca82a.0ef273d3-1525-4583-b956-a61a1f98ad1f is being set with open permissions: ugo+rw Jul 10 15:55:32 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [req-a8772252-fb70-466d-89ed-9684919b18bf req-07b67b4f-3bfc-4ae1-80e8-84427c450491 tempest-VolumesSnapshotsTestJSON-327621538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d91e9878-7122-4191-99ba-b430df1ca82a.0ef273d3-1525-4583-b956-a61a1f98ad1f {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:55:32 devstack sudo[96145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d91e9878-7122-4191-99ba-b430df1ca82a.0ef273d3-1525-4583-b956-a61a1f98ad1f Jul 10 15:55:32 devstack sudo[96145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:55:32 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-05812ed2-3130-49d4-932a-20f95d499442 tempest-AttachVolumeTestJSON-927521694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 15:55:32 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-05812ed2-3130-49d4-932a-20f95d499442 tempest-AttachVolumeTestJSON-927521694 None] Flow 'volume_create_manager' (e294ffe8-a6e1-4a20-b295-93ba2b2c1115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:55:32 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-05812ed2-3130-49d4-932a-20f95d499442 tempest-AttachVolumeTestJSON-927521694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb555e07-5456-441d-889c-672ca266cd71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:55:32 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-05812ed2-3130-49d4-932a-20f95d499442 tempest-AttachVolumeTestJSON-927521694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb555e07-5456-441d-889c-672ca266cd71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:55:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-603528814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=590db07f-6b56-4207-a3b3-404f56136f38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea67c374aa3346b2aad4092e92ea0fb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:55:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:55:32Z,use_quota=True,user_id='435cd5d215bb400995f051c97e8de689',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:55:32 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-05812ed2-3130-49d4-932a-20f95d499442 tempest-AttachVolumeTestJSON-927521694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (514b62df-96c0-4bbc-8fc7-ca09dd520fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:55:32 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-05812ed2-3130-49d4-932a-20f95d499442 tempest-AttachVolumeTestJSON-927521694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (514b62df-96c0-4bbc-8fc7-ca09dd520fbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:55:32 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-05812ed2-3130-49d4-932a-20f95d499442 tempest-AttachVolumeTestJSON-927521694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7397b5e-c7a2-4f39-8b42-0569ae8fc228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:55:32 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-05812ed2-3130-49d4-932a-20f95d499442 tempest-AttachVolumeTestJSON-927521694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7397b5e-c7a2-4f39-8b42-0569ae8fc228) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '590db07f-6b56-4207-a3b3-404f56136f38', 'volume_name': 'volume-590db07f-6b56-4207-a3b3-404f56136f38', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:55:32 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-05812ed2-3130-49d4-932a-20f95d499442 tempest-AttachVolumeTestJSON-927521694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cde5f6d6-6894-4f2c-aedf-674424a45154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:55:32 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-05812ed2-3130-49d4-932a-20f95d499442 tempest-AttachVolumeTestJSON-927521694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cde5f6d6-6894-4f2c-aedf-674424a45154) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:55:32 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-05812ed2-3130-49d4-932a-20f95d499442 tempest-AttachVolumeTestJSON-927521694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6344ece-a616-46f9-85a9-80ee15a63dd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:55:32 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-05812ed2-3130-49d4-932a-20f95d499442 tempest-AttachVolumeTestJSON-927521694 None] Volume 590db07f-6b56-4207-a3b3-404f56136f38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-590db07f-6b56-4207-a3b3-404f56136f38', 'volume_size': 1} Jul 10 15:55:32 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-05812ed2-3130-49d4-932a-20f95d499442 tempest-AttachVolumeTestJSON-927521694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:55:33 devstack sudo[96145]: pam_unix(sudo:session): session closed for user root Jul 10 15:55:33 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [req-a8772252-fb70-466d-89ed-9684919b18bf req-07b67b4f-3bfc-4ae1-80e8-84427c450491 tempest-VolumesSnapshotsTestJSON-327621538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d91e9878-7122-4191-99ba-b430df1ca82a.0ef273d3-1525-4583-b956-a61a1f98ad1f" returned: 0 in 0.726s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:55:33 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [req-a8772252-fb70-466d-89ed-9684919b18bf req-07b67b4f-3bfc-4ae1-80e8-84427c450491 tempest-VolumesSnapshotsTestJSON-327621538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d91e9878-7122-4191-99ba-b430df1ca82a.info {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:55:33 devstack sudo[96149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d91e9878-7122-4191-99ba-b430df1ca82a.info Jul 10 15:55:33 devstack sudo[96149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:55:33 devstack sudo[96149]: pam_unix(sudo:session): session closed for user root Jul 10 15:55:33 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [req-a8772252-fb70-466d-89ed-9684919b18bf req-07b67b4f-3bfc-4ae1-80e8-84427c450491 tempest-VolumesSnapshotsTestJSON-327621538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d91e9878-7122-4191-99ba-b430df1ca82a.info" returned: 0 in 0.755s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:55:33 devstack cinder-volume[87420]: WARNING cinder.volume.drivers.remotefs [req-a8772252-fb70-466d-89ed-9684919b18bf req-07b67b4f-3bfc-4ae1-80e8-84427c450491 tempest-VolumesSnapshotsTestJSON-327621538 None] /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d91e9878-7122-4191-99ba-b430df1ca82a.info is being set with open permissions: ugo+rw Jul 10 15:55:33 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [req-a8772252-fb70-466d-89ed-9684919b18bf req-07b67b4f-3bfc-4ae1-80e8-84427c450491 tempest-VolumesSnapshotsTestJSON-327621538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d91e9878-7122-4191-99ba-b430df1ca82a.info {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:55:33 devstack sudo[96152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d91e9878-7122-4191-99ba-b430df1ca82a.info Jul 10 15:55:33 devstack sudo[96152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:55:34 devstack sudo[96152]: pam_unix(sudo:session): session closed for user root Jul 10 15:55:34 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [req-a8772252-fb70-466d-89ed-9684919b18bf req-07b67b4f-3bfc-4ae1-80e8-84427c450491 tempest-VolumesSnapshotsTestJSON-327621538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d91e9878-7122-4191-99ba-b430df1ca82a.info" returned: 0 in 0.740s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:55:34 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [req-a8772252-fb70-466d-89ed-9684919b18bf req-07b67b4f-3bfc-4ae1-80e8-84427c450491 tempest-VolumesSnapshotsTestJSON-327621538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.266s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:55:34 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-05812ed2-3130-49d4-932a-20f95d499442 tempest-AttachVolumeTestJSON-927521694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.099s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:55:34 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-05812ed2-3130-49d4-932a-20f95d499442 tempest-AttachVolumeTestJSON-927521694 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:55:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-603528814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=590db07f-6b56-4207-a3b3-404f56136f38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea67c374aa3346b2aad4092e92ea0fb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:55:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:55:32Z,use_quota=True,user_id='435cd5d215bb400995f051c97e8de689',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 15:55:34 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-05812ed2-3130-49d4-932a-20f95d499442 tempest-AttachVolumeTestJSON-927521694 None] Creating volume 590db07f-6b56-4207-a3b3-404f56136f38 {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 15:55:34 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-05812ed2-3130-49d4-932a-20f95d499442 tempest-AttachVolumeTestJSON-927521694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:55:34 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-05812ed2-3130-49d4-932a-20f95d499442 tempest-AttachVolumeTestJSON-927521694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:55:34 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-05812ed2-3130-49d4-932a-20f95d499442 tempest-AttachVolumeTestJSON-927521694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:55:34 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-05812ed2-3130-49d4-932a-20f95d499442 tempest-AttachVolumeTestJSON-927521694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:55:34 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-05812ed2-3130-49d4-932a-20f95d499442 tempest-AttachVolumeTestJSON-927521694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:55:34 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-05812ed2-3130-49d4-932a-20f95d499442 tempest-AttachVolumeTestJSON-927521694 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 15:55:34 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-05812ed2-3130-49d4-932a-20f95d499442 tempest-AttachVolumeTestJSON-927521694 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 15:55:34 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-05812ed2-3130-49d4-932a-20f95d499442 tempest-AttachVolumeTestJSON-927521694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-590db07f-6b56-4207-a3b3-404f56136f38 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:55:34 devstack sudo[96155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-590db07f-6b56-4207-a3b3-404f56136f38 1073741824 Jul 10 15:55:34 devstack sudo[96155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:55:34 devstack cinder-volume[87420]: INFO cinder.volume.manager [req-a8772252-fb70-466d-89ed-9684919b18bf req-07b67b4f-3bfc-4ae1-80e8-84427c450491 tempest-VolumesSnapshotsTestJSON-327621538 None] Create snapshot completed successfully Jul 10 15:55:35 devstack cinder-volume[87420]: DEBUG cinder.coordination [req-a0fc0238-1eb4-4595-b70b-b2e80f437cc4 req-a785d82a-6e11-4d6c-923c-c17fbe51b085 tempest-VolumesSnapshotsTestJSON-327621538 None] Acquiring lock "cinder-0ef273d3-1525-4583-b956-a61a1f98ad1f-delete_snapshot" by "delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:55:35 devstack cinder-volume[87420]: DEBUG cinder.coordination [req-a0fc0238-1eb4-4595-b70b-b2e80f437cc4 req-a785d82a-6e11-4d6c-923c-c17fbe51b085 tempest-VolumesSnapshotsTestJSON-327621538 None] Lock "cinder-0ef273d3-1525-4583-b956-a61a1f98ad1f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:55:35 devstack cinder-volume[87420]: DEBUG cinder.coordination [req-a0fc0238-1eb4-4595-b70b-b2e80f437cc4 req-a785d82a-6e11-4d6c-923c-c17fbe51b085 tempest-VolumesSnapshotsTestJSON-327621538 None] Acquiring lock "cinder-quobyte-d91e9878-7122-4191-99ba-b430df1ca82a" by "delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:55:35 devstack cinder-volume[87420]: DEBUG cinder.coordination [req-a0fc0238-1eb4-4595-b70b-b2e80f437cc4 req-a785d82a-6e11-4d6c-923c-c17fbe51b085 tempest-VolumesSnapshotsTestJSON-327621538 None] Lock "cinder-quobyte-d91e9878-7122-4191-99ba-b430df1ca82a" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:55:35 devstack cinder-volume[87420]: DEBUG cinder.coordination [req-a0fc0238-1eb4-4595-b70b-b2e80f437cc4 req-a785d82a-6e11-4d6c-923c-c17fbe51b085 tempest-VolumesSnapshotsTestJSON-327621538 None] Acquiring lock "cinder-quobyte-0ef273d3-1525-4583-b956-a61a1f98ad1f" by "_delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:55:35 devstack cinder-volume[87420]: DEBUG cinder.coordination [req-a0fc0238-1eb4-4595-b70b-b2e80f437cc4 req-a785d82a-6e11-4d6c-923c-c17fbe51b085 tempest-VolumesSnapshotsTestJSON-327621538 None] Lock "cinder-quobyte-0ef273d3-1525-4583-b956-a61a1f98ad1f" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:55:35 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [req-a0fc0238-1eb4-4595-b70b-b2e80f437cc4 req-a785d82a-6e11-4d6c-923c-c17fbe51b085 tempest-VolumesSnapshotsTestJSON-327621538 None] Deleting offline snapshot 0ef273d3-1525-4583-b956-a61a1f98ad1f of volume d91e9878-7122-4191-99ba-b430df1ca82a {{(pid=87420) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 15:55:35 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [req-a0fc0238-1eb4-4595-b70b-b2e80f437cc4 req-a785d82a-6e11-4d6c-923c-c17fbe51b085 tempest-VolumesSnapshotsTestJSON-327621538 None] snapshot_file for this snap is: volume-d91e9878-7122-4191-99ba-b430df1ca82a.0ef273d3-1525-4583-b956-a61a1f98ad1f {{(pid=87420) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 15:55:35 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d886d33-b4b4-453a-a429-014988f0415b]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:55:35 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [req-a0fc0238-1eb4-4595-b70b-b2e80f437cc4 req-a785d82a-6e11-4d6c-923c-c17fbe51b085 tempest-VolumesSnapshotsTestJSON-327621538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d91e9878-7122-4191-99ba-b430df1ca82a.0ef273d3-1525-4583-b956-a61a1f98ad1f {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:55:35 devstack sudo[96155]: pam_unix(sudo:session): session closed for user root Jul 10 15:55:35 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-05812ed2-3130-49d4-932a-20f95d499442 tempest-AttachVolumeTestJSON-927521694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-590db07f-6b56-4207-a3b3-404f56136f38 1073741824" returned: 0 in 1.036s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:55:35 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-05812ed2-3130-49d4-932a-20f95d499442 tempest-AttachVolumeTestJSON-927521694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-590db07f-6b56-4207-a3b3-404f56136f38 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:55:35 devstack sudo[96162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-590db07f-6b56-4207-a3b3-404f56136f38 Jul 10 15:55:35 devstack sudo[96162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:55:35 devstack sudo[96161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d91e9878-7122-4191-99ba-b430df1ca82a.0ef273d3-1525-4583-b956-a61a1f98ad1f Jul 10 15:55:35 devstack sudo[96161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:55:36 devstack sudo[96162]: pam_unix(sudo:session): session closed for user root Jul 10 15:55:36 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-05812ed2-3130-49d4-932a-20f95d499442 tempest-AttachVolumeTestJSON-927521694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-590db07f-6b56-4207-a3b3-404f56136f38" returned: 0 in 0.953s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:55:36 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-05812ed2-3130-49d4-932a-20f95d499442 tempest-AttachVolumeTestJSON-927521694 None] <== create_volume: return (2052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 15:55:36 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-05812ed2-3130-49d4-932a-20f95d499442 tempest-AttachVolumeTestJSON-927521694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.057s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:55:36 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-05812ed2-3130-49d4-932a-20f95d499442 tempest-AttachVolumeTestJSON-927521694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6344ece-a616-46f9-85a9-80ee15a63dd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-590db07f-6b56-4207-a3b3-404f56136f38', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:55:36 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-05812ed2-3130-49d4-932a-20f95d499442 tempest-AttachVolumeTestJSON-927521694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31cd1a07-25fc-4c39-ab0c-6eb133c4f7aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:55:36 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-05812ed2-3130-49d4-932a-20f95d499442 tempest-AttachVolumeTestJSON-927521694 None] Volume volume-590db07f-6b56-4207-a3b3-404f56136f38 (590db07f-6b56-4207-a3b3-404f56136f38): created successfully Jul 10 15:55:36 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-05812ed2-3130-49d4-932a-20f95d499442 tempest-AttachVolumeTestJSON-927521694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31cd1a07-25fc-4c39-ab0c-6eb133c4f7aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:55:36 devstack sudo[96161]: pam_unix(sudo:session): session closed for user root Jul 10 15:55:36 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-05812ed2-3130-49d4-932a-20f95d499442 tempest-AttachVolumeTestJSON-927521694 None] Flow 'volume_create_manager' (e294ffe8-a6e1-4a20-b295-93ba2b2c1115) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:55:36 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [req-a0fc0238-1eb4-4595-b70b-b2e80f437cc4 req-a785d82a-6e11-4d6c-923c-c17fbe51b085 tempest-VolumesSnapshotsTestJSON-327621538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d91e9878-7122-4191-99ba-b430df1ca82a.0ef273d3-1525-4583-b956-a61a1f98ad1f" returned: 0 in 1.127s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:55:36 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [req-a0fc0238-1eb4-4595-b70b-b2e80f437cc4 req-a785d82a-6e11-4d6c-923c-c17fbe51b085 tempest-VolumesSnapshotsTestJSON-327621538 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d91e9878-7122-4191-99ba-b430df1ca82a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87420) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 15:55:36 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-05812ed2-3130-49d4-932a-20f95d499442 tempest-AttachVolumeTestJSON-927521694 None] Created volume successfully. Jul 10 15:55:36 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b42ebc-943a-4f7c-9f99-6620d3d90721]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:55:36 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [req-a0fc0238-1eb4-4595-b70b-b2e80f437cc4 req-a785d82a-6e11-4d6c-923c-c17fbe51b085 tempest-VolumesSnapshotsTestJSON-327621538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d91e9878-7122-4191-99ba-b430df1ca82a {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:55:36 devstack sudo[96169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d91e9878-7122-4191-99ba-b430df1ca82a Jul 10 15:55:36 devstack sudo[96169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:55:37 devstack sudo[96169]: pam_unix(sudo:session): session closed for user root Jul 10 15:55:37 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [req-a0fc0238-1eb4-4595-b70b-b2e80f437cc4 req-a785d82a-6e11-4d6c-923c-c17fbe51b085 tempest-VolumesSnapshotsTestJSON-327621538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d91e9878-7122-4191-99ba-b430df1ca82a" returned: 0 in 1.087s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:55:37 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [req-a0fc0238-1eb4-4595-b70b-b2e80f437cc4 req-a785d82a-6e11-4d6c-923c-c17fbe51b085 tempest-VolumesSnapshotsTestJSON-327621538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d91e9878-7122-4191-99ba-b430df1ca82a.0ef273d3-1525-4583-b956-a61a1f98ad1f {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:55:37 devstack sudo[96175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d91e9878-7122-4191-99ba-b430df1ca82a.0ef273d3-1525-4583-b956-a61a1f98ad1f Jul 10 15:55:37 devstack sudo[96175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:55:38 devstack sudo[96175]: pam_unix(sudo:session): session closed for user root Jul 10 15:55:38 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [req-a0fc0238-1eb4-4595-b70b-b2e80f437cc4 req-a785d82a-6e11-4d6c-923c-c17fbe51b085 tempest-VolumesSnapshotsTestJSON-327621538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d91e9878-7122-4191-99ba-b430df1ca82a.0ef273d3-1525-4583-b956-a61a1f98ad1f" returned: 0 in 0.853s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:55:38 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [req-a0fc0238-1eb4-4595-b70b-b2e80f437cc4 req-a785d82a-6e11-4d6c-923c-c17fbe51b085 tempest-VolumesSnapshotsTestJSON-327621538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d91e9878-7122-4191-99ba-b430df1ca82a.0ef273d3-1525-4583-b956-a61a1f98ad1f {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:55:38 devstack sudo[96184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d91e9878-7122-4191-99ba-b430df1ca82a.0ef273d3-1525-4583-b956-a61a1f98ad1f Jul 10 15:55:38 devstack sudo[96184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:55:39 devstack sudo[96184]: pam_unix(sudo:session): session closed for user root Jul 10 15:55:39 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [req-a0fc0238-1eb4-4595-b70b-b2e80f437cc4 req-a785d82a-6e11-4d6c-923c-c17fbe51b085 tempest-VolumesSnapshotsTestJSON-327621538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d91e9878-7122-4191-99ba-b430df1ca82a.0ef273d3-1525-4583-b956-a61a1f98ad1f" returned: 0 in 0.833s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:55:39 devstack cinder-volume[87420]: DEBUG cinder.coordination [req-a0fc0238-1eb4-4595-b70b-b2e80f437cc4 req-a785d82a-6e11-4d6c-923c-c17fbe51b085 tempest-VolumesSnapshotsTestJSON-327621538 None] Lock "cinder-quobyte-0ef273d3-1525-4583-b956-a61a1f98ad1f" released by "_delete_snapshot" :: held 4.063s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:55:39 devstack cinder-volume[87420]: DEBUG cinder.coordination [req-a0fc0238-1eb4-4595-b70b-b2e80f437cc4 req-a785d82a-6e11-4d6c-923c-c17fbe51b085 tempest-VolumesSnapshotsTestJSON-327621538 None] Lock "cinder-quobyte-d91e9878-7122-4191-99ba-b430df1ca82a" released by "delete_snapshot" :: held 4.092s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:55:39 devstack cinder-volume[87420]: DEBUG cinder.quota [req-a0fc0238-1eb4-4595-b70b-b2e80f437cc4 req-a785d82a-6e11-4d6c-923c-c17fbe51b085 tempest-VolumesSnapshotsTestJSON-327621538 None] Created reservations ['185d375e-0824-4657-925d-c9914a34acf8', '26f4f1c0-335e-470c-98b2-6e492ad1968d', '14235d22-b481-4920-9d49-f8ff0daf056b', 'd07c3f45-db3b-4ca2-b174-776cda4ed594'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 15:55:39 devstack cinder-volume[87420]: INFO cinder.volume.manager [req-a0fc0238-1eb4-4595-b70b-b2e80f437cc4 req-a785d82a-6e11-4d6c-923c-c17fbe51b085 tempest-VolumesSnapshotsTestJSON-327621538 None] Delete snapshot completed successfully. Jul 10 15:55:39 devstack cinder-volume[87420]: DEBUG cinder.coordination [req-a0fc0238-1eb4-4595-b70b-b2e80f437cc4 req-a785d82a-6e11-4d6c-923c-c17fbe51b085 tempest-VolumesSnapshotsTestJSON-327621538 None] Lock "cinder-0ef273d3-1525-4583-b956-a61a1f98ad1f-delete_snapshot" released by "delete_snapshot" :: held 4.286s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:55:40 devstack cinder-volume[87420]: DEBUG cinder.coordination [req-c801a545-ddf9-47b2-8322-04de5b0d80e7 req-ae00624e-1fdb-4fdb-b6d7-ff468ece1d0e tempest-VolumesSnapshotsTestJSON-327621538 None] Acquiring lock "cinder-d91e9878-7122-4191-99ba-b430df1ca82a-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:55:40 devstack cinder-volume[87420]: DEBUG cinder.coordination [req-c801a545-ddf9-47b2-8322-04de5b0d80e7 req-ae00624e-1fdb-4fdb-b6d7-ff468ece1d0e tempest-VolumesSnapshotsTestJSON-327621538 None] Lock "cinder-d91e9878-7122-4191-99ba-b430df1ca82a-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:55:40 devstack cinder-volume[87420]: DEBUG cinder.coordination [req-c801a545-ddf9-47b2-8322-04de5b0d80e7 req-ae00624e-1fdb-4fdb-b6d7-ff468ece1d0e tempest-VolumesSnapshotsTestJSON-327621538 None] Acquiring lock "cinder-quobyte-d91e9878-7122-4191-99ba-b430df1ca82a" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:55:40 devstack cinder-volume[87420]: DEBUG cinder.coordination [req-c801a545-ddf9-47b2-8322-04de5b0d80e7 req-ae00624e-1fdb-4fdb-b6d7-ff468ece1d0e tempest-VolumesSnapshotsTestJSON-327621538 None] Lock "cinder-quobyte-d91e9878-7122-4191-99ba-b430df1ca82a" acquired by "delete_volume" :: waited 0.024s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:55:40 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4048beb-818e-4cb2-9ad0-fe7fe42d9d7c]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:55:40 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [req-c801a545-ddf9-47b2-8322-04de5b0d80e7 req-ae00624e-1fdb-4fdb-b6d7-ff468ece1d0e tempest-VolumesSnapshotsTestJSON-327621538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d91e9878-7122-4191-99ba-b430df1ca82a {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:55:40 devstack sudo[96187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d91e9878-7122-4191-99ba-b430df1ca82a Jul 10 15:55:40 devstack sudo[96187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:55:41 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [req-2ec2008a-c094-42fe-9f82-6fbb09d3d44b req-75de620b-55ec-445b-88ad-3cde8e1b4096 tempest-AttachVolumeTestJSON-927521694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:55:41 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [req-2ec2008a-c094-42fe-9f82-6fbb09d3d44b req-75de620b-55ec-445b-88ad-3cde8e1b4096 tempest-AttachVolumeTestJSON-927521694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:55:41 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[468e9c51-63ff-457c-931b-4135e9fd4d5e]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:55:41 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [req-2ec2008a-c094-42fe-9f82-6fbb09d3d44b req-75de620b-55ec-445b-88ad-3cde8e1b4096 tempest-AttachVolumeTestJSON-927521694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-590db07f-6b56-4207-a3b3-404f56136f38 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:55:41 devstack sudo[96187]: pam_unix(sudo:session): session closed for user root Jul 10 15:55:41 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [req-c801a545-ddf9-47b2-8322-04de5b0d80e7 req-ae00624e-1fdb-4fdb-b6d7-ff468ece1d0e tempest-VolumesSnapshotsTestJSON-327621538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d91e9878-7122-4191-99ba-b430df1ca82a" returned: 0 in 1.051s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:55:41 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [req-c801a545-ddf9-47b2-8322-04de5b0d80e7 req-ae00624e-1fdb-4fdb-b6d7-ff468ece1d0e tempest-VolumesSnapshotsTestJSON-327621538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d91e9878-7122-4191-99ba-b430df1ca82a {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:55:41 devstack sudo[96201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d91e9878-7122-4191-99ba-b430df1ca82a Jul 10 15:55:41 devstack sudo[96201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:55:41 devstack sudo[96200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-590db07f-6b56-4207-a3b3-404f56136f38 Jul 10 15:55:41 devstack sudo[96200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:55:42 devstack sudo[96201]: pam_unix(sudo:session): session closed for user root Jul 10 15:55:42 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [req-c801a545-ddf9-47b2-8322-04de5b0d80e7 req-ae00624e-1fdb-4fdb-b6d7-ff468ece1d0e tempest-VolumesSnapshotsTestJSON-327621538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d91e9878-7122-4191-99ba-b430df1ca82a" returned: 0 in 0.845s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:55:42 devstack sudo[96200]: pam_unix(sudo:session): session closed for user root Jul 10 15:55:42 devstack cinder-volume[87420]: DEBUG cinder.coordination [req-c801a545-ddf9-47b2-8322-04de5b0d80e7 req-ae00624e-1fdb-4fdb-b6d7-ff468ece1d0e tempest-VolumesSnapshotsTestJSON-327621538 None] Lock "cinder-quobyte-d91e9878-7122-4191-99ba-b430df1ca82a" released by "delete_volume" :: held 1.989s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:55:42 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [req-2ec2008a-c094-42fe-9f82-6fbb09d3d44b req-75de620b-55ec-445b-88ad-3cde8e1b4096 tempest-AttachVolumeTestJSON-927521694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-590db07f-6b56-4207-a3b3-404f56136f38" returned: 0 in 0.979s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:55:42 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [req-2ec2008a-c094-42fe-9f82-6fbb09d3d44b req-75de620b-55ec-445b-88ad-3cde8e1b4096 tempest-AttachVolumeTestJSON-927521694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.013s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:55:42 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [req-2ec2008a-c094-42fe-9f82-6fbb09d3d44b req-75de620b-55ec-445b-88ad-3cde8e1b4096 tempest-AttachVolumeTestJSON-927521694 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80', 'name': 'volume-590db07f-6b56-4207-a3b3-404f56136f38', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c7751533-bfce-4b58-8bfe-9f2fdeda02fb', 'enforce_multipath': True} {{(pid=87420) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 15:55:42 devstack cinder-volume[87420]: DEBUG cinder.quota [req-c801a545-ddf9-47b2-8322-04de5b0d80e7 req-ae00624e-1fdb-4fdb-b6d7-ff468ece1d0e tempest-VolumesSnapshotsTestJSON-327621538 None] Created reservations ['ddfa95ff-fc34-4745-8ae8-15018cbf8100', '0d074119-67c3-4448-ba19-b71080e39609', '92ef7887-03c8-49fa-bba9-6cf9f9995a13', 'acde9bcb-2c67-49e5-9933-2c84e2daeba7'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 15:55:42 devstack cinder-volume[87420]: INFO cinder.volume.manager [req-2ec2008a-c094-42fe-9f82-6fbb09d3d44b req-75de620b-55ec-445b-88ad-3cde8e1b4096 tempest-AttachVolumeTestJSON-927521694 None] attachment_update completed successfully. Jul 10 15:55:42 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [req-c801a545-ddf9-47b2-8322-04de5b0d80e7 req-ae00624e-1fdb-4fdb-b6d7-ff468ece1d0e tempest-VolumesSnapshotsTestJSON-327621538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:55:42 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [req-c801a545-ddf9-47b2-8322-04de5b0d80e7 req-ae00624e-1fdb-4fdb-b6d7-ff468ece1d0e tempest-VolumesSnapshotsTestJSON-327621538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:55:42 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [req-c801a545-ddf9-47b2-8322-04de5b0d80e7 req-ae00624e-1fdb-4fdb-b6d7-ff468ece1d0e tempest-VolumesSnapshotsTestJSON-327621538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:55:42 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [req-c801a545-ddf9-47b2-8322-04de5b0d80e7 req-ae00624e-1fdb-4fdb-b6d7-ff468ece1d0e tempest-VolumesSnapshotsTestJSON-327621538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:55:42 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [req-c801a545-ddf9-47b2-8322-04de5b0d80e7 req-ae00624e-1fdb-4fdb-b6d7-ff468ece1d0e tempest-VolumesSnapshotsTestJSON-327621538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:55:42 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [req-c801a545-ddf9-47b2-8322-04de5b0d80e7 req-ae00624e-1fdb-4fdb-b6d7-ff468ece1d0e tempest-VolumesSnapshotsTestJSON-327621538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:55:42 devstack sudo[96209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 15:55:42 devstack sudo[96209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:55:42 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-964916e5-d888-43fa-b5f8-729c617780b7 tempest-VolumesSnapshotTestJSON-1119395226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 15:55:42 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-964916e5-d888-43fa-b5f8-729c617780b7 tempest-VolumesSnapshotTestJSON-1119395226 None] Flow 'volume_create_manager' (caa28c68-5b76-4d15-ba9c-d3c056676266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:55:42 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-964916e5-d888-43fa-b5f8-729c617780b7 tempest-VolumesSnapshotTestJSON-1119395226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d9fa54d-1397-498c-84da-b1a9df8d6019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:55:42 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-964916e5-d888-43fa-b5f8-729c617780b7 tempest-VolumesSnapshotTestJSON-1119395226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d9fa54d-1397-498c-84da-b1a9df8d6019) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:55:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2095594097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e17de25-b06f-472d-8562-fb636ea4efae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e643cb5b87b247789cb00bccc8c1eae1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:55:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:55:43Z,use_quota=True,user_id='8975db700f5543579bffa7dd0c86ba88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:55:42 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-964916e5-d888-43fa-b5f8-729c617780b7 tempest-VolumesSnapshotTestJSON-1119395226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc9b9080-b2d4-4fc3-a564-2b37ec8353e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:55:42 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-964916e5-d888-43fa-b5f8-729c617780b7 tempest-VolumesSnapshotTestJSON-1119395226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc9b9080-b2d4-4fc3-a564-2b37ec8353e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:55:42 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-964916e5-d888-43fa-b5f8-729c617780b7 tempest-VolumesSnapshotTestJSON-1119395226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (644f9f1a-8a7c-43e0-b623-7a7c6eea7371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:55:42 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-964916e5-d888-43fa-b5f8-729c617780b7 tempest-VolumesSnapshotTestJSON-1119395226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (644f9f1a-8a7c-43e0-b623-7a7c6eea7371) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e17de25-b06f-472d-8562-fb636ea4efae', 'volume_name': 'volume-9e17de25-b06f-472d-8562-fb636ea4efae', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:55:42 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-964916e5-d888-43fa-b5f8-729c617780b7 tempest-VolumesSnapshotTestJSON-1119395226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f305c421-2506-47cc-b122-48168e6ef763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:55:42 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-964916e5-d888-43fa-b5f8-729c617780b7 tempest-VolumesSnapshotTestJSON-1119395226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f305c421-2506-47cc-b122-48168e6ef763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:55:42 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-964916e5-d888-43fa-b5f8-729c617780b7 tempest-VolumesSnapshotTestJSON-1119395226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06104c9e-82cd-4b01-b054-7df8e66daa74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:55:42 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-964916e5-d888-43fa-b5f8-729c617780b7 tempest-VolumesSnapshotTestJSON-1119395226 None] Volume 9e17de25-b06f-472d-8562-fb636ea4efae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e17de25-b06f-472d-8562-fb636ea4efae', 'volume_size': 1} Jul 10 15:55:42 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-964916e5-d888-43fa-b5f8-729c617780b7 tempest-VolumesSnapshotTestJSON-1119395226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:55:42 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-964916e5-d888-43fa-b5f8-729c617780b7 tempest-VolumesSnapshotTestJSON-1119395226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:55:42 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-964916e5-d888-43fa-b5f8-729c617780b7 tempest-VolumesSnapshotTestJSON-1119395226 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:55:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2095594097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e17de25-b06f-472d-8562-fb636ea4efae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e643cb5b87b247789cb00bccc8c1eae1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:55:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:55:43Z,use_quota=True,user_id='8975db700f5543579bffa7dd0c86ba88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 15:55:42 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-964916e5-d888-43fa-b5f8-729c617780b7 tempest-VolumesSnapshotTestJSON-1119395226 None] Creating volume 9e17de25-b06f-472d-8562-fb636ea4efae {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 15:55:42 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-964916e5-d888-43fa-b5f8-729c617780b7 tempest-VolumesSnapshotTestJSON-1119395226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:55:42 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-964916e5-d888-43fa-b5f8-729c617780b7 tempest-VolumesSnapshotTestJSON-1119395226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:55:42 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-964916e5-d888-43fa-b5f8-729c617780b7 tempest-VolumesSnapshotTestJSON-1119395226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:55:42 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-964916e5-d888-43fa-b5f8-729c617780b7 tempest-VolumesSnapshotTestJSON-1119395226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:55:42 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-964916e5-d888-43fa-b5f8-729c617780b7 tempest-VolumesSnapshotTestJSON-1119395226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:55:42 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-964916e5-d888-43fa-b5f8-729c617780b7 tempest-VolumesSnapshotTestJSON-1119395226 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 15:55:42 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-964916e5-d888-43fa-b5f8-729c617780b7 tempest-VolumesSnapshotTestJSON-1119395226 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 15:55:42 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-964916e5-d888-43fa-b5f8-729c617780b7 tempest-VolumesSnapshotTestJSON-1119395226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-9e17de25-b06f-472d-8562-fb636ea4efae 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:55:43 devstack sudo[96212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-9e17de25-b06f-472d-8562-fb636ea4efae 1073741824 Jul 10 15:55:43 devstack sudo[96212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:55:43 devstack sudo[96209]: pam_unix(sudo:session): session closed for user root Jul 10 15:55:43 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [req-c801a545-ddf9-47b2-8322-04de5b0d80e7 req-ae00624e-1fdb-4fdb-b6d7-ff468ece1d0e tempest-VolumesSnapshotsTestJSON-327621538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.767s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:55:43 devstack cinder-volume[87420]: DEBUG cinder.manager [req-c801a545-ddf9-47b2-8322-04de5b0d80e7 req-ae00624e-1fdb-4fdb-b6d7-ff468ece1d0e tempest-VolumesSnapshotsTestJSON-327621538 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 15:55:43 devstack cinder-volume[87420]: INFO cinder.volume.manager [req-c801a545-ddf9-47b2-8322-04de5b0d80e7 req-ae00624e-1fdb-4fdb-b6d7-ff468ece1d0e tempest-VolumesSnapshotsTestJSON-327621538 None] Deleted volume successfully. Jul 10 15:55:43 devstack cinder-volume[87420]: DEBUG cinder.coordination [req-c801a545-ddf9-47b2-8322-04de5b0d80e7 req-ae00624e-1fdb-4fdb-b6d7-ff468ece1d0e tempest-VolumesSnapshotsTestJSON-327621538 None] Lock "cinder-d91e9878-7122-4191-99ba-b430df1ca82a-delete_volume" released by "delete_volume" :: held 3.067s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:55:44 devstack sudo[96212]: pam_unix(sudo:session): session closed for user root Jul 10 15:55:44 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-964916e5-d888-43fa-b5f8-729c617780b7 tempest-VolumesSnapshotTestJSON-1119395226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-9e17de25-b06f-472d-8562-fb636ea4efae 1073741824" returned: 0 in 1.106s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:55:44 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-964916e5-d888-43fa-b5f8-729c617780b7 tempest-VolumesSnapshotTestJSON-1119395226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-9e17de25-b06f-472d-8562-fb636ea4efae {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:55:44 devstack sudo[96221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-9e17de25-b06f-472d-8562-fb636ea4efae Jul 10 15:55:44 devstack sudo[96221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:55:44 devstack sudo[96221]: pam_unix(sudo:session): session closed for user root Jul 10 15:55:44 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-964916e5-d888-43fa-b5f8-729c617780b7 tempest-VolumesSnapshotTestJSON-1119395226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-9e17de25-b06f-472d-8562-fb636ea4efae" returned: 0 in 0.762s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:55:44 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-964916e5-d888-43fa-b5f8-729c617780b7 tempest-VolumesSnapshotTestJSON-1119395226 None] <== create_volume: return (1933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 15:55:44 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-964916e5-d888-43fa-b5f8-729c617780b7 tempest-VolumesSnapshotTestJSON-1119395226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.936s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:55:44 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-964916e5-d888-43fa-b5f8-729c617780b7 tempest-VolumesSnapshotTestJSON-1119395226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06104c9e-82cd-4b01-b054-7df8e66daa74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e17de25-b06f-472d-8562-fb636ea4efae', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:55:44 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-964916e5-d888-43fa-b5f8-729c617780b7 tempest-VolumesSnapshotTestJSON-1119395226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90eb43b4-5a7c-448f-8a6d-aba71009ffca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:55:44 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-964916e5-d888-43fa-b5f8-729c617780b7 tempest-VolumesSnapshotTestJSON-1119395226 None] Volume volume-9e17de25-b06f-472d-8562-fb636ea4efae (9e17de25-b06f-472d-8562-fb636ea4efae): created successfully Jul 10 15:55:44 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-964916e5-d888-43fa-b5f8-729c617780b7 tempest-VolumesSnapshotTestJSON-1119395226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90eb43b4-5a7c-448f-8a6d-aba71009ffca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:55:44 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-964916e5-d888-43fa-b5f8-729c617780b7 tempest-VolumesSnapshotTestJSON-1119395226 None] Flow 'volume_create_manager' (caa28c68-5b76-4d15-ba9c-d3c056676266) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:55:45 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-964916e5-d888-43fa-b5f8-729c617780b7 tempest-VolumesSnapshotTestJSON-1119395226 None] Created volume successfully. Jul 10 15:55:45 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-8a729def-6a12-4ab6-8020-d36f8142194d tempest-VolumesSnapshotTestJSON-1119395226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:55:45 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-8a729def-6a12-4ab6-8020-d36f8142194d tempest-VolumesSnapshotTestJSON-1119395226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:55:45 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-8a729def-6a12-4ab6-8020-d36f8142194d tempest-VolumesSnapshotTestJSON-1119395226 None] Creating offline snapshot d7f56253-58ac-45f9-8ab0-f02edd46385a of volume 9e17de25-b06f-472d-8562-fb636ea4efae {{(pid=87420) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 15:55:45 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[d99e989f-65c7-4cdb-a7f7-114ed771bad9]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:55:45 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8a729def-6a12-4ab6-8020-d36f8142194d tempest-VolumesSnapshotTestJSON-1119395226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-9e17de25-b06f-472d-8562-fb636ea4efae {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:55:45 devstack sudo[96230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-9e17de25-b06f-472d-8562-fb636ea4efae Jul 10 15:55:45 devstack sudo[96230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:55:46 devstack sudo[96230]: pam_unix(sudo:session): session closed for user root Jul 10 15:55:46 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8a729def-6a12-4ab6-8020-d36f8142194d tempest-VolumesSnapshotTestJSON-1119395226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-9e17de25-b06f-472d-8562-fb636ea4efae" returned: 0 in 0.981s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:55:46 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8a729def-6a12-4ab6-8020-d36f8142194d tempest-VolumesSnapshotTestJSON-1119395226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-9e17de25-b06f-472d-8562-fb636ea4efae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-9e17de25-b06f-472d-8562-fb636ea4efae.d7f56253-58ac-45f9-8ab0-f02edd46385a 1G {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:55:46 devstack sudo[96238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-9e17de25-b06f-472d-8562-fb636ea4efae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-9e17de25-b06f-472d-8562-fb636ea4efae.d7f56253-58ac-45f9-8ab0-f02edd46385a 1G Jul 10 15:55:46 devstack sudo[96238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:55:47 devstack sudo[96238]: pam_unix(sudo:session): session closed for user root Jul 10 15:55:47 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8a729def-6a12-4ab6-8020-d36f8142194d tempest-VolumesSnapshotTestJSON-1119395226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-9e17de25-b06f-472d-8562-fb636ea4efae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-9e17de25-b06f-472d-8562-fb636ea4efae.d7f56253-58ac-45f9-8ab0-f02edd46385a 1G" returned: 0 in 0.997s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:55:47 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8a729def-6a12-4ab6-8020-d36f8142194d tempest-VolumesSnapshotTestJSON-1119395226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e17de25-b06f-472d-8562-fb636ea4efae -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-9e17de25-b06f-472d-8562-fb636ea4efae.d7f56253-58ac-45f9-8ab0-f02edd46385a {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:55:47 devstack sudo[96268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e17de25-b06f-472d-8562-fb636ea4efae -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-9e17de25-b06f-472d-8562-fb636ea4efae.d7f56253-58ac-45f9-8ab0-f02edd46385a Jul 10 15:55:47 devstack sudo[96268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:55:48 devstack cinder-volume[87420]: INFO cinder.volume.manager [req-d1eae86a-a352-4960-8798-0d8fed9fe445 req-5f39fd7d-60ab-4352-99e0-b5f9958be580 tempest-AttachVolumeTestJSON-927521694 None] Terminate volume connection completed successfully. Jul 10 15:55:48 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [req-d1eae86a-a352-4960-8798-0d8fed9fe445 req-5f39fd7d-60ab-4352-99e0-b5f9958be580 tempest-AttachVolumeTestJSON-927521694 None] Deleting attachment 883c3a5e-2702-4615-8640-e050d0938c07. {{(pid=87420) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 15:55:48 devstack sudo[96268]: pam_unix(sudo:session): session closed for user root Jul 10 15:55:48 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8a729def-6a12-4ab6-8020-d36f8142194d tempest-VolumesSnapshotTestJSON-1119395226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e17de25-b06f-472d-8562-fb636ea4efae -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-9e17de25-b06f-472d-8562-fb636ea4efae.d7f56253-58ac-45f9-8ab0-f02edd46385a" returned: 0 in 0.853s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:55:48 devstack cinder-volume[87420]: WARNING cinder.volume.drivers.remotefs [None req-8a729def-6a12-4ab6-8020-d36f8142194d tempest-VolumesSnapshotTestJSON-1119395226 None] /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-9e17de25-b06f-472d-8562-fb636ea4efae.d7f56253-58ac-45f9-8ab0-f02edd46385a is being set with open permissions: ugo+rw Jul 10 15:55:48 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8a729def-6a12-4ab6-8020-d36f8142194d tempest-VolumesSnapshotTestJSON-1119395226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-9e17de25-b06f-472d-8562-fb636ea4efae.d7f56253-58ac-45f9-8ab0-f02edd46385a {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:55:48 devstack sudo[96275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-9e17de25-b06f-472d-8562-fb636ea4efae.d7f56253-58ac-45f9-8ab0-f02edd46385a Jul 10 15:55:48 devstack sudo[96275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:55:49 devstack sudo[96275]: pam_unix(sudo:session): session closed for user root Jul 10 15:55:49 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8a729def-6a12-4ab6-8020-d36f8142194d tempest-VolumesSnapshotTestJSON-1119395226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-9e17de25-b06f-472d-8562-fb636ea4efae.d7f56253-58ac-45f9-8ab0-f02edd46385a" returned: 0 in 0.806s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:55:49 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8a729def-6a12-4ab6-8020-d36f8142194d tempest-VolumesSnapshotTestJSON-1119395226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-9e17de25-b06f-472d-8562-fb636ea4efae.info {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:55:49 devstack sudo[96278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-9e17de25-b06f-472d-8562-fb636ea4efae.info Jul 10 15:55:49 devstack sudo[96278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:55:49 devstack sudo[96278]: pam_unix(sudo:session): session closed for user root Jul 10 15:55:49 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8a729def-6a12-4ab6-8020-d36f8142194d tempest-VolumesSnapshotTestJSON-1119395226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-9e17de25-b06f-472d-8562-fb636ea4efae.info" returned: 0 in 0.798s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:55:49 devstack cinder-volume[87420]: WARNING cinder.volume.drivers.remotefs [None req-8a729def-6a12-4ab6-8020-d36f8142194d tempest-VolumesSnapshotTestJSON-1119395226 None] /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-9e17de25-b06f-472d-8562-fb636ea4efae.info is being set with open permissions: ugo+rw Jul 10 15:55:49 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8a729def-6a12-4ab6-8020-d36f8142194d tempest-VolumesSnapshotTestJSON-1119395226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-9e17de25-b06f-472d-8562-fb636ea4efae.info {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:55:50 devstack sudo[96281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-9e17de25-b06f-472d-8562-fb636ea4efae.info Jul 10 15:55:50 devstack sudo[96281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:55:50 devstack sudo[96281]: pam_unix(sudo:session): session closed for user root Jul 10 15:55:50 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8a729def-6a12-4ab6-8020-d36f8142194d tempest-VolumesSnapshotTestJSON-1119395226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-9e17de25-b06f-472d-8562-fb636ea4efae.info" returned: 0 in 0.729s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:55:50 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-8a729def-6a12-4ab6-8020-d36f8142194d tempest-VolumesSnapshotTestJSON-1119395226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.285s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:55:50 devstack cinder-volume[87420]: INFO cinder.volume.manager [req-c02d9f36-8e0c-4213-873c-7f7c57874387 req-23e69f9c-d25f-4bce-bf9b-af6d767d7642 tempest-AttachVolumeTestJSON-927521694 None] Terminate volume connection completed successfully. Jul 10 15:55:50 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [req-c02d9f36-8e0c-4213-873c-7f7c57874387 req-23e69f9c-d25f-4bce-bf9b-af6d767d7642 tempest-AttachVolumeTestJSON-927521694 None] Deleting attachment c7751533-bfce-4b58-8bfe-9f2fdeda02fb. {{(pid=87420) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 15:55:50 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-8a729def-6a12-4ab6-8020-d36f8142194d tempest-VolumesSnapshotTestJSON-1119395226 None] Create snapshot completed successfully Jul 10 15:55:51 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d78696a-a5ca-4398-afd6-04d590674e1a tempest-VolumeQuotasNegativeTestJSON-534763400 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 15:55:51 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6d78696a-a5ca-4398-afd6-04d590674e1a tempest-VolumeQuotasNegativeTestJSON-534763400 None] Flow 'volume_create_manager' (fb8bf92b-0177-472d-a265-66583a009a65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:55:51 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6d78696a-a5ca-4398-afd6-04d590674e1a tempest-VolumeQuotasNegativeTestJSON-534763400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6acdab4-b51c-4e29-b3f0-d0359ee2507d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:55:51 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6d78696a-a5ca-4398-afd6-04d590674e1a tempest-VolumeQuotasNegativeTestJSON-534763400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6acdab4-b51c-4e29-b3f0-d0359ee2507d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:55:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1234927711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56a83eea-c6ec-4f3c-af9c-422f21a82a6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7997b81c655b4a3e8a64b4c861b38c8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:55:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:55:51Z,use_quota=True,user_id='fdb6a148ea46429bbb6d9c996ed6d97b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:55:51 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6d78696a-a5ca-4398-afd6-04d590674e1a tempest-VolumeQuotasNegativeTestJSON-534763400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e16ddd91-14c0-4fea-91d4-587c840758a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:55:51 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6d78696a-a5ca-4398-afd6-04d590674e1a tempest-VolumeQuotasNegativeTestJSON-534763400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e16ddd91-14c0-4fea-91d4-587c840758a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:55:51 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6d78696a-a5ca-4398-afd6-04d590674e1a tempest-VolumeQuotasNegativeTestJSON-534763400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3df1c45-2f81-4a4d-ab37-cb158f0680c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:55:51 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6d78696a-a5ca-4398-afd6-04d590674e1a tempest-VolumeQuotasNegativeTestJSON-534763400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3df1c45-2f81-4a4d-ab37-cb158f0680c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56a83eea-c6ec-4f3c-af9c-422f21a82a6b', 'volume_name': 'volume-56a83eea-c6ec-4f3c-af9c-422f21a82a6b', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:55:51 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6d78696a-a5ca-4398-afd6-04d590674e1a tempest-VolumeQuotasNegativeTestJSON-534763400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a89a86d5-eb69-4037-99ec-da31da271454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:55:51 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6d78696a-a5ca-4398-afd6-04d590674e1a tempest-VolumeQuotasNegativeTestJSON-534763400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a89a86d5-eb69-4037-99ec-da31da271454) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:55:51 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6d78696a-a5ca-4398-afd6-04d590674e1a tempest-VolumeQuotasNegativeTestJSON-534763400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6eda9c05-e7e9-4e03-a341-d4ac64a43d27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:55:51 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-6d78696a-a5ca-4398-afd6-04d590674e1a tempest-VolumeQuotasNegativeTestJSON-534763400 None] Volume 56a83eea-c6ec-4f3c-af9c-422f21a82a6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56a83eea-c6ec-4f3c-af9c-422f21a82a6b', 'volume_size': 1} Jul 10 15:55:51 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-6d78696a-a5ca-4398-afd6-04d590674e1a tempest-VolumeQuotasNegativeTestJSON-534763400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:55:51 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-6d78696a-a5ca-4398-afd6-04d590674e1a tempest-VolumeQuotasNegativeTestJSON-534763400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:55:51 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-6d78696a-a5ca-4398-afd6-04d590674e1a tempest-VolumeQuotasNegativeTestJSON-534763400 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:55:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1234927711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56a83eea-c6ec-4f3c-af9c-422f21a82a6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7997b81c655b4a3e8a64b4c861b38c8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:55:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:55:51Z,use_quota=True,user_id='fdb6a148ea46429bbb6d9c996ed6d97b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 15:55:51 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-6d78696a-a5ca-4398-afd6-04d590674e1a tempest-VolumeQuotasNegativeTestJSON-534763400 None] Creating volume 56a83eea-c6ec-4f3c-af9c-422f21a82a6b {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 15:55:51 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-6d78696a-a5ca-4398-afd6-04d590674e1a tempest-VolumeQuotasNegativeTestJSON-534763400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:55:51 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-6d78696a-a5ca-4398-afd6-04d590674e1a tempest-VolumeQuotasNegativeTestJSON-534763400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:55:51 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-6d78696a-a5ca-4398-afd6-04d590674e1a tempest-VolumeQuotasNegativeTestJSON-534763400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:55:51 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-6d78696a-a5ca-4398-afd6-04d590674e1a tempest-VolumeQuotasNegativeTestJSON-534763400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:55:51 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-6d78696a-a5ca-4398-afd6-04d590674e1a tempest-VolumeQuotasNegativeTestJSON-534763400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:55:51 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-6d78696a-a5ca-4398-afd6-04d590674e1a tempest-VolumeQuotasNegativeTestJSON-534763400 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 15:55:51 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-6d78696a-a5ca-4398-afd6-04d590674e1a tempest-VolumeQuotasNegativeTestJSON-534763400 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 15:55:51 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6d78696a-a5ca-4398-afd6-04d590674e1a tempest-VolumeQuotasNegativeTestJSON-534763400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-56a83eea-c6ec-4f3c-af9c-422f21a82a6b 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:55:51 devstack sudo[96288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-56a83eea-c6ec-4f3c-af9c-422f21a82a6b 1073741824 Jul 10 15:55:51 devstack sudo[96288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:55:51 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-94572c10-d2f4-4e9d-ad89-09ce0e2fa4d7 tempest-VolumesSnapshotTestJSON-1119395226 None] Acquiring lock "cinder-d7f56253-58ac-45f9-8ab0-f02edd46385a-delete_snapshot" by "delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:55:51 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-94572c10-d2f4-4e9d-ad89-09ce0e2fa4d7 tempest-VolumesSnapshotTestJSON-1119395226 None] Lock "cinder-d7f56253-58ac-45f9-8ab0-f02edd46385a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:55:52 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-94572c10-d2f4-4e9d-ad89-09ce0e2fa4d7 tempest-VolumesSnapshotTestJSON-1119395226 None] Acquiring lock "cinder-quobyte-9e17de25-b06f-472d-8562-fb636ea4efae" by "delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:55:52 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-94572c10-d2f4-4e9d-ad89-09ce0e2fa4d7 tempest-VolumesSnapshotTestJSON-1119395226 None] Lock "cinder-quobyte-9e17de25-b06f-472d-8562-fb636ea4efae" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:55:52 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-94572c10-d2f4-4e9d-ad89-09ce0e2fa4d7 tempest-VolumesSnapshotTestJSON-1119395226 None] Acquiring lock "cinder-quobyte-d7f56253-58ac-45f9-8ab0-f02edd46385a" by "_delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:55:52 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-94572c10-d2f4-4e9d-ad89-09ce0e2fa4d7 tempest-VolumesSnapshotTestJSON-1119395226 None] Lock "cinder-quobyte-d7f56253-58ac-45f9-8ab0-f02edd46385a" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:55:52 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-94572c10-d2f4-4e9d-ad89-09ce0e2fa4d7 tempest-VolumesSnapshotTestJSON-1119395226 None] Deleting offline snapshot d7f56253-58ac-45f9-8ab0-f02edd46385a of volume 9e17de25-b06f-472d-8562-fb636ea4efae {{(pid=87420) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 15:55:52 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-94572c10-d2f4-4e9d-ad89-09ce0e2fa4d7 tempest-VolumesSnapshotTestJSON-1119395226 None] snapshot_file for this snap is: volume-9e17de25-b06f-472d-8562-fb636ea4efae.d7f56253-58ac-45f9-8ab0-f02edd46385a {{(pid=87420) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 15:55:52 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[93cfa8dd-0fce-4f56-9de8-c18e174a465a]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:55:52 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-94572c10-d2f4-4e9d-ad89-09ce0e2fa4d7 tempest-VolumesSnapshotTestJSON-1119395226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-9e17de25-b06f-472d-8562-fb636ea4efae.d7f56253-58ac-45f9-8ab0-f02edd46385a {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:55:52 devstack sudo[96290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-9e17de25-b06f-472d-8562-fb636ea4efae.d7f56253-58ac-45f9-8ab0-f02edd46385a Jul 10 15:55:52 devstack sudo[96290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:55:52 devstack sudo[96288]: pam_unix(sudo:session): session closed for user root Jul 10 15:55:52 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6d78696a-a5ca-4398-afd6-04d590674e1a tempest-VolumeQuotasNegativeTestJSON-534763400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-56a83eea-c6ec-4f3c-af9c-422f21a82a6b 1073741824" returned: 0 in 0.935s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:55:52 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6d78696a-a5ca-4398-afd6-04d590674e1a tempest-VolumeQuotasNegativeTestJSON-534763400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-56a83eea-c6ec-4f3c-af9c-422f21a82a6b {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:55:52 devstack sudo[96295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-56a83eea-c6ec-4f3c-af9c-422f21a82a6b Jul 10 15:55:52 devstack sudo[96295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:55:52 devstack sudo[96290]: pam_unix(sudo:session): session closed for user root Jul 10 15:55:52 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-94572c10-d2f4-4e9d-ad89-09ce0e2fa4d7 tempest-VolumesSnapshotTestJSON-1119395226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-9e17de25-b06f-472d-8562-fb636ea4efae.d7f56253-58ac-45f9-8ab0-f02edd46385a" returned: 0 in 0.812s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:55:52 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-94572c10-d2f4-4e9d-ad89-09ce0e2fa4d7 tempest-VolumesSnapshotTestJSON-1119395226 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e17de25-b06f-472d-8562-fb636ea4efae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87420) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 15:55:52 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e212545-c3f7-4726-b7b8-3e813962a160]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:55:52 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-94572c10-d2f4-4e9d-ad89-09ce0e2fa4d7 tempest-VolumesSnapshotTestJSON-1119395226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-9e17de25-b06f-472d-8562-fb636ea4efae {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:55:53 devstack sudo[96301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-9e17de25-b06f-472d-8562-fb636ea4efae Jul 10 15:55:53 devstack sudo[96301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:55:53 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-eb63e58b-fe1c-4bee-924b-1a4dd6127ba6 tempest-BackendsCapabilitiesAdminTestsJSON-1636453245 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577095031738, 'free_capacity_gb': 1775.7577095031738, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87420) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 10 15:55:53 devstack sudo[96295]: pam_unix(sudo:session): session closed for user root Jul 10 15:55:53 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6d78696a-a5ca-4398-afd6-04d590674e1a tempest-VolumeQuotasNegativeTestJSON-534763400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-56a83eea-c6ec-4f3c-af9c-422f21a82a6b" returned: 0 in 0.679s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:55:53 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-6d78696a-a5ca-4398-afd6-04d590674e1a tempest-VolumeQuotasNegativeTestJSON-534763400 None] <== create_volume: return (1668ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 15:55:53 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-6d78696a-a5ca-4398-afd6-04d590674e1a tempest-VolumeQuotasNegativeTestJSON-534763400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.671s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:55:53 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6d78696a-a5ca-4398-afd6-04d590674e1a tempest-VolumeQuotasNegativeTestJSON-534763400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6eda9c05-e7e9-4e03-a341-d4ac64a43d27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56a83eea-c6ec-4f3c-af9c-422f21a82a6b', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:55:53 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6d78696a-a5ca-4398-afd6-04d590674e1a tempest-VolumeQuotasNegativeTestJSON-534763400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aea73be8-c079-42b0-a737-e7332a8277cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:55:53 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-6d78696a-a5ca-4398-afd6-04d590674e1a tempest-VolumeQuotasNegativeTestJSON-534763400 None] Volume volume-56a83eea-c6ec-4f3c-af9c-422f21a82a6b (56a83eea-c6ec-4f3c-af9c-422f21a82a6b): created successfully Jul 10 15:55:53 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6d78696a-a5ca-4398-afd6-04d590674e1a tempest-VolumeQuotasNegativeTestJSON-534763400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aea73be8-c079-42b0-a737-e7332a8277cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:55:53 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6d78696a-a5ca-4398-afd6-04d590674e1a tempest-VolumeQuotasNegativeTestJSON-534763400 None] Flow 'volume_create_manager' (fb8bf92b-0177-472d-a265-66583a009a65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:55:53 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-6d78696a-a5ca-4398-afd6-04d590674e1a tempest-VolumeQuotasNegativeTestJSON-534763400 None] Created volume successfully. Jul 10 15:55:53 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-7b2cb49d-c226-4a39-a481-4de4fb140722 tempest-BackendsCapabilitiesAdminTestsJSON-1636453245 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577095031738, 'free_capacity_gb': 1775.7577095031738, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87420) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 10 15:55:53 devstack sudo[96301]: pam_unix(sudo:session): session closed for user root Jul 10 15:55:53 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-94572c10-d2f4-4e9d-ad89-09ce0e2fa4d7 tempest-VolumesSnapshotTestJSON-1119395226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-9e17de25-b06f-472d-8562-fb636ea4efae" returned: 0 in 0.814s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:55:53 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-94572c10-d2f4-4e9d-ad89-09ce0e2fa4d7 tempest-VolumesSnapshotTestJSON-1119395226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-9e17de25-b06f-472d-8562-fb636ea4efae.d7f56253-58ac-45f9-8ab0-f02edd46385a {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:55:53 devstack sudo[96307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-9e17de25-b06f-472d-8562-fb636ea4efae.d7f56253-58ac-45f9-8ab0-f02edd46385a Jul 10 15:55:53 devstack sudo[96307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:55:54 devstack sudo[96307]: pam_unix(sudo:session): session closed for user root Jul 10 15:55:54 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-94572c10-d2f4-4e9d-ad89-09ce0e2fa4d7 tempest-VolumesSnapshotTestJSON-1119395226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-9e17de25-b06f-472d-8562-fb636ea4efae.d7f56253-58ac-45f9-8ab0-f02edd46385a" returned: 0 in 0.845s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:55:54 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-94572c10-d2f4-4e9d-ad89-09ce0e2fa4d7 tempest-VolumesSnapshotTestJSON-1119395226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-9e17de25-b06f-472d-8562-fb636ea4efae.d7f56253-58ac-45f9-8ab0-f02edd46385a {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:55:54 devstack sudo[96317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-9e17de25-b06f-472d-8562-fb636ea4efae.d7f56253-58ac-45f9-8ab0-f02edd46385a Jul 10 15:55:54 devstack sudo[96317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:55:54 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-f4997399-a1b6-4e6f-bafb-d3350af4a223 tempest-VolumeQuotasNegativeTestJSON-534763400 None] Acquiring lock "cinder-56a83eea-c6ec-4f3c-af9c-422f21a82a6b-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:55:54 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-f4997399-a1b6-4e6f-bafb-d3350af4a223 tempest-VolumeQuotasNegativeTestJSON-534763400 None] Lock "cinder-56a83eea-c6ec-4f3c-af9c-422f21a82a6b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:55:54 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-f4997399-a1b6-4e6f-bafb-d3350af4a223 tempest-VolumeQuotasNegativeTestJSON-534763400 None] Acquiring lock "cinder-quobyte-56a83eea-c6ec-4f3c-af9c-422f21a82a6b" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:55:54 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-f4997399-a1b6-4e6f-bafb-d3350af4a223 tempest-VolumeQuotasNegativeTestJSON-534763400 None] Lock "cinder-quobyte-56a83eea-c6ec-4f3c-af9c-422f21a82a6b" acquired by "delete_volume" :: waited 0.023s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:55:54 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[da790bd7-8dc2-441a-bceb-367db31e8b1d]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:55:54 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f4997399-a1b6-4e6f-bafb-d3350af4a223 tempest-VolumeQuotasNegativeTestJSON-534763400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-56a83eea-c6ec-4f3c-af9c-422f21a82a6b {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:55:54 devstack sudo[96319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-56a83eea-c6ec-4f3c-af9c-422f21a82a6b Jul 10 15:55:54 devstack sudo[96319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:55:55 devstack sudo[96317]: pam_unix(sudo:session): session closed for user root Jul 10 15:55:55 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-94572c10-d2f4-4e9d-ad89-09ce0e2fa4d7 tempest-VolumesSnapshotTestJSON-1119395226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-9e17de25-b06f-472d-8562-fb636ea4efae.d7f56253-58ac-45f9-8ab0-f02edd46385a" returned: 0 in 0.866s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:55:55 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-94572c10-d2f4-4e9d-ad89-09ce0e2fa4d7 tempest-VolumesSnapshotTestJSON-1119395226 None] Lock "cinder-quobyte-d7f56253-58ac-45f9-8ab0-f02edd46385a" released by "_delete_snapshot" :: held 3.462s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:55:55 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-94572c10-d2f4-4e9d-ad89-09ce0e2fa4d7 tempest-VolumesSnapshotTestJSON-1119395226 None] Lock "cinder-quobyte-9e17de25-b06f-472d-8562-fb636ea4efae" released by "delete_snapshot" :: held 3.486s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:55:55 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-94572c10-d2f4-4e9d-ad89-09ce0e2fa4d7 tempest-VolumesSnapshotTestJSON-1119395226 None] Created reservations ['1b8fd853-f737-4293-8b2a-d8f193e7d5ff', 'aa0b297f-1c9f-4dcb-b631-1b9a0de398de', '71379adc-5bc2-4927-956e-28316b5a6293', 'fa63f218-8ee0-45a7-b1d7-ed604efa363c'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 15:55:55 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-94572c10-d2f4-4e9d-ad89-09ce0e2fa4d7 tempest-VolumesSnapshotTestJSON-1119395226 None] Delete snapshot completed successfully. Jul 10 15:55:55 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-94572c10-d2f4-4e9d-ad89-09ce0e2fa4d7 tempest-VolumesSnapshotTestJSON-1119395226 None] Lock "cinder-d7f56253-58ac-45f9-8ab0-f02edd46385a-delete_snapshot" released by "delete_snapshot" :: held 3.728s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:55:55 devstack sudo[96319]: pam_unix(sudo:session): session closed for user root Jul 10 15:55:55 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f4997399-a1b6-4e6f-bafb-d3350af4a223 tempest-VolumeQuotasNegativeTestJSON-534763400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-56a83eea-c6ec-4f3c-af9c-422f21a82a6b" returned: 0 in 1.037s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:55:55 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f4997399-a1b6-4e6f-bafb-d3350af4a223 tempest-VolumeQuotasNegativeTestJSON-534763400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-56a83eea-c6ec-4f3c-af9c-422f21a82a6b {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:55:55 devstack sudo[96341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-56a83eea-c6ec-4f3c-af9c-422f21a82a6b Jul 10 15:55:55 devstack sudo[96341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:55:56 devstack sudo[96341]: pam_unix(sudo:session): session closed for user root Jul 10 15:55:56 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f4997399-a1b6-4e6f-bafb-d3350af4a223 tempest-VolumeQuotasNegativeTestJSON-534763400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-56a83eea-c6ec-4f3c-af9c-422f21a82a6b" returned: 0 in 0.892s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:55:56 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-f4997399-a1b6-4e6f-bafb-d3350af4a223 tempest-VolumeQuotasNegativeTestJSON-534763400 None] Lock "cinder-quobyte-56a83eea-c6ec-4f3c-af9c-422f21a82a6b" released by "delete_volume" :: held 2.030s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:55:56 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-f4997399-a1b6-4e6f-bafb-d3350af4a223 tempest-VolumeQuotasNegativeTestJSON-534763400 None] Created reservations ['216539eb-0b0f-4d44-a8ed-b100e6f2bafa', 'f8e81922-4c3a-4d05-ba07-bb542d6326f9', 'd853401d-de9f-4a54-84bf-63e3dce2b00e', 'dadaf4a7-3991-4974-8aad-8bf8eb7369e7'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 15:55:57 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ca7687d-1b00-4ced-91e6-9c9c1570289b tempest-VolumesSnapshotTestJSON-1119395226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 15:55:57 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-9ca7687d-1b00-4ced-91e6-9c9c1570289b tempest-VolumesSnapshotTestJSON-1119395226 None] Flow 'volume_create_manager' (b967bdf4-8c19-446c-a907-b3a8e4f4f5a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:55:57 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-9ca7687d-1b00-4ced-91e6-9c9c1570289b tempest-VolumesSnapshotTestJSON-1119395226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0749c3e-9b5e-4619-bf41-4b1123aa1319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:55:57 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-9ca7687d-1b00-4ced-91e6-9c9c1570289b tempest-VolumesSnapshotTestJSON-1119395226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0749c3e-9b5e-4619-bf41-4b1123aa1319) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:55:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-967103599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6cdcfe2-82af-4376-8cbd-cc7c1c38ce26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e643cb5b87b247789cb00bccc8c1eae1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:55:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:55:57Z,use_quota=True,user_id='8975db700f5543579bffa7dd0c86ba88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:55:57 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-9ca7687d-1b00-4ced-91e6-9c9c1570289b tempest-VolumesSnapshotTestJSON-1119395226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92a92090-819e-4c39-8690-e626a835b7fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:55:57 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-9ca7687d-1b00-4ced-91e6-9c9c1570289b tempest-VolumesSnapshotTestJSON-1119395226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92a92090-819e-4c39-8690-e626a835b7fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:55:57 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-9ca7687d-1b00-4ced-91e6-9c9c1570289b tempest-VolumesSnapshotTestJSON-1119395226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (721ec7c8-464b-4543-baf8-d1d9c3910549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:55:57 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-9ca7687d-1b00-4ced-91e6-9c9c1570289b tempest-VolumesSnapshotTestJSON-1119395226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (721ec7c8-464b-4543-baf8-d1d9c3910549) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6cdcfe2-82af-4376-8cbd-cc7c1c38ce26', 'volume_name': 'volume-b6cdcfe2-82af-4376-8cbd-cc7c1c38ce26', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:55:57 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-9ca7687d-1b00-4ced-91e6-9c9c1570289b tempest-VolumesSnapshotTestJSON-1119395226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40fbe056-2de3-4563-a5aa-62a6259ca4ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:55:57 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-9ca7687d-1b00-4ced-91e6-9c9c1570289b tempest-VolumesSnapshotTestJSON-1119395226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40fbe056-2de3-4563-a5aa-62a6259ca4ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:55:57 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-9ca7687d-1b00-4ced-91e6-9c9c1570289b tempest-VolumesSnapshotTestJSON-1119395226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10c01e18-fea0-4261-816f-2851e1b39a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:55:57 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-9ca7687d-1b00-4ced-91e6-9c9c1570289b tempest-VolumesSnapshotTestJSON-1119395226 None] Volume b6cdcfe2-82af-4376-8cbd-cc7c1c38ce26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6cdcfe2-82af-4376-8cbd-cc7c1c38ce26', 'volume_size': 1} Jul 10 15:55:57 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-9ca7687d-1b00-4ced-91e6-9c9c1570289b tempest-VolumesSnapshotTestJSON-1119395226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:55:57 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-9ca7687d-1b00-4ced-91e6-9c9c1570289b tempest-VolumesSnapshotTestJSON-1119395226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:55:57 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-9ca7687d-1b00-4ced-91e6-9c9c1570289b tempest-VolumesSnapshotTestJSON-1119395226 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:55:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-967103599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6cdcfe2-82af-4376-8cbd-cc7c1c38ce26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e643cb5b87b247789cb00bccc8c1eae1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:55:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:55:57Z,use_quota=True,user_id='8975db700f5543579bffa7dd0c86ba88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 15:55:57 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-9ca7687d-1b00-4ced-91e6-9c9c1570289b tempest-VolumesSnapshotTestJSON-1119395226 None] Creating volume b6cdcfe2-82af-4376-8cbd-cc7c1c38ce26 {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 15:55:57 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-9ca7687d-1b00-4ced-91e6-9c9c1570289b tempest-VolumesSnapshotTestJSON-1119395226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:55:57 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-9ca7687d-1b00-4ced-91e6-9c9c1570289b tempest-VolumesSnapshotTestJSON-1119395226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:55:57 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-9ca7687d-1b00-4ced-91e6-9c9c1570289b tempest-VolumesSnapshotTestJSON-1119395226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:55:57 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-9ca7687d-1b00-4ced-91e6-9c9c1570289b tempest-VolumesSnapshotTestJSON-1119395226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:55:57 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-9ca7687d-1b00-4ced-91e6-9c9c1570289b tempest-VolumesSnapshotTestJSON-1119395226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:55:57 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-9ca7687d-1b00-4ced-91e6-9c9c1570289b tempest-VolumesSnapshotTestJSON-1119395226 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 15:55:57 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-9ca7687d-1b00-4ced-91e6-9c9c1570289b tempest-VolumesSnapshotTestJSON-1119395226 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 15:55:57 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-9ca7687d-1b00-4ced-91e6-9c9c1570289b tempest-VolumesSnapshotTestJSON-1119395226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b6cdcfe2-82af-4376-8cbd-cc7c1c38ce26 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:55:57 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-f4997399-a1b6-4e6f-bafb-d3350af4a223 tempest-VolumeQuotasNegativeTestJSON-534763400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:55:57 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-f4997399-a1b6-4e6f-bafb-d3350af4a223 tempest-VolumeQuotasNegativeTestJSON-534763400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:55:57 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-f4997399-a1b6-4e6f-bafb-d3350af4a223 tempest-VolumeQuotasNegativeTestJSON-534763400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:55:57 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-f4997399-a1b6-4e6f-bafb-d3350af4a223 tempest-VolumeQuotasNegativeTestJSON-534763400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:55:57 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-f4997399-a1b6-4e6f-bafb-d3350af4a223 tempest-VolumeQuotasNegativeTestJSON-534763400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:55:57 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f4997399-a1b6-4e6f-bafb-d3350af4a223 tempest-VolumeQuotasNegativeTestJSON-534763400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:55:57 devstack sudo[96347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b6cdcfe2-82af-4376-8cbd-cc7c1c38ce26 1073741824 Jul 10 15:55:57 devstack sudo[96347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:55:57 devstack sudo[96349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 15:55:57 devstack sudo[96349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:55:57 devstack sudo[96349]: pam_unix(sudo:session): session closed for user root Jul 10 15:55:57 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f4997399-a1b6-4e6f-bafb-d3350af4a223 tempest-VolumeQuotasNegativeTestJSON-534763400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.777s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:55:57 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-f4997399-a1b6-4e6f-bafb-d3350af4a223 tempest-VolumeQuotasNegativeTestJSON-534763400 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 15:55:57 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-f4997399-a1b6-4e6f-bafb-d3350af4a223 tempest-VolumeQuotasNegativeTestJSON-534763400 None] Deleted volume successfully. Jul 10 15:55:57 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-f4997399-a1b6-4e6f-bafb-d3350af4a223 tempest-VolumeQuotasNegativeTestJSON-534763400 None] Lock "cinder-56a83eea-c6ec-4f3c-af9c-422f21a82a6b-delete_volume" released by "delete_volume" :: held 3.267s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:55:58 devstack sudo[96347]: pam_unix(sudo:session): session closed for user root Jul 10 15:55:58 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-9ca7687d-1b00-4ced-91e6-9c9c1570289b tempest-VolumesSnapshotTestJSON-1119395226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b6cdcfe2-82af-4376-8cbd-cc7c1c38ce26 1073741824" returned: 0 in 1.002s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:55:58 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-9ca7687d-1b00-4ced-91e6-9c9c1570289b tempest-VolumesSnapshotTestJSON-1119395226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b6cdcfe2-82af-4376-8cbd-cc7c1c38ce26 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:55:58 devstack sudo[96356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b6cdcfe2-82af-4376-8cbd-cc7c1c38ce26 Jul 10 15:55:58 devstack sudo[96356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:55:58 devstack sudo[96356]: pam_unix(sudo:session): session closed for user root Jul 10 15:55:58 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-9ca7687d-1b00-4ced-91e6-9c9c1570289b tempest-VolumesSnapshotTestJSON-1119395226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b6cdcfe2-82af-4376-8cbd-cc7c1c38ce26" returned: 0 in 0.724s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:55:58 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-9ca7687d-1b00-4ced-91e6-9c9c1570289b tempest-VolumesSnapshotTestJSON-1119395226 None] <== create_volume: return (1777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 15:55:58 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-9ca7687d-1b00-4ced-91e6-9c9c1570289b tempest-VolumesSnapshotTestJSON-1119395226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.779s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:55:58 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-9ca7687d-1b00-4ced-91e6-9c9c1570289b tempest-VolumesSnapshotTestJSON-1119395226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10c01e18-fea0-4261-816f-2851e1b39a6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6cdcfe2-82af-4376-8cbd-cc7c1c38ce26', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:55:58 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-9ca7687d-1b00-4ced-91e6-9c9c1570289b tempest-VolumesSnapshotTestJSON-1119395226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5910f437-9db0-477a-b36f-ebfd07f246ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:55:58 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-9ca7687d-1b00-4ced-91e6-9c9c1570289b tempest-VolumesSnapshotTestJSON-1119395226 None] Volume volume-b6cdcfe2-82af-4376-8cbd-cc7c1c38ce26 (b6cdcfe2-82af-4376-8cbd-cc7c1c38ce26): created successfully Jul 10 15:55:58 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-9ca7687d-1b00-4ced-91e6-9c9c1570289b tempest-VolumesSnapshotTestJSON-1119395226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5910f437-9db0-477a-b36f-ebfd07f246ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:55:58 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-9ca7687d-1b00-4ced-91e6-9c9c1570289b tempest-VolumesSnapshotTestJSON-1119395226 None] Flow 'volume_create_manager' (b967bdf4-8c19-446c-a907-b3a8e4f4f5a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:55:58 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-9ca7687d-1b00-4ced-91e6-9c9c1570289b tempest-VolumesSnapshotTestJSON-1119395226 None] Created volume successfully. Jul 10 15:55:59 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-c4252dd8-7c4e-4840-bd02-9df8c0cbc5c2 tempest-VolumesSnapshotTestJSON-1119395226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:55:59 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-c4252dd8-7c4e-4840-bd02-9df8c0cbc5c2 tempest-VolumesSnapshotTestJSON-1119395226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:55:59 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-c4252dd8-7c4e-4840-bd02-9df8c0cbc5c2 tempest-VolumesSnapshotTestJSON-1119395226 None] Creating offline snapshot aecab6b3-fd16-412b-be63-9a3ef90b2fab of volume b6cdcfe2-82af-4376-8cbd-cc7c1c38ce26 {{(pid=87420) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 15:55:59 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfb71640-dcce-40a1-b0f0-dd64d385dce9]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:55:59 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c4252dd8-7c4e-4840-bd02-9df8c0cbc5c2 tempest-VolumesSnapshotTestJSON-1119395226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b6cdcfe2-82af-4376-8cbd-cc7c1c38ce26 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:55:59 devstack sudo[96359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b6cdcfe2-82af-4376-8cbd-cc7c1c38ce26 Jul 10 15:55:59 devstack sudo[96359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:00 devstack sudo[96359]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:00 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c4252dd8-7c4e-4840-bd02-9df8c0cbc5c2 tempest-VolumesSnapshotTestJSON-1119395226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b6cdcfe2-82af-4376-8cbd-cc7c1c38ce26" returned: 0 in 0.917s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:00 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c4252dd8-7c4e-4840-bd02-9df8c0cbc5c2 tempest-VolumesSnapshotTestJSON-1119395226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b6cdcfe2-82af-4376-8cbd-cc7c1c38ce26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b6cdcfe2-82af-4376-8cbd-cc7c1c38ce26.aecab6b3-fd16-412b-be63-9a3ef90b2fab 1G {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:00 devstack sudo[96364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b6cdcfe2-82af-4376-8cbd-cc7c1c38ce26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b6cdcfe2-82af-4376-8cbd-cc7c1c38ce26.aecab6b3-fd16-412b-be63-9a3ef90b2fab 1G Jul 10 15:56:00 devstack sudo[96364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:01 devstack sudo[96364]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:01 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c4252dd8-7c4e-4840-bd02-9df8c0cbc5c2 tempest-VolumesSnapshotTestJSON-1119395226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b6cdcfe2-82af-4376-8cbd-cc7c1c38ce26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b6cdcfe2-82af-4376-8cbd-cc7c1c38ce26.aecab6b3-fd16-412b-be63-9a3ef90b2fab 1G" returned: 0 in 1.067s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:01 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c4252dd8-7c4e-4840-bd02-9df8c0cbc5c2 tempest-VolumesSnapshotTestJSON-1119395226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6cdcfe2-82af-4376-8cbd-cc7c1c38ce26 -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b6cdcfe2-82af-4376-8cbd-cc7c1c38ce26.aecab6b3-fd16-412b-be63-9a3ef90b2fab {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:01 devstack sudo[96370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6cdcfe2-82af-4376-8cbd-cc7c1c38ce26 -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b6cdcfe2-82af-4376-8cbd-cc7c1c38ce26.aecab6b3-fd16-412b-be63-9a3ef90b2fab Jul 10 15:56:01 devstack sudo[96370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:01 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-08d34825-1302-436d-b2ee-994a9765e030 tempest-SnapshotsActionsTest-1918108303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 15:56:01 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-08d34825-1302-436d-b2ee-994a9765e030 tempest-SnapshotsActionsTest-1918108303 None] Flow 'volume_create_manager' (6db1a909-87b3-43b5-9d6f-625aaa5d22c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:56:01 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-08d34825-1302-436d-b2ee-994a9765e030 tempest-SnapshotsActionsTest-1918108303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6f70ae1-df15-4b5c-a8b5-95f88dafdccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:56:01 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-08d34825-1302-436d-b2ee-994a9765e030 tempest-SnapshotsActionsTest-1918108303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6f70ae1-df15-4b5c-a8b5-95f88dafdccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:56:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1468503027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2922929-98bb-4fec-bdd5-aad2d7870937,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a7089de465c4823a175d120005dcc6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:56:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:56:02Z,use_quota=True,user_id='30a7707b10cb458aa1459562e8187be3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:56:01 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-08d34825-1302-436d-b2ee-994a9765e030 tempest-SnapshotsActionsTest-1918108303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6567e41c-9ce0-4c12-b317-b4e9e67ff5c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:56:01 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-08d34825-1302-436d-b2ee-994a9765e030 tempest-SnapshotsActionsTest-1918108303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6567e41c-9ce0-4c12-b317-b4e9e67ff5c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:56:01 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-08d34825-1302-436d-b2ee-994a9765e030 tempest-SnapshotsActionsTest-1918108303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (894e1832-b9bc-4beb-8c1e-8c4bf5dab234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:56:01 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-08d34825-1302-436d-b2ee-994a9765e030 tempest-SnapshotsActionsTest-1918108303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (894e1832-b9bc-4beb-8c1e-8c4bf5dab234) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2922929-98bb-4fec-bdd5-aad2d7870937', 'volume_name': 'volume-f2922929-98bb-4fec-bdd5-aad2d7870937', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:56:01 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-08d34825-1302-436d-b2ee-994a9765e030 tempest-SnapshotsActionsTest-1918108303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (234ce9a3-0082-462c-add1-814c9ba547ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:56:01 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-08d34825-1302-436d-b2ee-994a9765e030 tempest-SnapshotsActionsTest-1918108303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (234ce9a3-0082-462c-add1-814c9ba547ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:56:01 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-08d34825-1302-436d-b2ee-994a9765e030 tempest-SnapshotsActionsTest-1918108303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5358d6eb-eb2e-4b4a-ade2-22b3fbcca667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:56:01 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-08d34825-1302-436d-b2ee-994a9765e030 tempest-SnapshotsActionsTest-1918108303 None] Volume f2922929-98bb-4fec-bdd5-aad2d7870937: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2922929-98bb-4fec-bdd5-aad2d7870937', 'volume_size': 1} Jul 10 15:56:01 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-08d34825-1302-436d-b2ee-994a9765e030 tempest-SnapshotsActionsTest-1918108303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:56:02 devstack sudo[96370]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:02 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c4252dd8-7c4e-4840-bd02-9df8c0cbc5c2 tempest-VolumesSnapshotTestJSON-1119395226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6cdcfe2-82af-4376-8cbd-cc7c1c38ce26 -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b6cdcfe2-82af-4376-8cbd-cc7c1c38ce26.aecab6b3-fd16-412b-be63-9a3ef90b2fab" returned: 0 in 0.937s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:02 devstack cinder-volume[87420]: WARNING cinder.volume.drivers.remotefs [None req-c4252dd8-7c4e-4840-bd02-9df8c0cbc5c2 tempest-VolumesSnapshotTestJSON-1119395226 None] /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b6cdcfe2-82af-4376-8cbd-cc7c1c38ce26.aecab6b3-fd16-412b-be63-9a3ef90b2fab is being set with open permissions: ugo+rw Jul 10 15:56:02 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c4252dd8-7c4e-4840-bd02-9df8c0cbc5c2 tempest-VolumesSnapshotTestJSON-1119395226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b6cdcfe2-82af-4376-8cbd-cc7c1c38ce26.aecab6b3-fd16-412b-be63-9a3ef90b2fab {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:02 devstack sudo[96376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b6cdcfe2-82af-4376-8cbd-cc7c1c38ce26.aecab6b3-fd16-412b-be63-9a3ef90b2fab Jul 10 15:56:02 devstack sudo[96376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:02 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-b80a17bc-4232-4713-82ca-d273badc7e15 tempest-AttachVolumeTestJSON-927521694 None] Acquiring lock "cinder-590db07f-6b56-4207-a3b3-404f56136f38-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:56:02 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-b80a17bc-4232-4713-82ca-d273badc7e15 tempest-AttachVolumeTestJSON-927521694 None] Lock "cinder-590db07f-6b56-4207-a3b3-404f56136f38-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:56:02 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-b80a17bc-4232-4713-82ca-d273badc7e15 tempest-AttachVolumeTestJSON-927521694 None] Acquiring lock "cinder-quobyte-590db07f-6b56-4207-a3b3-404f56136f38" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:56:02 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-b80a17bc-4232-4713-82ca-d273badc7e15 tempest-AttachVolumeTestJSON-927521694 None] Lock "cinder-quobyte-590db07f-6b56-4207-a3b3-404f56136f38" acquired by "delete_volume" :: waited 0.024s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:56:02 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[0061aa71-c791-48fb-8ddb-306cdd95a760]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:56:02 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-b80a17bc-4232-4713-82ca-d273badc7e15 tempest-AttachVolumeTestJSON-927521694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-590db07f-6b56-4207-a3b3-404f56136f38 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:02 devstack sudo[96378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-590db07f-6b56-4207-a3b3-404f56136f38 Jul 10 15:56:02 devstack sudo[96378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:03 devstack sudo[96376]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:03 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c4252dd8-7c4e-4840-bd02-9df8c0cbc5c2 tempest-VolumesSnapshotTestJSON-1119395226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b6cdcfe2-82af-4376-8cbd-cc7c1c38ce26.aecab6b3-fd16-412b-be63-9a3ef90b2fab" returned: 0 in 0.745s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:03 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c4252dd8-7c4e-4840-bd02-9df8c0cbc5c2 tempest-VolumesSnapshotTestJSON-1119395226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b6cdcfe2-82af-4376-8cbd-cc7c1c38ce26.info {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:03 devstack sudo[96382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b6cdcfe2-82af-4376-8cbd-cc7c1c38ce26.info Jul 10 15:56:03 devstack sudo[96382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:03 devstack sudo[96378]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:03 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-b80a17bc-4232-4713-82ca-d273badc7e15 tempest-AttachVolumeTestJSON-927521694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-590db07f-6b56-4207-a3b3-404f56136f38" returned: 0 in 0.800s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:03 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-b80a17bc-4232-4713-82ca-d273badc7e15 tempest-AttachVolumeTestJSON-927521694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-590db07f-6b56-4207-a3b3-404f56136f38 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:03 devstack sudo[96387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-590db07f-6b56-4207-a3b3-404f56136f38 Jul 10 15:56:03 devstack sudo[96387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:03 devstack sudo[96382]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:03 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c4252dd8-7c4e-4840-bd02-9df8c0cbc5c2 tempest-VolumesSnapshotTestJSON-1119395226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b6cdcfe2-82af-4376-8cbd-cc7c1c38ce26.info" returned: 0 in 0.683s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:03 devstack cinder-volume[87420]: WARNING cinder.volume.drivers.remotefs [None req-c4252dd8-7c4e-4840-bd02-9df8c0cbc5c2 tempest-VolumesSnapshotTestJSON-1119395226 None] /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b6cdcfe2-82af-4376-8cbd-cc7c1c38ce26.info is being set with open permissions: ugo+rw Jul 10 15:56:03 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c4252dd8-7c4e-4840-bd02-9df8c0cbc5c2 tempest-VolumesSnapshotTestJSON-1119395226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b6cdcfe2-82af-4376-8cbd-cc7c1c38ce26.info {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:03 devstack sudo[96390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b6cdcfe2-82af-4376-8cbd-cc7c1c38ce26.info Jul 10 15:56:03 devstack sudo[96390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:04 devstack sudo[96387]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:04 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-b80a17bc-4232-4713-82ca-d273badc7e15 tempest-AttachVolumeTestJSON-927521694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-590db07f-6b56-4207-a3b3-404f56136f38" returned: 0 in 0.713s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:04 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-b80a17bc-4232-4713-82ca-d273badc7e15 tempest-AttachVolumeTestJSON-927521694 None] Lock "cinder-quobyte-590db07f-6b56-4207-a3b3-404f56136f38" released by "delete_volume" :: held 1.583s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:56:04 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-b80a17bc-4232-4713-82ca-d273badc7e15 tempest-AttachVolumeTestJSON-927521694 None] Created reservations ['6107b20d-aecf-412d-b485-e869036e0bbf', '2aed4d0d-fec4-4d2d-9e36-1080212c0e83', 'a6f501e0-f444-4682-916e-1db3f5ef7ed0', '629a02e8-8f7b-4b52-aac0-20975dafc5ae'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 15:56:04 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-b80a17bc-4232-4713-82ca-d273badc7e15 tempest-AttachVolumeTestJSON-927521694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:56:04 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-b80a17bc-4232-4713-82ca-d273badc7e15 tempest-AttachVolumeTestJSON-927521694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:56:04 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-b80a17bc-4232-4713-82ca-d273badc7e15 tempest-AttachVolumeTestJSON-927521694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:56:04 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-b80a17bc-4232-4713-82ca-d273badc7e15 tempest-AttachVolumeTestJSON-927521694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:56:04 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-b80a17bc-4232-4713-82ca-d273badc7e15 tempest-AttachVolumeTestJSON-927521694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:56:04 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-b80a17bc-4232-4713-82ca-d273badc7e15 tempest-AttachVolumeTestJSON-927521694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:04 devstack sudo[96393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 15:56:04 devstack sudo[96393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:04 devstack sudo[96390]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:04 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c4252dd8-7c4e-4840-bd02-9df8c0cbc5c2 tempest-VolumesSnapshotTestJSON-1119395226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b6cdcfe2-82af-4376-8cbd-cc7c1c38ce26.info" returned: 0 in 0.664s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:04 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-c4252dd8-7c4e-4840-bd02-9df8c0cbc5c2 tempest-VolumesSnapshotTestJSON-1119395226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.147s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:56:04 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-08d34825-1302-436d-b2ee-994a9765e030 tempest-SnapshotsActionsTest-1918108303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.700s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:56:04 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-08d34825-1302-436d-b2ee-994a9765e030 tempest-SnapshotsActionsTest-1918108303 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:56:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1468503027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2922929-98bb-4fec-bdd5-aad2d7870937,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a7089de465c4823a175d120005dcc6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:56:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:56:02Z,use_quota=True,user_id='30a7707b10cb458aa1459562e8187be3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 15:56:04 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-08d34825-1302-436d-b2ee-994a9765e030 tempest-SnapshotsActionsTest-1918108303 None] Creating volume f2922929-98bb-4fec-bdd5-aad2d7870937 {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 15:56:04 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-08d34825-1302-436d-b2ee-994a9765e030 tempest-SnapshotsActionsTest-1918108303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:56:04 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-08d34825-1302-436d-b2ee-994a9765e030 tempest-SnapshotsActionsTest-1918108303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:56:04 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-08d34825-1302-436d-b2ee-994a9765e030 tempest-SnapshotsActionsTest-1918108303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:56:04 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-08d34825-1302-436d-b2ee-994a9765e030 tempest-SnapshotsActionsTest-1918108303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:56:04 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-08d34825-1302-436d-b2ee-994a9765e030 tempest-SnapshotsActionsTest-1918108303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:56:04 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-08d34825-1302-436d-b2ee-994a9765e030 tempest-SnapshotsActionsTest-1918108303 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 15:56:04 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-08d34825-1302-436d-b2ee-994a9765e030 tempest-SnapshotsActionsTest-1918108303 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 15:56:04 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-08d34825-1302-436d-b2ee-994a9765e030 tempest-SnapshotsActionsTest-1918108303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:04 devstack sudo[96398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937 1073741824 Jul 10 15:56:04 devstack sudo[96398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:04 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-c4252dd8-7c4e-4840-bd02-9df8c0cbc5c2 tempest-VolumesSnapshotTestJSON-1119395226 None] Create snapshot completed successfully Jul 10 15:56:04 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-8cb6c485-db13-4801-ac44-25b03b0d4b58 tempest-AttachVolumeTestJSON-927521694 None] Acquiring lock "cinder-b754da21-8f5a-45d9-9967-0fc4f7d47dc5-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:56:04 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-8cb6c485-db13-4801-ac44-25b03b0d4b58 tempest-AttachVolumeTestJSON-927521694 None] Lock "cinder-b754da21-8f5a-45d9-9967-0fc4f7d47dc5-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:56:04 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-8cb6c485-db13-4801-ac44-25b03b0d4b58 tempest-AttachVolumeTestJSON-927521694 None] Acquiring lock "cinder-quobyte-b754da21-8f5a-45d9-9967-0fc4f7d47dc5" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:56:04 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-8cb6c485-db13-4801-ac44-25b03b0d4b58 tempest-AttachVolumeTestJSON-927521694 None] Lock "cinder-quobyte-b754da21-8f5a-45d9-9967-0fc4f7d47dc5" acquired by "delete_volume" :: waited 0.028s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:56:04 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdcfb246-0f45-4044-82ba-8456af54ca33]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:56:04 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8cb6c485-db13-4801-ac44-25b03b0d4b58 tempest-AttachVolumeTestJSON-927521694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b754da21-8f5a-45d9-9967-0fc4f7d47dc5 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:05 devstack sudo[96393]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:05 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-b80a17bc-4232-4713-82ca-d273badc7e15 tempest-AttachVolumeTestJSON-927521694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.798s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:05 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-b80a17bc-4232-4713-82ca-d273badc7e15 tempest-AttachVolumeTestJSON-927521694 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 15:56:05 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-b80a17bc-4232-4713-82ca-d273badc7e15 tempest-AttachVolumeTestJSON-927521694 None] Deleted volume successfully. Jul 10 15:56:05 devstack sudo[96401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b754da21-8f5a-45d9-9967-0fc4f7d47dc5 Jul 10 15:56:05 devstack sudo[96401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:05 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-b80a17bc-4232-4713-82ca-d273badc7e15 tempest-AttachVolumeTestJSON-927521694 None] Lock "cinder-590db07f-6b56-4207-a3b3-404f56136f38-delete_volume" released by "delete_volume" :: held 2.675s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:56:05 devstack sudo[96398]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:05 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-08d34825-1302-436d-b2ee-994a9765e030 tempest-SnapshotsActionsTest-1918108303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937 1073741824" returned: 0 in 0.976s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:05 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-08d34825-1302-436d-b2ee-994a9765e030 tempest-SnapshotsActionsTest-1918108303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:05 devstack sudo[96407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937 Jul 10 15:56:05 devstack sudo[96407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:05 devstack sudo[96401]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:05 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8cb6c485-db13-4801-ac44-25b03b0d4b58 tempest-AttachVolumeTestJSON-927521694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b754da21-8f5a-45d9-9967-0fc4f7d47dc5" returned: 0 in 1.038s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:05 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8cb6c485-db13-4801-ac44-25b03b0d4b58 tempest-AttachVolumeTestJSON-927521694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b754da21-8f5a-45d9-9967-0fc4f7d47dc5 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:06 devstack sudo[96413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b754da21-8f5a-45d9-9967-0fc4f7d47dc5 Jul 10 15:56:06 devstack sudo[96413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:06 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4a25549-a2b4-493f-885e-1a626bb21954 tempest-VolumesSnapshotTestJSON-1119395226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 15:56:06 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d4a25549-a2b4-493f-885e-1a626bb21954 tempest-VolumesSnapshotTestJSON-1119395226 None] Flow 'volume_create_manager' (bc345fa7-4aa9-4ac3-8093-47ccac9e2b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:56:06 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d4a25549-a2b4-493f-885e-1a626bb21954 tempest-VolumesSnapshotTestJSON-1119395226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dcc250c-e76d-4e53-b328-630a909725d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:56:06 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d4a25549-a2b4-493f-885e-1a626bb21954 tempest-VolumesSnapshotTestJSON-1119395226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dcc250c-e76d-4e53-b328-630a909725d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:56:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-146261534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c68b4234-ba32-4394-8796-f5d0542bad6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e643cb5b87b247789cb00bccc8c1eae1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:56:06Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=aecab6b3-fd16-412b-be63-9a3ef90b2fab,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:56:06Z,use_quota=True,user_id='8975db700f5543579bffa7dd0c86ba88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:56:06 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d4a25549-a2b4-493f-885e-1a626bb21954 tempest-VolumesSnapshotTestJSON-1119395226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95ffac8f-f1ed-4b0e-93f3-b318a867e478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:56:06 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d4a25549-a2b4-493f-885e-1a626bb21954 tempest-VolumesSnapshotTestJSON-1119395226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95ffac8f-f1ed-4b0e-93f3-b318a867e478) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:56:06 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d4a25549-a2b4-493f-885e-1a626bb21954 tempest-VolumesSnapshotTestJSON-1119395226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b46e2ebf-00fb-4dc5-a541-56703a6bf742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:56:06 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d4a25549-a2b4-493f-885e-1a626bb21954 tempest-VolumesSnapshotTestJSON-1119395226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b46e2ebf-00fb-4dc5-a541-56703a6bf742) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c68b4234-ba32-4394-8796-f5d0542bad6f', 'volume_name': 'volume-c68b4234-ba32-4394-8796-f5d0542bad6f', 'volume_size': 2, 'snapshot_id': 'aecab6b3-fd16-412b-be63-9a3ef90b2fab'}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:56:06 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d4a25549-a2b4-493f-885e-1a626bb21954 tempest-VolumesSnapshotTestJSON-1119395226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57d3c8a3-efa8-4a4f-b094-9c8bb5b6cd79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:56:06 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d4a25549-a2b4-493f-885e-1a626bb21954 tempest-VolumesSnapshotTestJSON-1119395226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57d3c8a3-efa8-4a4f-b094-9c8bb5b6cd79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:56:06 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d4a25549-a2b4-493f-885e-1a626bb21954 tempest-VolumesSnapshotTestJSON-1119395226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1134c57f-6fef-4caa-91a1-0b91feb6de88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:56:06 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-d4a25549-a2b4-493f-885e-1a626bb21954 tempest-VolumesSnapshotTestJSON-1119395226 None] Volume c68b4234-ba32-4394-8796-f5d0542bad6f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c68b4234-ba32-4394-8796-f5d0542bad6f', 'volume_size': 2, 'snapshot_id': 'aecab6b3-fd16-412b-be63-9a3ef90b2fab'} Jul 10 15:56:06 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-d4a25549-a2b4-493f-885e-1a626bb21954 tempest-VolumesSnapshotTestJSON-1119395226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:56:06 devstack sudo[96407]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:06 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-08d34825-1302-436d-b2ee-994a9765e030 tempest-SnapshotsActionsTest-1918108303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937" returned: 0 in 0.989s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:06 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-08d34825-1302-436d-b2ee-994a9765e030 tempest-SnapshotsActionsTest-1918108303 None] <== create_volume: return (2047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 15:56:06 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-08d34825-1302-436d-b2ee-994a9765e030 tempest-SnapshotsActionsTest-1918108303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.053s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:56:06 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-d4a25549-a2b4-493f-885e-1a626bb21954 tempest-VolumesSnapshotTestJSON-1119395226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.018s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:56:06 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-d4a25549-a2b4-493f-885e-1a626bb21954 tempest-VolumesSnapshotTestJSON-1119395226 None] Acquiring lock "cinder-quobyte-aecab6b3-fd16-412b-be63-9a3ef90b2fab-c68b4234-ba32-4394-8796-f5d0542bad6f" by "_create_volume_from_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:56:06 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-08d34825-1302-436d-b2ee-994a9765e030 tempest-SnapshotsActionsTest-1918108303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5358d6eb-eb2e-4b4a-ade2-22b3fbcca667) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2922929-98bb-4fec-bdd5-aad2d7870937', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:56:06 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-08d34825-1302-436d-b2ee-994a9765e030 tempest-SnapshotsActionsTest-1918108303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb8c3f66-ce11-4e60-995d-7fbe6587866f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:56:06 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-d4a25549-a2b4-493f-885e-1a626bb21954 tempest-VolumesSnapshotTestJSON-1119395226 None] Lock "cinder-quobyte-aecab6b3-fd16-412b-be63-9a3ef90b2fab-c68b4234-ba32-4394-8796-f5d0542bad6f" acquired by "_create_volume_from_snapshot" :: waited 0.041s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:56:06 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-d4a25549-a2b4-493f-885e-1a626bb21954 tempest-VolumesSnapshotTestJSON-1119395226 None] Creating volume c68b4234-ba32-4394-8796-f5d0542bad6f from snapshot aecab6b3-fd16-412b-be63-9a3ef90b2fab {{(pid=87420) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 10 15:56:06 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-d4a25549-a2b4-493f-885e-1a626bb21954 tempest-VolumesSnapshotTestJSON-1119395226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:56:06 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-d4a25549-a2b4-493f-885e-1a626bb21954 tempest-VolumesSnapshotTestJSON-1119395226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:56:06 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-d4a25549-a2b4-493f-885e-1a626bb21954 tempest-VolumesSnapshotTestJSON-1119395226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:56:06 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-d4a25549-a2b4-493f-885e-1a626bb21954 tempest-VolumesSnapshotTestJSON-1119395226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:56:06 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-d4a25549-a2b4-493f-885e-1a626bb21954 tempest-VolumesSnapshotTestJSON-1119395226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:56:06 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-d4a25549-a2b4-493f-885e-1a626bb21954 tempest-VolumesSnapshotTestJSON-1119395226 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 15:56:06 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-d4a25549-a2b4-493f-885e-1a626bb21954 tempest-VolumesSnapshotTestJSON-1119395226 None] Acquiring lock "cinder-quobyte-c68b4234-ba32-4394-8796-f5d0542bad6f" by "_copy_volume_from_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:56:06 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-08d34825-1302-436d-b2ee-994a9765e030 tempest-SnapshotsActionsTest-1918108303 None] Volume volume-f2922929-98bb-4fec-bdd5-aad2d7870937 (f2922929-98bb-4fec-bdd5-aad2d7870937): created successfully Jul 10 15:56:06 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-08d34825-1302-436d-b2ee-994a9765e030 tempest-SnapshotsActionsTest-1918108303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb8c3f66-ce11-4e60-995d-7fbe6587866f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:56:06 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-08d34825-1302-436d-b2ee-994a9765e030 tempest-SnapshotsActionsTest-1918108303 None] Flow 'volume_create_manager' (6db1a909-87b3-43b5-9d6f-625aaa5d22c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:56:06 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-d4a25549-a2b4-493f-885e-1a626bb21954 tempest-VolumesSnapshotTestJSON-1119395226 None] Lock "cinder-quobyte-c68b4234-ba32-4394-8796-f5d0542bad6f" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:56:06 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-d4a25549-a2b4-493f-885e-1a626bb21954 tempest-VolumesSnapshotTestJSON-1119395226 None] snapshot: aecab6b3-fd16-412b-be63-9a3ef90b2fab, volume: c68b4234-ba32-4394-8796-f5d0542bad6f, {{(pid=87420) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 15:56:06 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-08d34825-1302-436d-b2ee-994a9765e030 tempest-SnapshotsActionsTest-1918108303 None] Created volume successfully. Jul 10 15:56:06 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-d4a25549-a2b4-493f-885e-1a626bb21954 tempest-VolumesSnapshotTestJSON-1119395226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:56:06 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-d4a25549-a2b4-493f-885e-1a626bb21954 tempest-VolumesSnapshotTestJSON-1119395226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:56:06 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-d4a25549-a2b4-493f-885e-1a626bb21954 tempest-VolumesSnapshotTestJSON-1119395226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:56:06 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-d4a25549-a2b4-493f-885e-1a626bb21954 tempest-VolumesSnapshotTestJSON-1119395226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:56:06 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-d4a25549-a2b4-493f-885e-1a626bb21954 tempest-VolumesSnapshotTestJSON-1119395226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:56:06 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5ff466d-a1c2-4cdf-b0d4-560e7533fd08]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:56:06 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d4a25549-a2b4-493f-885e-1a626bb21954 tempest-VolumesSnapshotTestJSON-1119395226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b6cdcfe2-82af-4376-8cbd-cc7c1c38ce26.aecab6b3-fd16-412b-be63-9a3ef90b2fab {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:06 devstack sudo[96416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b6cdcfe2-82af-4376-8cbd-cc7c1c38ce26.aecab6b3-fd16-412b-be63-9a3ef90b2fab Jul 10 15:56:06 devstack sudo[96416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:06 devstack sudo[96413]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:06 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8cb6c485-db13-4801-ac44-25b03b0d4b58 tempest-AttachVolumeTestJSON-927521694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b754da21-8f5a-45d9-9967-0fc4f7d47dc5" returned: 0 in 0.865s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:06 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-8cb6c485-db13-4801-ac44-25b03b0d4b58 tempest-AttachVolumeTestJSON-927521694 None] Lock "cinder-quobyte-b754da21-8f5a-45d9-9967-0fc4f7d47dc5" released by "delete_volume" :: held 1.963s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:56:06 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-8cb6c485-db13-4801-ac44-25b03b0d4b58 tempest-AttachVolumeTestJSON-927521694 None] Created reservations ['3309c2b8-ea7a-4232-98b6-609b46c71742', 'b2d2f94a-19ad-4b28-8d94-4398da5fe2ff', 'b24b1be8-8158-4730-80b6-b478953b2741', 'b600e56d-a036-4f0b-8d84-c63cda731f61'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 15:56:07 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-8cb6c485-db13-4801-ac44-25b03b0d4b58 tempest-AttachVolumeTestJSON-927521694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:56:07 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-8cb6c485-db13-4801-ac44-25b03b0d4b58 tempest-AttachVolumeTestJSON-927521694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:56:07 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-8cb6c485-db13-4801-ac44-25b03b0d4b58 tempest-AttachVolumeTestJSON-927521694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:56:07 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-8cb6c485-db13-4801-ac44-25b03b0d4b58 tempest-AttachVolumeTestJSON-927521694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:56:07 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-8cb6c485-db13-4801-ac44-25b03b0d4b58 tempest-AttachVolumeTestJSON-927521694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:56:07 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8cb6c485-db13-4801-ac44-25b03b0d4b58 tempest-AttachVolumeTestJSON-927521694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:07 devstack sudo[96419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 15:56:07 devstack sudo[96419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:07 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-c0cab77d-8118-4bf6-9bda-367fca8edca4 tempest-SnapshotsActionsTest-1918108303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:56:07 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-9e61ebad-2f04-42da-81b5-9b8dc04ba0ed tempest-AttachVolumeTestJSON-927521694 None] Acquiring lock "cinder-691a1195-b6ba-4a90-9c37-4140d3b05b8f-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:56:07 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-9e61ebad-2f04-42da-81b5-9b8dc04ba0ed tempest-AttachVolumeTestJSON-927521694 None] Lock "cinder-691a1195-b6ba-4a90-9c37-4140d3b05b8f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:56:07 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-9e61ebad-2f04-42da-81b5-9b8dc04ba0ed tempest-AttachVolumeTestJSON-927521694 None] Acquiring lock "cinder-quobyte-691a1195-b6ba-4a90-9c37-4140d3b05b8f" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:56:07 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-9e61ebad-2f04-42da-81b5-9b8dc04ba0ed tempest-AttachVolumeTestJSON-927521694 None] Lock "cinder-quobyte-691a1195-b6ba-4a90-9c37-4140d3b05b8f" acquired by "delete_volume" :: waited 0.026s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:56:07 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d48bad9-e081-456b-81bc-a31efe2cdf6e]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:56:07 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-9e61ebad-2f04-42da-81b5-9b8dc04ba0ed tempest-AttachVolumeTestJSON-927521694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-691a1195-b6ba-4a90-9c37-4140d3b05b8f {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:07 devstack sudo[96421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-691a1195-b6ba-4a90-9c37-4140d3b05b8f Jul 10 15:56:07 devstack sudo[96421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:07 devstack sudo[96416]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:07 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d4a25549-a2b4-493f-885e-1a626bb21954 tempest-VolumesSnapshotTestJSON-1119395226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b6cdcfe2-82af-4376-8cbd-cc7c1c38ce26.aecab6b3-fd16-412b-be63-9a3ef90b2fab" returned: 0 in 1.071s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:07 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-d4a25549-a2b4-493f-885e-1a626bb21954 tempest-VolumesSnapshotTestJSON-1119395226 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6cdcfe2-82af-4376-8cbd-cc7c1c38ce26(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87420) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 15:56:07 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-d4a25549-a2b4-493f-885e-1a626bb21954 tempest-VolumesSnapshotTestJSON-1119395226 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b6cdcfe2-82af-4376-8cbd-cc7c1c38ce26 {{(pid=87420) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 15:56:07 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-d4a25549-a2b4-493f-885e-1a626bb21954 tempest-VolumesSnapshotTestJSON-1119395226 None] Creating direct copy from snapshot {{(pid=87420) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 15:56:07 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[66a44494-d7c5-45fc-9c30-a46176832b8c]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:56:07 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d4a25549-a2b4-493f-885e-1a626bb21954 tempest-VolumesSnapshotTestJSON-1119395226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b6cdcfe2-82af-4376-8cbd-cc7c1c38ce26 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:07 devstack sudo[96426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b6cdcfe2-82af-4376-8cbd-cc7c1c38ce26 Jul 10 15:56:07 devstack sudo[96426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:07 devstack sudo[96419]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:07 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8cb6c485-db13-4801-ac44-25b03b0d4b58 tempest-AttachVolumeTestJSON-927521694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.913s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:07 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-8cb6c485-db13-4801-ac44-25b03b0d4b58 tempest-AttachVolumeTestJSON-927521694 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 15:56:07 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-8cb6c485-db13-4801-ac44-25b03b0d4b58 tempest-AttachVolumeTestJSON-927521694 None] Deleted volume successfully. Jul 10 15:56:07 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-8cb6c485-db13-4801-ac44-25b03b0d4b58 tempest-AttachVolumeTestJSON-927521694 None] Lock "cinder-b754da21-8f5a-45d9-9967-0fc4f7d47dc5-delete_volume" released by "delete_volume" :: held 3.195s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:56:08 devstack sudo[96421]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:08 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-9e61ebad-2f04-42da-81b5-9b8dc04ba0ed tempest-AttachVolumeTestJSON-927521694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-691a1195-b6ba-4a90-9c37-4140d3b05b8f" returned: 0 in 0.891s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:08 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-9e61ebad-2f04-42da-81b5-9b8dc04ba0ed tempest-AttachVolumeTestJSON-927521694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-691a1195-b6ba-4a90-9c37-4140d3b05b8f {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:08 devstack sudo[96432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-691a1195-b6ba-4a90-9c37-4140d3b05b8f Jul 10 15:56:08 devstack sudo[96432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:08 devstack sudo[96426]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:08 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d4a25549-a2b4-493f-885e-1a626bb21954 tempest-VolumesSnapshotTestJSON-1119395226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b6cdcfe2-82af-4376-8cbd-cc7c1c38ce26" returned: 0 in 0.849s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:08 devstack cinder-volume[87420]: DEBUG cinder.utils [None req-d4a25549-a2b4-493f-885e-1a626bb21954 tempest-VolumesSnapshotTestJSON-1119395226 None] Path /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-c68b4234-ba32-4394-8796-f5d0542bad6f not found in is_blk_device check {{(pid=87420) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 15:56:08 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d4a25549-a2b4-493f-885e-1a626bb21954 tempest-VolumesSnapshotTestJSON-1119395226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b6cdcfe2-82af-4376-8cbd-cc7c1c38ce26 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-c68b4234-ba32-4394-8796-f5d0542bad6f {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:08 devstack sudo[96438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b6cdcfe2-82af-4376-8cbd-cc7c1c38ce26 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-c68b4234-ba32-4394-8796-f5d0542bad6f Jul 10 15:56:08 devstack sudo[96438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:09 devstack sudo[96432]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:09 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-9e61ebad-2f04-42da-81b5-9b8dc04ba0ed tempest-AttachVolumeTestJSON-927521694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-691a1195-b6ba-4a90-9c37-4140d3b05b8f" returned: 0 in 0.707s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:09 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-9e61ebad-2f04-42da-81b5-9b8dc04ba0ed tempest-AttachVolumeTestJSON-927521694 None] Lock "cinder-quobyte-691a1195-b6ba-4a90-9c37-4140d3b05b8f" released by "delete_volume" :: held 1.665s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:56:09 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-9e61ebad-2f04-42da-81b5-9b8dc04ba0ed tempest-AttachVolumeTestJSON-927521694 None] Created reservations ['7e169959-0e0e-4d38-86a7-b1352e2071e9', 'dcb36c10-146b-4a72-8c20-efbb9e4452f5', 'aa61b3c3-6a46-4e31-bf42-78c01b4906cc', 'e568b060-51d8-4660-9ea5-df9bd05101a1'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 15:56:09 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-9e61ebad-2f04-42da-81b5-9b8dc04ba0ed tempest-AttachVolumeTestJSON-927521694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:56:09 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-9e61ebad-2f04-42da-81b5-9b8dc04ba0ed tempest-AttachVolumeTestJSON-927521694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:56:09 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-9e61ebad-2f04-42da-81b5-9b8dc04ba0ed tempest-AttachVolumeTestJSON-927521694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:56:09 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-9e61ebad-2f04-42da-81b5-9b8dc04ba0ed tempest-AttachVolumeTestJSON-927521694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:56:09 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-9e61ebad-2f04-42da-81b5-9b8dc04ba0ed tempest-AttachVolumeTestJSON-927521694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:56:09 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-9e61ebad-2f04-42da-81b5-9b8dc04ba0ed tempest-AttachVolumeTestJSON-927521694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:09 devstack sudo[96444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 15:56:09 devstack sudo[96444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:10 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-73d8a73f-66df-4e12-aa1c-8c5cb582ee1e tempest-VolumesImageMetadata-843895676 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 15:56:10 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-73d8a73f-66df-4e12-aa1c-8c5cb582ee1e tempest-VolumesImageMetadata-843895676 None] Flow 'volume_create_manager' (d2a03bd8-9345-42c8-b20b-85e2db09d9a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:56:10 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-73d8a73f-66df-4e12-aa1c-8c5cb582ee1e tempest-VolumesImageMetadata-843895676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53f5137a-5955-4b0c-94b1-d9b373037da2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:56:10 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-73d8a73f-66df-4e12-aa1c-8c5cb582ee1e tempest-VolumesImageMetadata-843895676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53f5137a-5955-4b0c-94b1-d9b373037da2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:56:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2015581467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab176fcf-d540-47c8-8e14-5d225ef6515e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e237c8d0db84eaa9135b2ee0935baff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:56:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:56:10Z,use_quota=True,user_id='e14e0a3b70f84a1b83ba205a69e71196',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:56:10 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-73d8a73f-66df-4e12-aa1c-8c5cb582ee1e tempest-VolumesImageMetadata-843895676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f74ddac4-896c-4ae0-b3d3-6705269281ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:56:10 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-73d8a73f-66df-4e12-aa1c-8c5cb582ee1e tempest-VolumesImageMetadata-843895676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f74ddac4-896c-4ae0-b3d3-6705269281ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:56:10 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-73d8a73f-66df-4e12-aa1c-8c5cb582ee1e tempest-VolumesImageMetadata-843895676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fd1f1bb-8ac7-4d9f-a526-6505056e2513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:56:10 devstack cinder-volume[87420]: DEBUG cinder.image.glance [None req-73d8a73f-66df-4e12-aa1c-8c5cb582ee1e tempest-VolumesImageMetadata-843895676 None] Creating Keystone auth plugin from conf {{(pid=87420) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 10 15:56:10 devstack sudo[96444]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:10 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-9e61ebad-2f04-42da-81b5-9b8dc04ba0ed tempest-AttachVolumeTestJSON-927521694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 1.604s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:10 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-9e61ebad-2f04-42da-81b5-9b8dc04ba0ed tempest-AttachVolumeTestJSON-927521694 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 15:56:10 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-9e61ebad-2f04-42da-81b5-9b8dc04ba0ed tempest-AttachVolumeTestJSON-927521694 None] Deleted volume successfully. Jul 10 15:56:10 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-9e61ebad-2f04-42da-81b5-9b8dc04ba0ed tempest-AttachVolumeTestJSON-927521694 None] Lock "cinder-691a1195-b6ba-4a90-9c37-4140d3b05b8f-delete_volume" released by "delete_volume" :: held 3.566s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:56:11 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-73d8a73f-66df-4e12-aa1c-8c5cb582ee1e tempest-VolumesImageMetadata-843895676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fd1f1bb-8ac7-4d9f-a526-6505056e2513) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ab176fcf-d540-47c8-8e14-5d225ef6515e', 'volume_name': 'volume-ab176fcf-d540-47c8-8e14-5d225ef6515e', 'volume_size': 1, 'image_id': '980bf5e0-e973-48f3-bc1f-383f924c4467', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/980bf5e0-e973-48f3-bc1f-383f924c4467', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'de9cf234f3774db489ed55d5afcfc7bf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '980bf5e0-e973-48f3-bc1f-383f924c4467', 'created_at': datetime.datetime(2026, 7, 10, 13, 42, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 13, 42, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/980bf5e0-e973-48f3-bc1f-383f924c4467/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:56:11 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-73d8a73f-66df-4e12-aa1c-8c5cb582ee1e tempest-VolumesImageMetadata-843895676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa90c5f4-1543-41a2-a387-6de1f27d0803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:56:11 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-73d8a73f-66df-4e12-aa1c-8c5cb582ee1e tempest-VolumesImageMetadata-843895676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa90c5f4-1543-41a2-a387-6de1f27d0803) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:56:11 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-73d8a73f-66df-4e12-aa1c-8c5cb582ee1e tempest-VolumesImageMetadata-843895676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c039fc90-cc82-447c-9b43-2838f978da1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:56:11 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-73d8a73f-66df-4e12-aa1c-8c5cb582ee1e tempest-VolumesImageMetadata-843895676 None] Volume ab176fcf-d540-47c8-8e14-5d225ef6515e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ab176fcf-d540-47c8-8e14-5d225ef6515e', 'volume_size': 1, 'image_id': '980bf5e0-e973-48f3-bc1f-383f924c4467', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/980bf5e0-e973-48f3-bc1f-383f924c4467', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'de9cf234f3774db489ed55d5afcfc7bf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '980bf5e0-e973-48f3-bc1f-383f924c4467', 'created_at': datetime.datetime(2026, 7, 10, 13, 42, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 13, 42, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/980bf5e0-e973-48f3-bc1f-383f924c4467/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 10 15:56:11 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-73d8a73f-66df-4e12-aa1c-8c5cb582ee1e tempest-VolumesImageMetadata-843895676 None] Trying to clone ab176fcf-d540-47c8-8e14-5d225ef6515e from image 980bf5e0-e973-48f3-bc1f-383f924c4467 at location (None, [{'url': 'file:///opt/stack/data/glance/images/980bf5e0-e973-48f3-bc1f-383f924c4467', 'metadata': {}}]). {{(pid=87420) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 10 15:56:12 devstack cinder-volume[87420]: DEBUG cinder.image.image_utils [None req-73d8a73f-66df-4e12-aa1c-8c5cb582ee1e tempest-VolumesImageMetadata-843895676 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_980bf5e0-e973-48f3-bc1f-383f924c4467__23hmr89devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87420) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 10 15:56:12 devstack cinder-volume[87420]: INFO cinder.image.image_utils [None req-73d8a73f-66df-4e12-aa1c-8c5cb582ee1e tempest-VolumesImageMetadata-843895676 None] Image download 20.69 MB at 20.69 MB/s Jul 10 15:56:12 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b7378c1-81e3-48b3-afec-25d22a75003a]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:56:12 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-73d8a73f-66df-4e12-aa1c-8c5cb582ee1e tempest-VolumesImageMetadata-843895676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_980bf5e0-e973-48f3-bc1f-383f924c4467__23hmr89devstack@QuobyteHD {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:12 devstack sudo[96455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_980bf5e0-e973-48f3-bc1f-383f924c4467__23hmr89devstack@QuobyteHD Jul 10 15:56:12 devstack sudo[96455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:14 devstack sudo[96455]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:14 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-73d8a73f-66df-4e12-aa1c-8c5cb582ee1e tempest-VolumesImageMetadata-843895676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_980bf5e0-e973-48f3-bc1f-383f924c4467__23hmr89devstack@QuobyteHD" returned: 0 in 1.664s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:14 devstack cinder-volume[87420]: DEBUG cinder.image.image_utils [None req-73d8a73f-66df-4e12-aa1c-8c5cb582ee1e tempest-VolumesImageMetadata-843895676 None] Temporary image 980bf5e0-e973-48f3-bc1f-383f924c4467 is fetched for user e14e0a3b70f84a1b83ba205a69e71196. {{(pid=87420) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 10 15:56:14 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[a190c58b-2585-40b0-baf2-29bacafe7413]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:56:14 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-73d8a73f-66df-4e12-aa1c-8c5cb582ee1e tempest-VolumesImageMetadata-843895676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_980bf5e0-e973-48f3-bc1f-383f924c4467__23hmr89devstack@QuobyteHD {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:14 devstack sudo[96464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_980bf5e0-e973-48f3-bc1f-383f924c4467__23hmr89devstack@QuobyteHD Jul 10 15:56:14 devstack sudo[96464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:14 devstack sudo[96438]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:14 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d4a25549-a2b4-493f-885e-1a626bb21954 tempest-VolumesSnapshotTestJSON-1119395226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b6cdcfe2-82af-4376-8cbd-cc7c1c38ce26 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-c68b4234-ba32-4394-8796-f5d0542bad6f" returned: 0 in 5.965s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:14 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[23026a39-5996-44eb-9775-7dbd5e15dbea]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:56:14 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d4a25549-a2b4-493f-885e-1a626bb21954 tempest-VolumesSnapshotTestJSON-1119395226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b6cdcfe2-82af-4376-8cbd-cc7c1c38ce26 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:14 devstack sudo[96466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b6cdcfe2-82af-4376-8cbd-cc7c1c38ce26 Jul 10 15:56:14 devstack sudo[96466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:15 devstack sudo[96464]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:15 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-73d8a73f-66df-4e12-aa1c-8c5cb582ee1e tempest-VolumesImageMetadata-843895676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_980bf5e0-e973-48f3-bc1f-383f924c4467__23hmr89devstack@QuobyteHD" returned: 0 in 0.855s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:15 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-73d8a73f-66df-4e12-aa1c-8c5cb582ee1e tempest-VolumesImageMetadata-843895676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:56:15 devstack sudo[96466]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:15 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d4a25549-a2b4-493f-885e-1a626bb21954 tempest-VolumesSnapshotTestJSON-1119395226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b6cdcfe2-82af-4376-8cbd-cc7c1c38ce26" returned: 0 in 0.945s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:15 devstack cinder-volume[87420]: DEBUG cinder.image.image_utils [None req-d4a25549-a2b4-493f-885e-1a626bb21954 tempest-VolumesSnapshotTestJSON-1119395226 None] Image conversion details: src /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b6cdcfe2-82af-4376-8cbd-cc7c1c38ce26, size 1024.00 MB, duration 5.97 sec, destination /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-c68b4234-ba32-4394-8796-f5d0542bad6f {{(pid=87420) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 15:56:15 devstack cinder-volume[87420]: INFO cinder.image.image_utils [None req-d4a25549-a2b4-493f-885e-1a626bb21954 tempest-VolumesSnapshotTestJSON-1119395226 None] Converted 1024.00 MB image at 171.63 MB/s Jul 10 15:56:15 devstack cinder-volume[87420]: WARNING cinder.volume.drivers.remotefs [None req-d4a25549-a2b4-493f-885e-1a626bb21954 tempest-VolumesSnapshotTestJSON-1119395226 None] /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-c68b4234-ba32-4394-8796-f5d0542bad6f is being set with open permissions: ugo+rw Jul 10 15:56:15 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d4a25549-a2b4-493f-885e-1a626bb21954 tempest-VolumesSnapshotTestJSON-1119395226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-c68b4234-ba32-4394-8796-f5d0542bad6f {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:15 devstack sudo[96475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-c68b4234-ba32-4394-8796-f5d0542bad6f Jul 10 15:56:15 devstack sudo[96475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:16 devstack sudo[96475]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:16 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d4a25549-a2b4-493f-885e-1a626bb21954 tempest-VolumesSnapshotTestJSON-1119395226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-c68b4234-ba32-4394-8796-f5d0542bad6f" returned: 0 in 0.709s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:16 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-d4a25549-a2b4-493f-885e-1a626bb21954 tempest-VolumesSnapshotTestJSON-1119395226 None] Lock "cinder-quobyte-c68b4234-ba32-4394-8796-f5d0542bad6f" released by "_copy_volume_from_snapshot" :: held 9.667s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:56:16 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-d4a25549-a2b4-493f-885e-1a626bb21954 tempest-VolumesSnapshotTestJSON-1119395226 None] Lock "cinder-quobyte-aecab6b3-fd16-412b-be63-9a3ef90b2fab-c68b4234-ba32-4394-8796-f5d0542bad6f" released by "_create_volume_from_snapshot" :: held 9.725s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:56:16 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-d4a25549-a2b4-493f-885e-1a626bb21954 tempest-VolumesSnapshotTestJSON-1119395226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.768s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:56:16 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-c0cab77d-8118-4bf6-9bda-367fca8edca4 tempest-SnapshotsActionsTest-1918108303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.975s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:56:16 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-c0cab77d-8118-4bf6-9bda-367fca8edca4 tempest-SnapshotsActionsTest-1918108303 None] Creating offline snapshot 04b64570-a35a-4472-9f73-f425b6bccc9e of volume f2922929-98bb-4fec-bdd5-aad2d7870937 {{(pid=87420) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 15:56:16 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b919f7f-3fe6-4ab6-80a1-54d5222d266d]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:56:16 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c0cab77d-8118-4bf6-9bda-367fca8edca4 tempest-SnapshotsActionsTest-1918108303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:16 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d4a25549-a2b4-493f-885e-1a626bb21954 tempest-VolumesSnapshotTestJSON-1119395226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1134c57f-6fef-4caa-91a1-0b91feb6de88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c68b4234-ba32-4394-8796-f5d0542bad6f', 'volume_size': 2, 'snapshot_id': 'aecab6b3-fd16-412b-be63-9a3ef90b2fab'}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:56:16 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d4a25549-a2b4-493f-885e-1a626bb21954 tempest-VolumesSnapshotTestJSON-1119395226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b32e46e6-92d0-40b0-bdee-6fac20d42e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:56:16 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-d4a25549-a2b4-493f-885e-1a626bb21954 tempest-VolumesSnapshotTestJSON-1119395226 None] Volume volume-c68b4234-ba32-4394-8796-f5d0542bad6f (c68b4234-ba32-4394-8796-f5d0542bad6f): created successfully Jul 10 15:56:16 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d4a25549-a2b4-493f-885e-1a626bb21954 tempest-VolumesSnapshotTestJSON-1119395226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b32e46e6-92d0-40b0-bdee-6fac20d42e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:56:16 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d4a25549-a2b4-493f-885e-1a626bb21954 tempest-VolumesSnapshotTestJSON-1119395226 None] Flow 'volume_create_manager' (bc345fa7-4aa9-4ac3-8093-47ccac9e2b60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:56:16 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-d4a25549-a2b4-493f-885e-1a626bb21954 tempest-VolumesSnapshotTestJSON-1119395226 None] Created volume successfully. Jul 10 15:56:16 devstack sudo[96478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937 Jul 10 15:56:16 devstack sudo[96478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:17 devstack sudo[96478]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c0cab77d-8118-4bf6-9bda-367fca8edca4 tempest-SnapshotsActionsTest-1918108303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937" returned: 0 in 0.819s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c0cab77d-8118-4bf6-9bda-367fca8edca4 tempest-SnapshotsActionsTest-1918108303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.04b64570-a35a-4472-9f73-f425b6bccc9e 1G {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:17 devstack sudo[96484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.04b64570-a35a-4472-9f73-f425b6bccc9e 1G Jul 10 15:56:17 devstack sudo[96484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:17 devstack cinder-volume[87420]: DEBUG oslo_service.periodic_task [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87420) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 15:56:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:56:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:56:17 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:56:17 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:56:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:56:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:17 devstack sudo[96486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 15:56:17 devstack sudo[96486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:17 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-8a3da2fc-e1ef-41df-b4e1-c8651f2de0a3 tempest-VolumesSnapshotTestJSON-1119395226 None] Acquiring lock "cinder-c68b4234-ba32-4394-8796-f5d0542bad6f-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:56:17 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-8a3da2fc-e1ef-41df-b4e1-c8651f2de0a3 tempest-VolumesSnapshotTestJSON-1119395226 None] Lock "cinder-c68b4234-ba32-4394-8796-f5d0542bad6f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:56:17 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-8a3da2fc-e1ef-41df-b4e1-c8651f2de0a3 tempest-VolumesSnapshotTestJSON-1119395226 None] Acquiring lock "cinder-quobyte-c68b4234-ba32-4394-8796-f5d0542bad6f" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:56:17 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-8a3da2fc-e1ef-41df-b4e1-c8651f2de0a3 tempest-VolumesSnapshotTestJSON-1119395226 None] Lock "cinder-quobyte-c68b4234-ba32-4394-8796-f5d0542bad6f" acquired by "delete_volume" :: waited 0.021s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:56:17 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e356037-2115-4d36-a62b-2ca3e9c61c85]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:56:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8a3da2fc-e1ef-41df-b4e1-c8651f2de0a3 tempest-VolumesSnapshotTestJSON-1119395226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-c68b4234-ba32-4394-8796-f5d0542bad6f {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:17 devstack sudo[96488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-c68b4234-ba32-4394-8796-f5d0542bad6f Jul 10 15:56:17 devstack sudo[96488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:18 devstack sudo[96484]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c0cab77d-8118-4bf6-9bda-367fca8edca4 tempest-SnapshotsActionsTest-1918108303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.04b64570-a35a-4472-9f73-f425b6bccc9e 1G" returned: 0 in 1.008s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c0cab77d-8118-4bf6-9bda-367fca8edca4 tempest-SnapshotsActionsTest-1918108303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2922929-98bb-4fec-bdd5-aad2d7870937 -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.04b64570-a35a-4472-9f73-f425b6bccc9e {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:18 devstack sudo[96486]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.832s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:18 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 15:56:18 devstack cinder-volume[87420]: DEBUG oslo_service.periodic_task [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Running periodic task VolumeManager._thread_info {{(pid=87420) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 15:56:18 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] thread count: 28 {{(pid=87420) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 15:56:18 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] thread info: [<_MainThread(MainThread, started 133639250378880)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87420) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 15:56:18 devstack sudo[96495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2922929-98bb-4fec-bdd5-aad2d7870937 -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.04b64570-a35a-4472-9f73-f425b6bccc9e Jul 10 15:56:18 devstack sudo[96495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:18 devstack sudo[96488]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8a3da2fc-e1ef-41df-b4e1-c8651f2de0a3 tempest-VolumesSnapshotTestJSON-1119395226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-c68b4234-ba32-4394-8796-f5d0542bad6f" returned: 0 in 0.849s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8a3da2fc-e1ef-41df-b4e1-c8651f2de0a3 tempest-VolumesSnapshotTestJSON-1119395226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-c68b4234-ba32-4394-8796-f5d0542bad6f {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:18 devstack sudo[96500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-c68b4234-ba32-4394-8796-f5d0542bad6f Jul 10 15:56:18 devstack sudo[96500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:18 devstack sudo[96495]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c0cab77d-8118-4bf6-9bda-367fca8edca4 tempest-SnapshotsActionsTest-1918108303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2922929-98bb-4fec-bdd5-aad2d7870937 -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.04b64570-a35a-4472-9f73-f425b6bccc9e" returned: 0 in 0.741s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:18 devstack cinder-volume[87420]: WARNING cinder.volume.drivers.remotefs [None req-c0cab77d-8118-4bf6-9bda-367fca8edca4 tempest-SnapshotsActionsTest-1918108303 None] /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.04b64570-a35a-4472-9f73-f425b6bccc9e is being set with open permissions: ugo+rw Jul 10 15:56:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c0cab77d-8118-4bf6-9bda-367fca8edca4 tempest-SnapshotsActionsTest-1918108303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.04b64570-a35a-4472-9f73-f425b6bccc9e {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:18 devstack sudo[96505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.04b64570-a35a-4472-9f73-f425b6bccc9e Jul 10 15:56:18 devstack sudo[96505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:19 devstack sudo[96500]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:19 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8a3da2fc-e1ef-41df-b4e1-c8651f2de0a3 tempest-VolumesSnapshotTestJSON-1119395226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-c68b4234-ba32-4394-8796-f5d0542bad6f" returned: 0 in 0.721s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:19 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-8a3da2fc-e1ef-41df-b4e1-c8651f2de0a3 tempest-VolumesSnapshotTestJSON-1119395226 None] Lock "cinder-quobyte-c68b4234-ba32-4394-8796-f5d0542bad6f" released by "delete_volume" :: held 1.621s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:56:19 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-8a3da2fc-e1ef-41df-b4e1-c8651f2de0a3 tempest-VolumesSnapshotTestJSON-1119395226 None] Created reservations ['50b26e82-e833-40fe-90ec-c30b400295dd', 'e4d3a8bb-8917-46d7-a79d-45c191e82e8b', 'bc028609-2e3c-4fe2-90e7-df5a82cfec2b', 'b040c6e0-e266-4187-aa05-171e316b3859'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 15:56:19 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-8a3da2fc-e1ef-41df-b4e1-c8651f2de0a3 tempest-VolumesSnapshotTestJSON-1119395226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:56:19 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-8a3da2fc-e1ef-41df-b4e1-c8651f2de0a3 tempest-VolumesSnapshotTestJSON-1119395226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:56:19 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-8a3da2fc-e1ef-41df-b4e1-c8651f2de0a3 tempest-VolumesSnapshotTestJSON-1119395226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:56:19 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-8a3da2fc-e1ef-41df-b4e1-c8651f2de0a3 tempest-VolumesSnapshotTestJSON-1119395226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:56:19 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-8a3da2fc-e1ef-41df-b4e1-c8651f2de0a3 tempest-VolumesSnapshotTestJSON-1119395226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:56:19 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8a3da2fc-e1ef-41df-b4e1-c8651f2de0a3 tempest-VolumesSnapshotTestJSON-1119395226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:19 devstack sudo[96508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 15:56:19 devstack sudo[96508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:19 devstack sudo[96505]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:19 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c0cab77d-8118-4bf6-9bda-367fca8edca4 tempest-SnapshotsActionsTest-1918108303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.04b64570-a35a-4472-9f73-f425b6bccc9e" returned: 0 in 0.667s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:19 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c0cab77d-8118-4bf6-9bda-367fca8edca4 tempest-SnapshotsActionsTest-1918108303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.info {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:19 devstack sudo[96511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.info Jul 10 15:56:19 devstack sudo[96511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:19 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-836a300d-c709-4c5d-95d0-d9999bbc32cc tempest-VolumesSnapshotTestJSON-1119395226 None] Acquiring lock "cinder-aecab6b3-fd16-412b-be63-9a3ef90b2fab-delete_snapshot" by "delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:56:19 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-836a300d-c709-4c5d-95d0-d9999bbc32cc tempest-VolumesSnapshotTestJSON-1119395226 None] Lock "cinder-aecab6b3-fd16-412b-be63-9a3ef90b2fab-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:56:19 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-836a300d-c709-4c5d-95d0-d9999bbc32cc tempest-VolumesSnapshotTestJSON-1119395226 None] Acquiring lock "cinder-quobyte-b6cdcfe2-82af-4376-8cbd-cc7c1c38ce26" by "delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:56:20 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-836a300d-c709-4c5d-95d0-d9999bbc32cc tempest-VolumesSnapshotTestJSON-1119395226 None] Lock "cinder-quobyte-b6cdcfe2-82af-4376-8cbd-cc7c1c38ce26" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:56:20 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-836a300d-c709-4c5d-95d0-d9999bbc32cc tempest-VolumesSnapshotTestJSON-1119395226 None] Acquiring lock "cinder-quobyte-aecab6b3-fd16-412b-be63-9a3ef90b2fab" by "_delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:56:20 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-836a300d-c709-4c5d-95d0-d9999bbc32cc tempest-VolumesSnapshotTestJSON-1119395226 None] Lock "cinder-quobyte-aecab6b3-fd16-412b-be63-9a3ef90b2fab" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:56:20 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-836a300d-c709-4c5d-95d0-d9999bbc32cc tempest-VolumesSnapshotTestJSON-1119395226 None] Deleting offline snapshot aecab6b3-fd16-412b-be63-9a3ef90b2fab of volume b6cdcfe2-82af-4376-8cbd-cc7c1c38ce26 {{(pid=87420) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 15:56:20 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-836a300d-c709-4c5d-95d0-d9999bbc32cc tempest-VolumesSnapshotTestJSON-1119395226 None] snapshot_file for this snap is: volume-b6cdcfe2-82af-4376-8cbd-cc7c1c38ce26.aecab6b3-fd16-412b-be63-9a3ef90b2fab {{(pid=87420) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 15:56:20 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[efa528b0-c269-495b-913f-9b7ccb1aabd4]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:56:20 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-836a300d-c709-4c5d-95d0-d9999bbc32cc tempest-VolumesSnapshotTestJSON-1119395226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b6cdcfe2-82af-4376-8cbd-cc7c1c38ce26.aecab6b3-fd16-412b-be63-9a3ef90b2fab {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:20 devstack sudo[96508]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:20 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8a3da2fc-e1ef-41df-b4e1-c8651f2de0a3 tempest-VolumesSnapshotTestJSON-1119395226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.739s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:20 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-8a3da2fc-e1ef-41df-b4e1-c8651f2de0a3 tempest-VolumesSnapshotTestJSON-1119395226 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 15:56:20 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-8a3da2fc-e1ef-41df-b4e1-c8651f2de0a3 tempest-VolumesSnapshotTestJSON-1119395226 None] Deleted volume successfully. Jul 10 15:56:20 devstack sudo[96514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b6cdcfe2-82af-4376-8cbd-cc7c1c38ce26.aecab6b3-fd16-412b-be63-9a3ef90b2fab Jul 10 15:56:20 devstack sudo[96514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:20 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-8a3da2fc-e1ef-41df-b4e1-c8651f2de0a3 tempest-VolumesSnapshotTestJSON-1119395226 None] Lock "cinder-c68b4234-ba32-4394-8796-f5d0542bad6f-delete_volume" released by "delete_volume" :: held 2.649s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:56:20 devstack sudo[96511]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:20 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c0cab77d-8118-4bf6-9bda-367fca8edca4 tempest-SnapshotsActionsTest-1918108303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.info" returned: 0 in 0.804s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:20 devstack cinder-volume[87420]: WARNING cinder.volume.drivers.remotefs [None req-c0cab77d-8118-4bf6-9bda-367fca8edca4 tempest-SnapshotsActionsTest-1918108303 None] /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.info is being set with open permissions: ugo+rw Jul 10 15:56:20 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c0cab77d-8118-4bf6-9bda-367fca8edca4 tempest-SnapshotsActionsTest-1918108303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.info {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:20 devstack sudo[96517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.info Jul 10 15:56:20 devstack sudo[96517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:20 devstack sudo[96514]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:20 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-836a300d-c709-4c5d-95d0-d9999bbc32cc tempest-VolumesSnapshotTestJSON-1119395226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b6cdcfe2-82af-4376-8cbd-cc7c1c38ce26.aecab6b3-fd16-412b-be63-9a3ef90b2fab" returned: 0 in 0.863s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:20 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-836a300d-c709-4c5d-95d0-d9999bbc32cc tempest-VolumesSnapshotTestJSON-1119395226 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6cdcfe2-82af-4376-8cbd-cc7c1c38ce26(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87420) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 15:56:20 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d635f40-bff8-4734-9416-50dc3e468a2c]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:56:20 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-836a300d-c709-4c5d-95d0-d9999bbc32cc tempest-VolumesSnapshotTestJSON-1119395226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b6cdcfe2-82af-4376-8cbd-cc7c1c38ce26 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:21 devstack sudo[96525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b6cdcfe2-82af-4376-8cbd-cc7c1c38ce26 Jul 10 15:56:21 devstack sudo[96525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:21 devstack sudo[96517]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:21 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c0cab77d-8118-4bf6-9bda-367fca8edca4 tempest-SnapshotsActionsTest-1918108303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.info" returned: 0 in 0.729s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:21 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-c0cab77d-8118-4bf6-9bda-367fca8edca4 tempest-SnapshotsActionsTest-1918108303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.872s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:56:21 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-73d8a73f-66df-4e12-aa1c-8c5cb582ee1e tempest-VolumesImageMetadata-843895676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.072s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:56:21 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-73d8a73f-66df-4e12-aa1c-8c5cb582ee1e tempest-VolumesImageMetadata-843895676 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:56:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2015581467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab176fcf-d540-47c8-8e14-5d225ef6515e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e237c8d0db84eaa9135b2ee0935baff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:56:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:56:10Z,use_quota=True,user_id='e14e0a3b70f84a1b83ba205a69e71196',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 15:56:21 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-73d8a73f-66df-4e12-aa1c-8c5cb582ee1e tempest-VolumesImageMetadata-843895676 None] Creating volume ab176fcf-d540-47c8-8e14-5d225ef6515e {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 15:56:21 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-73d8a73f-66df-4e12-aa1c-8c5cb582ee1e tempest-VolumesImageMetadata-843895676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:56:21 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-73d8a73f-66df-4e12-aa1c-8c5cb582ee1e tempest-VolumesImageMetadata-843895676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:56:21 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-73d8a73f-66df-4e12-aa1c-8c5cb582ee1e tempest-VolumesImageMetadata-843895676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:56:21 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-73d8a73f-66df-4e12-aa1c-8c5cb582ee1e tempest-VolumesImageMetadata-843895676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:56:21 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-73d8a73f-66df-4e12-aa1c-8c5cb582ee1e tempest-VolumesImageMetadata-843895676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:56:21 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-73d8a73f-66df-4e12-aa1c-8c5cb582ee1e tempest-VolumesImageMetadata-843895676 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 15:56:21 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-73d8a73f-66df-4e12-aa1c-8c5cb582ee1e tempest-VolumesImageMetadata-843895676 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 15:56:21 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-73d8a73f-66df-4e12-aa1c-8c5cb582ee1e tempest-VolumesImageMetadata-843895676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ab176fcf-d540-47c8-8e14-5d225ef6515e 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:21 devstack sudo[96528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ab176fcf-d540-47c8-8e14-5d225ef6515e 1073741824 Jul 10 15:56:21 devstack sudo[96528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:21 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-c0cab77d-8118-4bf6-9bda-367fca8edca4 tempest-SnapshotsActionsTest-1918108303 None] Create snapshot completed successfully Jul 10 15:56:21 devstack sudo[96525]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:21 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-836a300d-c709-4c5d-95d0-d9999bbc32cc tempest-VolumesSnapshotTestJSON-1119395226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b6cdcfe2-82af-4376-8cbd-cc7c1c38ce26" returned: 0 in 0.819s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:21 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-836a300d-c709-4c5d-95d0-d9999bbc32cc tempest-VolumesSnapshotTestJSON-1119395226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b6cdcfe2-82af-4376-8cbd-cc7c1c38ce26.aecab6b3-fd16-412b-be63-9a3ef90b2fab {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:21 devstack sudo[96534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b6cdcfe2-82af-4376-8cbd-cc7c1c38ce26.aecab6b3-fd16-412b-be63-9a3ef90b2fab Jul 10 15:56:21 devstack sudo[96534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:21 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-a083018d-6bb4-4d9b-bb30-4143be9c70e3 tempest-VolumeQuotasAdminTestJSON-1318972926 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 15:56:22 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-a083018d-6bb4-4d9b-bb30-4143be9c70e3 tempest-VolumeQuotasAdminTestJSON-1318972926 None] Flow 'volume_create_manager' (299b2f59-09d0-4dd0-812e-6043f0e143c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:56:22 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-a083018d-6bb4-4d9b-bb30-4143be9c70e3 tempest-VolumeQuotasAdminTestJSON-1318972926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3bce6a2-2044-423f-964f-1d5564adcd8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:56:22 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-a083018d-6bb4-4d9b-bb30-4143be9c70e3 tempest-VolumeQuotasAdminTestJSON-1318972926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3bce6a2-2044-423f-964f-1d5564adcd8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:56:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1509900568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=032e69b1-4936-46e5-84aa-e165563f8181,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09c3a36ea75441ba8f3c75f61d110b98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:56:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:56:22Z,use_quota=True,user_id='a8add1071767419ba9a64983e85627a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:56:22 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-a083018d-6bb4-4d9b-bb30-4143be9c70e3 tempest-VolumeQuotasAdminTestJSON-1318972926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db1761a3-dd7e-49b5-9990-636ad842cadd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:56:22 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-a083018d-6bb4-4d9b-bb30-4143be9c70e3 tempest-VolumeQuotasAdminTestJSON-1318972926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db1761a3-dd7e-49b5-9990-636ad842cadd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:56:22 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-a083018d-6bb4-4d9b-bb30-4143be9c70e3 tempest-VolumeQuotasAdminTestJSON-1318972926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9641764-a812-48d9-bee7-6f3db6d53239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:56:22 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-a083018d-6bb4-4d9b-bb30-4143be9c70e3 tempest-VolumeQuotasAdminTestJSON-1318972926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9641764-a812-48d9-bee7-6f3db6d53239) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '032e69b1-4936-46e5-84aa-e165563f8181', 'volume_name': 'volume-032e69b1-4936-46e5-84aa-e165563f8181', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:56:22 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-a083018d-6bb4-4d9b-bb30-4143be9c70e3 tempest-VolumeQuotasAdminTestJSON-1318972926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3eb91cab-6da1-42e5-80a8-40e76f02c0db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:56:22 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-a083018d-6bb4-4d9b-bb30-4143be9c70e3 tempest-VolumeQuotasAdminTestJSON-1318972926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3eb91cab-6da1-42e5-80a8-40e76f02c0db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:56:22 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-a083018d-6bb4-4d9b-bb30-4143be9c70e3 tempest-VolumeQuotasAdminTestJSON-1318972926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71613ffe-6239-4d96-8e9e-4cb823a3dab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:56:22 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-a083018d-6bb4-4d9b-bb30-4143be9c70e3 tempest-VolumeQuotasAdminTestJSON-1318972926 None] Volume 032e69b1-4936-46e5-84aa-e165563f8181: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-032e69b1-4936-46e5-84aa-e165563f8181', 'volume_size': 1} Jul 10 15:56:22 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-a083018d-6bb4-4d9b-bb30-4143be9c70e3 tempest-VolumeQuotasAdminTestJSON-1318972926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:56:22 devstack sudo[96528]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:22 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-73d8a73f-66df-4e12-aa1c-8c5cb582ee1e tempest-VolumesImageMetadata-843895676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ab176fcf-d540-47c8-8e14-5d225ef6515e 1073741824" returned: 0 in 0.949s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:22 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-73d8a73f-66df-4e12-aa1c-8c5cb582ee1e tempest-VolumesImageMetadata-843895676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ab176fcf-d540-47c8-8e14-5d225ef6515e {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:22 devstack sudo[96540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ab176fcf-d540-47c8-8e14-5d225ef6515e Jul 10 15:56:22 devstack sudo[96540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:22 devstack sudo[96534]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:22 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-836a300d-c709-4c5d-95d0-d9999bbc32cc tempest-VolumesSnapshotTestJSON-1119395226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b6cdcfe2-82af-4376-8cbd-cc7c1c38ce26.aecab6b3-fd16-412b-be63-9a3ef90b2fab" returned: 0 in 0.858s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:22 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-836a300d-c709-4c5d-95d0-d9999bbc32cc tempest-VolumesSnapshotTestJSON-1119395226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b6cdcfe2-82af-4376-8cbd-cc7c1c38ce26.aecab6b3-fd16-412b-be63-9a3ef90b2fab {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:22 devstack sudo[96546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b6cdcfe2-82af-4376-8cbd-cc7c1c38ce26.aecab6b3-fd16-412b-be63-9a3ef90b2fab Jul 10 15:56:22 devstack sudo[96546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:22 devstack cinder-volume[87420]: DEBUG dbcounter [-] [87420] Writing DB stats cinder:SELECT=95,cinder:INSERT=23,cinder:UPDATE=113,cinder:DELETE=5 {{(pid=87420) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 15:56:22 devstack cinder-volume[87420]: DEBUG dbcounter [-] [87420] Writing DB stats cinder:SELECT=110,cinder:INSERT=29,cinder:UPDATE=96,cinder:DELETE=13 {{(pid=87420) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 15:56:22 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-989bb548-6115-40c9-a216-e94b143f3a31 tempest-SnapshotsActionsTest-1918108303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:56:22 devstack sudo[96540]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:22 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-73d8a73f-66df-4e12-aa1c-8c5cb582ee1e tempest-VolumesImageMetadata-843895676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ab176fcf-d540-47c8-8e14-5d225ef6515e" returned: 0 in 0.767s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:22 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-73d8a73f-66df-4e12-aa1c-8c5cb582ee1e tempest-VolumesImageMetadata-843895676 None] <== create_volume: return (1766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 15:56:22 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-73d8a73f-66df-4e12-aa1c-8c5cb582ee1e tempest-VolumesImageMetadata-843895676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.769s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:56:22 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-a083018d-6bb4-4d9b-bb30-4143be9c70e3 tempest-VolumeQuotasAdminTestJSON-1318972926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.901s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:56:22 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-a083018d-6bb4-4d9b-bb30-4143be9c70e3 tempest-VolumeQuotasAdminTestJSON-1318972926 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:56:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1509900568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=032e69b1-4936-46e5-84aa-e165563f8181,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09c3a36ea75441ba8f3c75f61d110b98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:56:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:56:22Z,use_quota=True,user_id='a8add1071767419ba9a64983e85627a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 15:56:22 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-a083018d-6bb4-4d9b-bb30-4143be9c70e3 tempest-VolumeQuotasAdminTestJSON-1318972926 None] Creating volume 032e69b1-4936-46e5-84aa-e165563f8181 {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 15:56:22 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-a083018d-6bb4-4d9b-bb30-4143be9c70e3 tempest-VolumeQuotasAdminTestJSON-1318972926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:56:22 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-a083018d-6bb4-4d9b-bb30-4143be9c70e3 tempest-VolumeQuotasAdminTestJSON-1318972926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:56:22 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-a083018d-6bb4-4d9b-bb30-4143be9c70e3 tempest-VolumeQuotasAdminTestJSON-1318972926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:56:22 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-a083018d-6bb4-4d9b-bb30-4143be9c70e3 tempest-VolumeQuotasAdminTestJSON-1318972926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:56:22 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-a083018d-6bb4-4d9b-bb30-4143be9c70e3 tempest-VolumeQuotasAdminTestJSON-1318972926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:56:22 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-a083018d-6bb4-4d9b-bb30-4143be9c70e3 tempest-VolumeQuotasAdminTestJSON-1318972926 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 15:56:22 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-a083018d-6bb4-4d9b-bb30-4143be9c70e3 tempest-VolumeQuotasAdminTestJSON-1318972926 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 15:56:22 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a083018d-6bb4-4d9b-bb30-4143be9c70e3 tempest-VolumeQuotasAdminTestJSON-1318972926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-032e69b1-4936-46e5-84aa-e165563f8181 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:23 devstack sudo[96550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-032e69b1-4936-46e5-84aa-e165563f8181 1073741824 Jul 10 15:56:23 devstack sudo[96550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:23 devstack cinder-volume[87420]: DEBUG cinder.volume.volume_utils [None req-73d8a73f-66df-4e12-aa1c-8c5cb582ee1e tempest-VolumesImageMetadata-843895676 None] Attempting download of 980bf5e0-e973-48f3-bc1f-383f924c4467 ((None, [{'url': 'file:///opt/stack/data/glance/images/980bf5e0-e973-48f3-bc1f-383f924c4467', 'metadata': {}}])) to volume ab176fcf-d540-47c8-8e14-5d225ef6515e. {{(pid=87420) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 10 15:56:23 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[85d65b69-048a-4dc7-8f8f-91f45f8295d2]: (4, 'raw') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:56:23 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-73d8a73f-66df-4e12-aa1c-8c5cb582ee1e tempest-VolumesImageMetadata-843895676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_980bf5e0-e973-48f3-bc1f-383f924c4467_v2gqsapc {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:23 devstack sudo[96552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_980bf5e0-e973-48f3-bc1f-383f924c4467_v2gqsapc Jul 10 15:56:23 devstack sudo[96552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:23 devstack sudo[96546]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:23 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-836a300d-c709-4c5d-95d0-d9999bbc32cc tempest-VolumesSnapshotTestJSON-1119395226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b6cdcfe2-82af-4376-8cbd-cc7c1c38ce26.aecab6b3-fd16-412b-be63-9a3ef90b2fab" returned: 0 in 0.733s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:23 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-836a300d-c709-4c5d-95d0-d9999bbc32cc tempest-VolumesSnapshotTestJSON-1119395226 None] Lock "cinder-quobyte-aecab6b3-fd16-412b-be63-9a3ef90b2fab" released by "_delete_snapshot" :: held 3.413s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:56:23 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-836a300d-c709-4c5d-95d0-d9999bbc32cc tempest-VolumesSnapshotTestJSON-1119395226 None] Lock "cinder-quobyte-b6cdcfe2-82af-4376-8cbd-cc7c1c38ce26" released by "delete_snapshot" :: held 3.451s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:56:23 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-836a300d-c709-4c5d-95d0-d9999bbc32cc tempest-VolumesSnapshotTestJSON-1119395226 None] Created reservations ['6be74d70-a4fb-4ef7-89ee-1159384c249f', 'c9a52751-c88e-46e1-8f30-559c83f7beea', 'b45d488b-55e6-4efd-908f-158278c6e3a6', 'b43f10e5-ca81-45a8-920f-f4c2dc11a8b7'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 15:56:23 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-836a300d-c709-4c5d-95d0-d9999bbc32cc tempest-VolumesSnapshotTestJSON-1119395226 None] Delete snapshot completed successfully. Jul 10 15:56:23 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-836a300d-c709-4c5d-95d0-d9999bbc32cc tempest-VolumesSnapshotTestJSON-1119395226 None] Lock "cinder-aecab6b3-fd16-412b-be63-9a3ef90b2fab-delete_snapshot" released by "delete_snapshot" :: held 3.604s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:56:23 devstack sudo[96550]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:23 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a083018d-6bb4-4d9b-bb30-4143be9c70e3 tempest-VolumeQuotasAdminTestJSON-1318972926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-032e69b1-4936-46e5-84aa-e165563f8181 1073741824" returned: 0 in 0.860s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:23 devstack sudo[96552]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:23 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a083018d-6bb4-4d9b-bb30-4143be9c70e3 tempest-VolumeQuotasAdminTestJSON-1318972926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-032e69b1-4936-46e5-84aa-e165563f8181 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:23 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-73d8a73f-66df-4e12-aa1c-8c5cb582ee1e tempest-VolumesImageMetadata-843895676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_980bf5e0-e973-48f3-bc1f-383f924c4467_v2gqsapc" returned: 0 in 0.790s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:23 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-73d8a73f-66df-4e12-aa1c-8c5cb582ee1e tempest-VolumesImageMetadata-843895676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_980bf5e0-e973-48f3-bc1f-383f924c4467_v2gqsapc {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:23 devstack sudo[96560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-032e69b1-4936-46e5-84aa-e165563f8181 Jul 10 15:56:23 devstack sudo[96560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:24 devstack sudo[96561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_980bf5e0-e973-48f3-bc1f-383f924c4467_v2gqsapc Jul 10 15:56:24 devstack sudo[96561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:24 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-47cb3c7e-cf31-4091-b2da-7acfbb825f24 tempest-VolumesSnapshotTestJSON-1119395226 None] Acquiring lock "cinder-b6cdcfe2-82af-4376-8cbd-cc7c1c38ce26-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:56:24 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-47cb3c7e-cf31-4091-b2da-7acfbb825f24 tempest-VolumesSnapshotTestJSON-1119395226 None] Lock "cinder-b6cdcfe2-82af-4376-8cbd-cc7c1c38ce26-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:56:24 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-47cb3c7e-cf31-4091-b2da-7acfbb825f24 tempest-VolumesSnapshotTestJSON-1119395226 None] Acquiring lock "cinder-quobyte-b6cdcfe2-82af-4376-8cbd-cc7c1c38ce26" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:56:24 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-47cb3c7e-cf31-4091-b2da-7acfbb825f24 tempest-VolumesSnapshotTestJSON-1119395226 None] Lock "cinder-quobyte-b6cdcfe2-82af-4376-8cbd-cc7c1c38ce26" acquired by "delete_volume" :: waited 0.031s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:56:24 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[7031ccef-4bfd-4abb-998b-a8d0b4451fcb]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:56:24 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-47cb3c7e-cf31-4091-b2da-7acfbb825f24 tempest-VolumesSnapshotTestJSON-1119395226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b6cdcfe2-82af-4376-8cbd-cc7c1c38ce26 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:24 devstack sudo[96566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b6cdcfe2-82af-4376-8cbd-cc7c1c38ce26 Jul 10 15:56:24 devstack sudo[96566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:24 devstack sudo[96560]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:24 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a083018d-6bb4-4d9b-bb30-4143be9c70e3 tempest-VolumeQuotasAdminTestJSON-1318972926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-032e69b1-4936-46e5-84aa-e165563f8181" returned: 0 in 0.715s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:24 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-a083018d-6bb4-4d9b-bb30-4143be9c70e3 tempest-VolumeQuotasAdminTestJSON-1318972926 None] <== create_volume: return (1615ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 15:56:24 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-a083018d-6bb4-4d9b-bb30-4143be9c70e3 tempest-VolumeQuotasAdminTestJSON-1318972926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.619s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:56:24 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-989bb548-6115-40c9-a216-e94b143f3a31 tempest-SnapshotsActionsTest-1918108303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.793s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:56:24 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-a083018d-6bb4-4d9b-bb30-4143be9c70e3 tempest-VolumeQuotasAdminTestJSON-1318972926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71613ffe-6239-4d96-8e9e-4cb823a3dab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-032e69b1-4936-46e5-84aa-e165563f8181', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:56:24 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-a083018d-6bb4-4d9b-bb30-4143be9c70e3 tempest-VolumeQuotasAdminTestJSON-1318972926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0c5c4ad-74bc-4d89-8792-d4877471c079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:56:24 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-989bb548-6115-40c9-a216-e94b143f3a31 tempest-SnapshotsActionsTest-1918108303 None] Creating offline snapshot 5d42a5b2-5673-4169-8e1f-11cf60d2bbdb of volume f2922929-98bb-4fec-bdd5-aad2d7870937 {{(pid=87420) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 15:56:24 devstack sudo[96561]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:24 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-73d8a73f-66df-4e12-aa1c-8c5cb582ee1e tempest-VolumesImageMetadata-843895676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_980bf5e0-e973-48f3-bc1f-383f924c4467_v2gqsapc" returned: 1 in 0.776s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:24 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-73d8a73f-66df-4e12-aa1c-8c5cb582ee1e tempest-VolumesImageMetadata-843895676 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_980bf5e0-e973-48f3-bc1f-383f924c4467_v2gqsapc' failed. Not Retrying. {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 15:56:24 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[43bfdfd8-af91-47b6-94b5-64e13a2dc789]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:56:24 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-73d8a73f-66df-4e12-aa1c-8c5cb582ee1e tempest-VolumesImageMetadata-843895676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_980bf5e0-e973-48f3-bc1f-383f924c4467__23hmr89devstack@QuobyteHD {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:24 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a88bbfe-af69-4f61-9eeb-baa814a1b945]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:56:24 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-989bb548-6115-40c9-a216-e94b143f3a31 tempest-SnapshotsActionsTest-1918108303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.04b64570-a35a-4472-9f73-f425b6bccc9e {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:24 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-a083018d-6bb4-4d9b-bb30-4143be9c70e3 tempest-VolumeQuotasAdminTestJSON-1318972926 None] Volume volume-032e69b1-4936-46e5-84aa-e165563f8181 (032e69b1-4936-46e5-84aa-e165563f8181): created successfully Jul 10 15:56:24 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-a083018d-6bb4-4d9b-bb30-4143be9c70e3 tempest-VolumeQuotasAdminTestJSON-1318972926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0c5c4ad-74bc-4d89-8792-d4877471c079) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:56:24 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-a083018d-6bb4-4d9b-bb30-4143be9c70e3 tempest-VolumeQuotasAdminTestJSON-1318972926 None] Flow 'volume_create_manager' (299b2f59-09d0-4dd0-812e-6043f0e143c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:56:24 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-a083018d-6bb4-4d9b-bb30-4143be9c70e3 tempest-VolumeQuotasAdminTestJSON-1318972926 None] Created volume successfully. Jul 10 15:56:24 devstack sudo[96571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_980bf5e0-e973-48f3-bc1f-383f924c4467__23hmr89devstack@QuobyteHD Jul 10 15:56:24 devstack sudo[96571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:24 devstack sudo[96572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.04b64570-a35a-4472-9f73-f425b6bccc9e Jul 10 15:56:24 devstack sudo[96572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:25 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-be1dd9b8-c635-4072-9d64-dfba6c6a22cb tempest-VolumeQuotasAdminTestJSON-1318972926 None] Acquiring lock "cinder-032e69b1-4936-46e5-84aa-e165563f8181-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:56:25 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-be1dd9b8-c635-4072-9d64-dfba6c6a22cb tempest-VolumeQuotasAdminTestJSON-1318972926 None] Lock "cinder-032e69b1-4936-46e5-84aa-e165563f8181-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:56:25 devstack sudo[96566]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:25 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-47cb3c7e-cf31-4091-b2da-7acfbb825f24 tempest-VolumesSnapshotTestJSON-1119395226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b6cdcfe2-82af-4376-8cbd-cc7c1c38ce26" returned: 0 in 0.872s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:25 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-47cb3c7e-cf31-4091-b2da-7acfbb825f24 tempest-VolumesSnapshotTestJSON-1119395226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b6cdcfe2-82af-4376-8cbd-cc7c1c38ce26 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:25 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-be1dd9b8-c635-4072-9d64-dfba6c6a22cb tempest-VolumeQuotasAdminTestJSON-1318972926 None] Acquiring lock "cinder-quobyte-032e69b1-4936-46e5-84aa-e165563f8181" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:56:25 devstack sudo[96578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b6cdcfe2-82af-4376-8cbd-cc7c1c38ce26 Jul 10 15:56:25 devstack sudo[96578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:25 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-be1dd9b8-c635-4072-9d64-dfba6c6a22cb tempest-VolumeQuotasAdminTestJSON-1318972926 None] Lock "cinder-quobyte-032e69b1-4936-46e5-84aa-e165563f8181" acquired by "delete_volume" :: waited 0.022s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:56:25 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[b36bbab4-841c-4240-b1b8-9e602202a993]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:56:25 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-be1dd9b8-c635-4072-9d64-dfba6c6a22cb tempest-VolumeQuotasAdminTestJSON-1318972926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-032e69b1-4936-46e5-84aa-e165563f8181 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:25 devstack sudo[96586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-032e69b1-4936-46e5-84aa-e165563f8181 Jul 10 15:56:25 devstack sudo[96586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:25 devstack sudo[96571]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:25 devstack sudo[96572]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:25 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-73d8a73f-66df-4e12-aa1c-8c5cb582ee1e tempest-VolumesImageMetadata-843895676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_980bf5e0-e973-48f3-bc1f-383f924c4467__23hmr89devstack@QuobyteHD" returned: 0 in 0.886s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:25 devstack cinder-volume[87420]: DEBUG cinder.image.image_utils [None req-73d8a73f-66df-4e12-aa1c-8c5cb582ee1e tempest-VolumesImageMetadata-843895676 None] 980bf5e0-e973-48f3-bc1f-383f924c4467 was qcow2, converting to raw {{(pid=87420) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 10 15:56:25 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-73d8a73f-66df-4e12-aa1c-8c5cb582ee1e tempest-VolumesImageMetadata-843895676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_980bf5e0-e973-48f3-bc1f-383f924c4467__23hmr89devstack@QuobyteHD /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ab176fcf-d540-47c8-8e14-5d225ef6515e {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:25 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-989bb548-6115-40c9-a216-e94b143f3a31 tempest-SnapshotsActionsTest-1918108303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.04b64570-a35a-4472-9f73-f425b6bccc9e" returned: 0 in 0.890s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:25 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-989bb548-6115-40c9-a216-e94b143f3a31 tempest-SnapshotsActionsTest-1918108303 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f2922929-98bb-4fec-bdd5-aad2d7870937(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87420) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 15:56:25 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-989bb548-6115-40c9-a216-e94b143f3a31 tempest-SnapshotsActionsTest-1918108303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.04b64570-a35a-4472-9f73-f425b6bccc9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.5d42a5b2-5673-4169-8e1f-11cf60d2bbdb 1G {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:25 devstack sudo[96588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_980bf5e0-e973-48f3-bc1f-383f924c4467__23hmr89devstack@QuobyteHD /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ab176fcf-d540-47c8-8e14-5d225ef6515e Jul 10 15:56:25 devstack sudo[96588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:25 devstack sudo[96589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.04b64570-a35a-4472-9f73-f425b6bccc9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.5d42a5b2-5673-4169-8e1f-11cf60d2bbdb 1G Jul 10 15:56:25 devstack sudo[96589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:26 devstack sudo[96578]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:26 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-47cb3c7e-cf31-4091-b2da-7acfbb825f24 tempest-VolumesSnapshotTestJSON-1119395226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b6cdcfe2-82af-4376-8cbd-cc7c1c38ce26" returned: 0 in 0.731s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:26 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-47cb3c7e-cf31-4091-b2da-7acfbb825f24 tempest-VolumesSnapshotTestJSON-1119395226 None] Lock "cinder-quobyte-b6cdcfe2-82af-4376-8cbd-cc7c1c38ce26" released by "delete_volume" :: held 1.687s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:56:26 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-47cb3c7e-cf31-4091-b2da-7acfbb825f24 tempest-VolumesSnapshotTestJSON-1119395226 None] Created reservations ['d70c22b8-a39d-4d01-857c-22b1005138e9', '113b1eae-2ffb-47ef-ae8f-eb746c04b047', '8b37d7c8-bf6c-4537-927b-7a6a45848ff7', 'cccdd04a-6249-4ca4-ada8-3715b5d8e3bb'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 15:56:26 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-47cb3c7e-cf31-4091-b2da-7acfbb825f24 tempest-VolumesSnapshotTestJSON-1119395226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:56:26 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-47cb3c7e-cf31-4091-b2da-7acfbb825f24 tempest-VolumesSnapshotTestJSON-1119395226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:56:26 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-47cb3c7e-cf31-4091-b2da-7acfbb825f24 tempest-VolumesSnapshotTestJSON-1119395226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:56:26 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-47cb3c7e-cf31-4091-b2da-7acfbb825f24 tempest-VolumesSnapshotTestJSON-1119395226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:56:26 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-47cb3c7e-cf31-4091-b2da-7acfbb825f24 tempest-VolumesSnapshotTestJSON-1119395226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:56:26 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-47cb3c7e-cf31-4091-b2da-7acfbb825f24 tempest-VolumesSnapshotTestJSON-1119395226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:26 devstack sudo[96601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 15:56:26 devstack sudo[96601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:26 devstack sudo[96586]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:26 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-be1dd9b8-c635-4072-9d64-dfba6c6a22cb tempest-VolumeQuotasAdminTestJSON-1318972926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-032e69b1-4936-46e5-84aa-e165563f8181" returned: 0 in 0.894s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:26 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-be1dd9b8-c635-4072-9d64-dfba6c6a22cb tempest-VolumeQuotasAdminTestJSON-1318972926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-032e69b1-4936-46e5-84aa-e165563f8181 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:26 devstack sudo[96607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-032e69b1-4936-46e5-84aa-e165563f8181 Jul 10 15:56:26 devstack sudo[96607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:26 devstack sudo[96589]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:26 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-989bb548-6115-40c9-a216-e94b143f3a31 tempest-SnapshotsActionsTest-1918108303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.04b64570-a35a-4472-9f73-f425b6bccc9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.5d42a5b2-5673-4169-8e1f-11cf60d2bbdb 1G" returned: 0 in 1.021s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:26 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-989bb548-6115-40c9-a216-e94b143f3a31 tempest-SnapshotsActionsTest-1918108303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2922929-98bb-4fec-bdd5-aad2d7870937.04b64570-a35a-4472-9f73-f425b6bccc9e -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.5d42a5b2-5673-4169-8e1f-11cf60d2bbdb {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:26 devstack sudo[96610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2922929-98bb-4fec-bdd5-aad2d7870937.04b64570-a35a-4472-9f73-f425b6bccc9e -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.5d42a5b2-5673-4169-8e1f-11cf60d2bbdb Jul 10 15:56:26 devstack sudo[96610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:27 devstack sudo[96601]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:27 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-47cb3c7e-cf31-4091-b2da-7acfbb825f24 tempest-VolumesSnapshotTestJSON-1119395226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.882s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:27 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-47cb3c7e-cf31-4091-b2da-7acfbb825f24 tempest-VolumesSnapshotTestJSON-1119395226 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 15:56:27 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-47cb3c7e-cf31-4091-b2da-7acfbb825f24 tempest-VolumesSnapshotTestJSON-1119395226 None] Deleted volume successfully. Jul 10 15:56:27 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-47cb3c7e-cf31-4091-b2da-7acfbb825f24 tempest-VolumesSnapshotTestJSON-1119395226 None] Lock "cinder-b6cdcfe2-82af-4376-8cbd-cc7c1c38ce26-delete_volume" released by "delete_volume" :: held 2.866s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:56:27 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f498722-aef6-4d71-b1bb-4810538887e1 tempest-VolumesSnapshotTestJSON-1119395226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 15:56:27 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6f498722-aef6-4d71-b1bb-4810538887e1 tempest-VolumesSnapshotTestJSON-1119395226 None] Flow 'volume_create_manager' (39e39bc0-5346-497a-89cd-8bc76d352956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:56:27 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6f498722-aef6-4d71-b1bb-4810538887e1 tempest-VolumesSnapshotTestJSON-1119395226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4a5243f-6fd2-4434-be2c-5fa25da18d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:56:27 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6f498722-aef6-4d71-b1bb-4810538887e1 tempest-VolumesSnapshotTestJSON-1119395226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4a5243f-6fd2-4434-be2c-5fa25da18d3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:56:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1985363714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6945f8cb-aca6-4ada-9615-b2eb533169f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e643cb5b87b247789cb00bccc8c1eae1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:56:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:56:27Z,use_quota=True,user_id='8975db700f5543579bffa7dd0c86ba88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:56:27 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6f498722-aef6-4d71-b1bb-4810538887e1 tempest-VolumesSnapshotTestJSON-1119395226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7b3e675-5a5f-45d3-a30e-5aad0682b454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:56:27 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6f498722-aef6-4d71-b1bb-4810538887e1 tempest-VolumesSnapshotTestJSON-1119395226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7b3e675-5a5f-45d3-a30e-5aad0682b454) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:56:27 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6f498722-aef6-4d71-b1bb-4810538887e1 tempest-VolumesSnapshotTestJSON-1119395226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30ab6f2a-84cd-41ab-8b67-2a73995b916f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:56:27 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6f498722-aef6-4d71-b1bb-4810538887e1 tempest-VolumesSnapshotTestJSON-1119395226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30ab6f2a-84cd-41ab-8b67-2a73995b916f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6945f8cb-aca6-4ada-9615-b2eb533169f3', 'volume_name': 'volume-6945f8cb-aca6-4ada-9615-b2eb533169f3', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:56:27 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6f498722-aef6-4d71-b1bb-4810538887e1 tempest-VolumesSnapshotTestJSON-1119395226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d53cef3-766d-463b-a4ec-04604f01b43a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:56:27 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6f498722-aef6-4d71-b1bb-4810538887e1 tempest-VolumesSnapshotTestJSON-1119395226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d53cef3-766d-463b-a4ec-04604f01b43a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:56:27 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6f498722-aef6-4d71-b1bb-4810538887e1 tempest-VolumesSnapshotTestJSON-1119395226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64dfbdb9-4d2f-440b-889c-f9fcdba8d25c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:56:27 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-6f498722-aef6-4d71-b1bb-4810538887e1 tempest-VolumesSnapshotTestJSON-1119395226 None] Volume 6945f8cb-aca6-4ada-9615-b2eb533169f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6945f8cb-aca6-4ada-9615-b2eb533169f3', 'volume_size': 1} Jul 10 15:56:27 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-6f498722-aef6-4d71-b1bb-4810538887e1 tempest-VolumesSnapshotTestJSON-1119395226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:56:27 devstack sudo[96607]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:27 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-be1dd9b8-c635-4072-9d64-dfba6c6a22cb tempest-VolumeQuotasAdminTestJSON-1318972926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-032e69b1-4936-46e5-84aa-e165563f8181" returned: 0 in 1.164s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:27 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-be1dd9b8-c635-4072-9d64-dfba6c6a22cb tempest-VolumeQuotasAdminTestJSON-1318972926 None] Lock "cinder-quobyte-032e69b1-4936-46e5-84aa-e165563f8181" released by "delete_volume" :: held 2.122s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:56:27 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-be1dd9b8-c635-4072-9d64-dfba6c6a22cb tempest-VolumeQuotasAdminTestJSON-1318972926 None] Created reservations ['81d3929b-1171-4c3f-b6cd-8105f115df35', 'be4af767-4e35-4111-a944-d0d2eb1145ae', '5bc7ac2f-3624-4032-aa4a-ef0c9d5a8519', 'b1d464fe-466c-44ed-a7e2-a09319252744'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 15:56:27 devstack sudo[96610]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:27 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-989bb548-6115-40c9-a216-e94b143f3a31 tempest-SnapshotsActionsTest-1918108303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2922929-98bb-4fec-bdd5-aad2d7870937.04b64570-a35a-4472-9f73-f425b6bccc9e -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.5d42a5b2-5673-4169-8e1f-11cf60d2bbdb" returned: 0 in 0.970s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:27 devstack cinder-volume[87420]: WARNING cinder.volume.drivers.remotefs [None req-989bb548-6115-40c9-a216-e94b143f3a31 tempest-SnapshotsActionsTest-1918108303 None] /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.5d42a5b2-5673-4169-8e1f-11cf60d2bbdb is being set with open permissions: ugo+rw Jul 10 15:56:27 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-989bb548-6115-40c9-a216-e94b143f3a31 tempest-SnapshotsActionsTest-1918108303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.5d42a5b2-5673-4169-8e1f-11cf60d2bbdb {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:27 devstack sudo[96618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.5d42a5b2-5673-4169-8e1f-11cf60d2bbdb Jul 10 15:56:27 devstack sudo[96618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:27 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-be1dd9b8-c635-4072-9d64-dfba6c6a22cb tempest-VolumeQuotasAdminTestJSON-1318972926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:56:27 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-be1dd9b8-c635-4072-9d64-dfba6c6a22cb tempest-VolumeQuotasAdminTestJSON-1318972926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:56:27 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-be1dd9b8-c635-4072-9d64-dfba6c6a22cb tempest-VolumeQuotasAdminTestJSON-1318972926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:56:27 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-be1dd9b8-c635-4072-9d64-dfba6c6a22cb tempest-VolumeQuotasAdminTestJSON-1318972926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:56:27 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-be1dd9b8-c635-4072-9d64-dfba6c6a22cb tempest-VolumeQuotasAdminTestJSON-1318972926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:56:27 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-be1dd9b8-c635-4072-9d64-dfba6c6a22cb tempest-VolumeQuotasAdminTestJSON-1318972926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:27 devstack sudo[96620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 15:56:27 devstack sudo[96620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:27 devstack sudo[96588]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:27 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-73d8a73f-66df-4e12-aa1c-8c5cb582ee1e tempest-VolumesImageMetadata-843895676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_980bf5e0-e973-48f3-bc1f-383f924c4467__23hmr89devstack@QuobyteHD /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ab176fcf-d540-47c8-8e14-5d225ef6515e" returned: 0 in 2.230s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:27 devstack cinder-volume[87420]: DEBUG cinder.image.image_utils [None req-73d8a73f-66df-4e12-aa1c-8c5cb582ee1e tempest-VolumesImageMetadata-843895676 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_980bf5e0-e973-48f3-bc1f-383f924c4467__23hmr89devstack@QuobyteHD, size 112.00 MB, duration 2.23 sec, destination /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ab176fcf-d540-47c8-8e14-5d225ef6515e {{(pid=87420) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 15:56:27 devstack cinder-volume[87420]: INFO cinder.image.image_utils [None req-73d8a73f-66df-4e12-aa1c-8c5cb582ee1e tempest-VolumesImageMetadata-843895676 None] Converted 112.00 MB image at 50.18 MB/s Jul 10 15:56:27 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-73d8a73f-66df-4e12-aa1c-8c5cb582ee1e tempest-VolumesImageMetadata-843895676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ab176fcf-d540-47c8-8e14-5d225ef6515e 1G {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:27 devstack sudo[96622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ab176fcf-d540-47c8-8e14-5d225ef6515e 1G Jul 10 15:56:27 devstack sudo[96622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:28 devstack sudo[96618]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:28 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-989bb548-6115-40c9-a216-e94b143f3a31 tempest-SnapshotsActionsTest-1918108303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.5d42a5b2-5673-4169-8e1f-11cf60d2bbdb" returned: 0 in 0.718s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:28 devstack sudo[96620]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:28 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-989bb548-6115-40c9-a216-e94b143f3a31 tempest-SnapshotsActionsTest-1918108303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.737s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:56:28 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-6f498722-aef6-4d71-b1bb-4810538887e1 tempest-VolumesSnapshotTestJSON-1119395226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.950s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:56:28 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-6f498722-aef6-4d71-b1bb-4810538887e1 tempest-VolumesSnapshotTestJSON-1119395226 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:56:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1985363714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6945f8cb-aca6-4ada-9615-b2eb533169f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e643cb5b87b247789cb00bccc8c1eae1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:56:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:56:27Z,use_quota=True,user_id='8975db700f5543579bffa7dd0c86ba88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 15:56:28 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-6f498722-aef6-4d71-b1bb-4810538887e1 tempest-VolumesSnapshotTestJSON-1119395226 None] Creating volume 6945f8cb-aca6-4ada-9615-b2eb533169f3 {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 15:56:28 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-6f498722-aef6-4d71-b1bb-4810538887e1 tempest-VolumesSnapshotTestJSON-1119395226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:56:28 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-6f498722-aef6-4d71-b1bb-4810538887e1 tempest-VolumesSnapshotTestJSON-1119395226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:56:28 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-6f498722-aef6-4d71-b1bb-4810538887e1 tempest-VolumesSnapshotTestJSON-1119395226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:56:28 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-6f498722-aef6-4d71-b1bb-4810538887e1 tempest-VolumesSnapshotTestJSON-1119395226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:56:28 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-6f498722-aef6-4d71-b1bb-4810538887e1 tempest-VolumesSnapshotTestJSON-1119395226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:56:28 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-6f498722-aef6-4d71-b1bb-4810538887e1 tempest-VolumesSnapshotTestJSON-1119395226 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 15:56:28 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-6f498722-aef6-4d71-b1bb-4810538887e1 tempest-VolumesSnapshotTestJSON-1119395226 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 15:56:28 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6f498722-aef6-4d71-b1bb-4810538887e1 tempest-VolumesSnapshotTestJSON-1119395226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6945f8cb-aca6-4ada-9615-b2eb533169f3 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:28 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-be1dd9b8-c635-4072-9d64-dfba6c6a22cb tempest-VolumeQuotasAdminTestJSON-1318972926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.731s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:28 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-be1dd9b8-c635-4072-9d64-dfba6c6a22cb tempest-VolumeQuotasAdminTestJSON-1318972926 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 15:56:28 devstack sudo[96627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6945f8cb-aca6-4ada-9615-b2eb533169f3 1073741824 Jul 10 15:56:28 devstack sudo[96627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:28 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-be1dd9b8-c635-4072-9d64-dfba6c6a22cb tempest-VolumeQuotasAdminTestJSON-1318972926 None] Deleted volume successfully. Jul 10 15:56:28 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-989bb548-6115-40c9-a216-e94b143f3a31 tempest-SnapshotsActionsTest-1918108303 None] Create snapshot completed successfully Jul 10 15:56:28 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-be1dd9b8-c635-4072-9d64-dfba6c6a22cb tempest-VolumeQuotasAdminTestJSON-1318972926 None] Lock "cinder-032e69b1-4936-46e5-84aa-e165563f8181-delete_volume" released by "delete_volume" :: held 3.161s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:56:28 devstack sudo[96622]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:28 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-73d8a73f-66df-4e12-aa1c-8c5cb582ee1e tempest-VolumesImageMetadata-843895676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ab176fcf-d540-47c8-8e14-5d225ef6515e 1G" returned: 0 in 0.743s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:28 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb007dd5-4c88-4408-acc9-474937f44e14]: (4, 'raw') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:56:28 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-73d8a73f-66df-4e12-aa1c-8c5cb582ee1e tempest-VolumesImageMetadata-843895676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ab176fcf-d540-47c8-8e14-5d225ef6515e {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:28 devstack sudo[96631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ab176fcf-d540-47c8-8e14-5d225ef6515e Jul 10 15:56:28 devstack sudo[96631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:29 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a5da688-12f4-4dc3-a280-70919ba5451f tempest-VolumeQuotasAdminTestJSON-1318972926 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 15:56:29 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-0a5da688-12f4-4dc3-a280-70919ba5451f tempest-VolumeQuotasAdminTestJSON-1318972926 None] Flow 'volume_create_manager' (f42aae0b-077d-4083-b9ea-d83b53e6bc81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:56:29 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-0a5da688-12f4-4dc3-a280-70919ba5451f tempest-VolumeQuotasAdminTestJSON-1318972926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65d1cc11-138c-4903-a901-03997d90ae0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:56:29 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-0a5da688-12f4-4dc3-a280-70919ba5451f tempest-VolumeQuotasAdminTestJSON-1318972926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65d1cc11-138c-4903-a901-03997d90ae0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:56:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-32346755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bafbcf1a-fa50-4b78-a1a4-d3e505c6e759,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09c3a36ea75441ba8f3c75f61d110b98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:56:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:56:29Z,use_quota=True,user_id='a8add1071767419ba9a64983e85627a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:56:29 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-0a5da688-12f4-4dc3-a280-70919ba5451f tempest-VolumeQuotasAdminTestJSON-1318972926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7adaed3b-6955-4077-8c70-482e3dfd19df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:56:29 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-0a5da688-12f4-4dc3-a280-70919ba5451f tempest-VolumeQuotasAdminTestJSON-1318972926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7adaed3b-6955-4077-8c70-482e3dfd19df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:56:29 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-0a5da688-12f4-4dc3-a280-70919ba5451f tempest-VolumeQuotasAdminTestJSON-1318972926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bce93b76-e85c-454b-b0ad-7a1d93e95083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:56:29 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-0a5da688-12f4-4dc3-a280-70919ba5451f tempest-VolumeQuotasAdminTestJSON-1318972926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bce93b76-e85c-454b-b0ad-7a1d93e95083) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bafbcf1a-fa50-4b78-a1a4-d3e505c6e759', 'volume_name': 'volume-bafbcf1a-fa50-4b78-a1a4-d3e505c6e759', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:56:29 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-0a5da688-12f4-4dc3-a280-70919ba5451f tempest-VolumeQuotasAdminTestJSON-1318972926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f3d1d90-74c6-4d56-9754-54208725ae1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:56:29 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-0a5da688-12f4-4dc3-a280-70919ba5451f tempest-VolumeQuotasAdminTestJSON-1318972926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f3d1d90-74c6-4d56-9754-54208725ae1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:56:29 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-0a5da688-12f4-4dc3-a280-70919ba5451f tempest-VolumeQuotasAdminTestJSON-1318972926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f5e43f5-dfaf-4ea5-9dce-65fc17b79dda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:56:29 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-0a5da688-12f4-4dc3-a280-70919ba5451f tempest-VolumeQuotasAdminTestJSON-1318972926 None] Volume bafbcf1a-fa50-4b78-a1a4-d3e505c6e759: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bafbcf1a-fa50-4b78-a1a4-d3e505c6e759', 'volume_size': 1} Jul 10 15:56:29 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-0a5da688-12f4-4dc3-a280-70919ba5451f tempest-VolumeQuotasAdminTestJSON-1318972926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:56:29 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-f630c09f-d3f7-40f4-ae25-008ac02cf52f tempest-SnapshotsActionsTest-51400650 None] Acquiring lock "cinder-5d42a5b2-5673-4169-8e1f-11cf60d2bbdb-delete_snapshot" by "delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:56:29 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-f630c09f-d3f7-40f4-ae25-008ac02cf52f tempest-SnapshotsActionsTest-51400650 None] Lock "cinder-5d42a5b2-5673-4169-8e1f-11cf60d2bbdb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:56:29 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-f630c09f-d3f7-40f4-ae25-008ac02cf52f tempest-SnapshotsActionsTest-51400650 None] Acquiring lock "cinder-quobyte-f2922929-98bb-4fec-bdd5-aad2d7870937" by "delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:56:29 devstack sudo[96627]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:29 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-f630c09f-d3f7-40f4-ae25-008ac02cf52f tempest-SnapshotsActionsTest-51400650 None] Lock "cinder-quobyte-f2922929-98bb-4fec-bdd5-aad2d7870937" acquired by "delete_snapshot" :: waited 0.049s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:56:29 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-f630c09f-d3f7-40f4-ae25-008ac02cf52f tempest-SnapshotsActionsTest-51400650 None] Acquiring lock "cinder-quobyte-5d42a5b2-5673-4169-8e1f-11cf60d2bbdb" by "_delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:56:29 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6f498722-aef6-4d71-b1bb-4810538887e1 tempest-VolumesSnapshotTestJSON-1119395226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6945f8cb-aca6-4ada-9615-b2eb533169f3 1073741824" returned: 0 in 1.121s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:29 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-f630c09f-d3f7-40f4-ae25-008ac02cf52f tempest-SnapshotsActionsTest-51400650 None] Lock "cinder-quobyte-5d42a5b2-5673-4169-8e1f-11cf60d2bbdb" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:56:29 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-f630c09f-d3f7-40f4-ae25-008ac02cf52f tempest-SnapshotsActionsTest-51400650 None] Deleting offline snapshot 5d42a5b2-5673-4169-8e1f-11cf60d2bbdb of volume f2922929-98bb-4fec-bdd5-aad2d7870937 {{(pid=87420) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 15:56:29 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-f630c09f-d3f7-40f4-ae25-008ac02cf52f tempest-SnapshotsActionsTest-51400650 None] snapshot_file for this snap is: volume-f2922929-98bb-4fec-bdd5-aad2d7870937.5d42a5b2-5673-4169-8e1f-11cf60d2bbdb {{(pid=87420) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 15:56:29 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1f40b40-b403-4586-ab52-a7aaad4ec629]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:56:29 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f630c09f-d3f7-40f4-ae25-008ac02cf52f tempest-SnapshotsActionsTest-51400650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.5d42a5b2-5673-4169-8e1f-11cf60d2bbdb {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:29 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6f498722-aef6-4d71-b1bb-4810538887e1 tempest-VolumesSnapshotTestJSON-1119395226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6945f8cb-aca6-4ada-9615-b2eb533169f3 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:29 devstack sudo[96677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6945f8cb-aca6-4ada-9615-b2eb533169f3 Jul 10 15:56:29 devstack sudo[96677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:29 devstack sudo[96631]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:29 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-73d8a73f-66df-4e12-aa1c-8c5cb582ee1e tempest-VolumesImageMetadata-843895676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ab176fcf-d540-47c8-8e14-5d225ef6515e" returned: 0 in 1.063s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:29 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-73d8a73f-66df-4e12-aa1c-8c5cb582ee1e tempest-VolumesImageMetadata-843895676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ab176fcf-d540-47c8-8e14-5d225ef6515e {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:29 devstack sudo[96676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.5d42a5b2-5673-4169-8e1f-11cf60d2bbdb Jul 10 15:56:29 devstack sudo[96676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:29 devstack sudo[96679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ab176fcf-d540-47c8-8e14-5d225ef6515e Jul 10 15:56:29 devstack sudo[96679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:30 devstack sudo[96677]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:30 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6f498722-aef6-4d71-b1bb-4810538887e1 tempest-VolumesSnapshotTestJSON-1119395226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6945f8cb-aca6-4ada-9615-b2eb533169f3" returned: 0 in 0.697s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:30 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-6f498722-aef6-4d71-b1bb-4810538887e1 tempest-VolumesSnapshotTestJSON-1119395226 None] <== create_volume: return (1931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 15:56:30 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-6f498722-aef6-4d71-b1bb-4810538887e1 tempest-VolumesSnapshotTestJSON-1119395226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.935s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:56:30 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-0a5da688-12f4-4dc3-a280-70919ba5451f tempest-VolumeQuotasAdminTestJSON-1318972926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.945s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:56:30 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-0a5da688-12f4-4dc3-a280-70919ba5451f tempest-VolumeQuotasAdminTestJSON-1318972926 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:56:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-32346755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bafbcf1a-fa50-4b78-a1a4-d3e505c6e759,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09c3a36ea75441ba8f3c75f61d110b98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:56:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:56:29Z,use_quota=True,user_id='a8add1071767419ba9a64983e85627a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 15:56:30 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-0a5da688-12f4-4dc3-a280-70919ba5451f tempest-VolumeQuotasAdminTestJSON-1318972926 None] Creating volume bafbcf1a-fa50-4b78-a1a4-d3e505c6e759 {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 15:56:30 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-0a5da688-12f4-4dc3-a280-70919ba5451f tempest-VolumeQuotasAdminTestJSON-1318972926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:56:30 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-0a5da688-12f4-4dc3-a280-70919ba5451f tempest-VolumeQuotasAdminTestJSON-1318972926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:56:30 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-0a5da688-12f4-4dc3-a280-70919ba5451f tempest-VolumeQuotasAdminTestJSON-1318972926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:56:30 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-0a5da688-12f4-4dc3-a280-70919ba5451f tempest-VolumeQuotasAdminTestJSON-1318972926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:56:30 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-0a5da688-12f4-4dc3-a280-70919ba5451f tempest-VolumeQuotasAdminTestJSON-1318972926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:56:30 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-0a5da688-12f4-4dc3-a280-70919ba5451f tempest-VolumeQuotasAdminTestJSON-1318972926 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 15:56:30 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-0a5da688-12f4-4dc3-a280-70919ba5451f tempest-VolumeQuotasAdminTestJSON-1318972926 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 15:56:30 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-0a5da688-12f4-4dc3-a280-70919ba5451f tempest-VolumeQuotasAdminTestJSON-1318972926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-bafbcf1a-fa50-4b78-a1a4-d3e505c6e759 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:30 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6f498722-aef6-4d71-b1bb-4810538887e1 tempest-VolumesSnapshotTestJSON-1119395226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64dfbdb9-4d2f-440b-889c-f9fcdba8d25c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6945f8cb-aca6-4ada-9615-b2eb533169f3', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:56:30 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6f498722-aef6-4d71-b1bb-4810538887e1 tempest-VolumesSnapshotTestJSON-1119395226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (beebeadc-7e22-4ccf-b0ce-b7be4e4361b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:56:30 devstack sudo[96687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-bafbcf1a-fa50-4b78-a1a4-d3e505c6e759 1073741824 Jul 10 15:56:30 devstack sudo[96687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:30 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-6f498722-aef6-4d71-b1bb-4810538887e1 tempest-VolumesSnapshotTestJSON-1119395226 None] Volume volume-6945f8cb-aca6-4ada-9615-b2eb533169f3 (6945f8cb-aca6-4ada-9615-b2eb533169f3): created successfully Jul 10 15:56:30 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6f498722-aef6-4d71-b1bb-4810538887e1 tempest-VolumesSnapshotTestJSON-1119395226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (beebeadc-7e22-4ccf-b0ce-b7be4e4361b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:56:30 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6f498722-aef6-4d71-b1bb-4810538887e1 tempest-VolumesSnapshotTestJSON-1119395226 None] Flow 'volume_create_manager' (39e39bc0-5346-497a-89cd-8bc76d352956) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:56:30 devstack sudo[96676]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:30 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f630c09f-d3f7-40f4-ae25-008ac02cf52f tempest-SnapshotsActionsTest-51400650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.5d42a5b2-5673-4169-8e1f-11cf60d2bbdb" returned: 0 in 0.854s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:30 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-f630c09f-d3f7-40f4-ae25-008ac02cf52f tempest-SnapshotsActionsTest-51400650 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f2922929-98bb-4fec-bdd5-aad2d7870937(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87420) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 15:56:30 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-6f498722-aef6-4d71-b1bb-4810538887e1 tempest-VolumesSnapshotTestJSON-1119395226 None] Created volume successfully. Jul 10 15:56:30 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[addef781-5a16-4334-9689-c08fef82434d]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:56:30 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f630c09f-d3f7-40f4-ae25-008ac02cf52f tempest-SnapshotsActionsTest-51400650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.04b64570-a35a-4472-9f73-f425b6bccc9e {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:30 devstack sudo[96679]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:30 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-73d8a73f-66df-4e12-aa1c-8c5cb582ee1e tempest-VolumesImageMetadata-843895676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ab176fcf-d540-47c8-8e14-5d225ef6515e" returned: 1 in 0.846s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:30 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-73d8a73f-66df-4e12-aa1c-8c5cb582ee1e tempest-VolumesImageMetadata-843895676 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ab176fcf-d540-47c8-8e14-5d225ef6515e' failed. Not Retrying. {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 15:56:30 devstack cinder-volume[87420]: DEBUG cinder.volume.volume_utils [None req-73d8a73f-66df-4e12-aa1c-8c5cb582ee1e tempest-VolumesImageMetadata-843895676 None] Downloaded image 980bf5e0-e973-48f3-bc1f-383f924c4467 ((None, [{'url': 'file:///opt/stack/data/glance/images/980bf5e0-e973-48f3-bc1f-383f924c4467', 'metadata': {}}])) to volume ab176fcf-d540-47c8-8e14-5d225ef6515e successfully. {{(pid=87420) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 10 15:56:30 devstack cinder-volume[87420]: DEBUG cinder.image.image_utils [None req-73d8a73f-66df-4e12-aa1c-8c5cb582ee1e tempest-VolumesImageMetadata-843895676 None] Temporary image 980bf5e0-e973-48f3-bc1f-383f924c4467 for user e14e0a3b70f84a1b83ba205a69e71196 is deleted. {{(pid=87420) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 10 15:56:30 devstack cinder-volume[87420]: DEBUG cinder.volume.volume_utils [None req-73d8a73f-66df-4e12-aa1c-8c5cb582ee1e tempest-VolumesImageMetadata-843895676 None] Marking volume ab176fcf-d540-47c8-8e14-5d225ef6515e as bootable. {{(pid=87420) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 10 15:56:30 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-73d8a73f-66df-4e12-aa1c-8c5cb582ee1e tempest-VolumesImageMetadata-843895676 None] Copying metadata from image 980bf5e0-e973-48f3-bc1f-383f924c4467 to ab176fcf-d540-47c8-8e14-5d225ef6515e. {{(pid=87420) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 10 15:56:30 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-73d8a73f-66df-4e12-aa1c-8c5cb582ee1e tempest-VolumesImageMetadata-843895676 None] Creating volume glance metadata for volume ab176fcf-d540-47c8-8e14-5d225ef6515e backed by image 980bf5e0-e973-48f3-bc1f-383f924c4467 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '980bf5e0-e973-48f3-bc1f-383f924c4467', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87420) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 10 15:56:30 devstack sudo[96691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.04b64570-a35a-4472-9f73-f425b6bccc9e Jul 10 15:56:30 devstack sudo[96691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:30 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-73d8a73f-66df-4e12-aa1c-8c5cb582ee1e tempest-VolumesImageMetadata-843895676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c039fc90-cc82-447c-9b43-2838f978da1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab176fcf-d540-47c8-8e14-5d225ef6515e', 'volume_size': 1, 'image_id': '980bf5e0-e973-48f3-bc1f-383f924c4467', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/980bf5e0-e973-48f3-bc1f-383f924c4467', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'de9cf234f3774db489ed55d5afcfc7bf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '980bf5e0-e973-48f3-bc1f-383f924c4467', 'created_at': datetime.datetime(2026, 7, 10, 13, 42, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 13, 42, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/980bf5e0-e973-48f3-bc1f-383f924c4467/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:56:30 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-73d8a73f-66df-4e12-aa1c-8c5cb582ee1e tempest-VolumesImageMetadata-843895676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cf703eb-2feb-4c80-96e6-81c729d41b30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:56:30 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-73d8a73f-66df-4e12-aa1c-8c5cb582ee1e tempest-VolumesImageMetadata-843895676 None] Volume volume-ab176fcf-d540-47c8-8e14-5d225ef6515e (ab176fcf-d540-47c8-8e14-5d225ef6515e): created successfully Jul 10 15:56:30 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-73d8a73f-66df-4e12-aa1c-8c5cb582ee1e tempest-VolumesImageMetadata-843895676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cf703eb-2feb-4c80-96e6-81c729d41b30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:56:30 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-73d8a73f-66df-4e12-aa1c-8c5cb582ee1e tempest-VolumesImageMetadata-843895676 None] Flow 'volume_create_manager' (d2a03bd8-9345-42c8-b20b-85e2db09d9a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:56:30 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-73d8a73f-66df-4e12-aa1c-8c5cb582ee1e tempest-VolumesImageMetadata-843895676 None] Created volume successfully. Jul 10 15:56:31 devstack sudo[96691]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:31 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f630c09f-d3f7-40f4-ae25-008ac02cf52f tempest-SnapshotsActionsTest-51400650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.04b64570-a35a-4472-9f73-f425b6bccc9e" returned: 0 in 0.843s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:31 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-f630c09f-d3f7-40f4-ae25-008ac02cf52f tempest-SnapshotsActionsTest-51400650 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f2922929-98bb-4fec-bdd5-aad2d7870937(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87420) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 15:56:31 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f630c09f-d3f7-40f4-ae25-008ac02cf52f tempest-SnapshotsActionsTest-51400650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.5d42a5b2-5673-4169-8e1f-11cf60d2bbdb {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:31 devstack sudo[96687]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:31 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-0a5da688-12f4-4dc3-a280-70919ba5451f tempest-VolumeQuotasAdminTestJSON-1318972926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-bafbcf1a-fa50-4b78-a1a4-d3e505c6e759 1073741824" returned: 0 in 0.998s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:31 devstack sudo[96700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.5d42a5b2-5673-4169-8e1f-11cf60d2bbdb Jul 10 15:56:31 devstack sudo[96700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:31 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-0a5da688-12f4-4dc3-a280-70919ba5451f tempest-VolumeQuotasAdminTestJSON-1318972926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-bafbcf1a-fa50-4b78-a1a4-d3e505c6e759 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:31 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-7cd08654-ddc0-490b-a36d-5081a3cf4a0c tempest-VolumesImageMetadata-843895676 None] Acquiring lock "cinder-ab176fcf-d540-47c8-8e14-5d225ef6515e-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:56:31 devstack sudo[96702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-bafbcf1a-fa50-4b78-a1a4-d3e505c6e759 Jul 10 15:56:31 devstack sudo[96702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:31 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-7cd08654-ddc0-490b-a36d-5081a3cf4a0c tempest-VolumesImageMetadata-843895676 None] Lock "cinder-ab176fcf-d540-47c8-8e14-5d225ef6515e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:56:31 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-7cd08654-ddc0-490b-a36d-5081a3cf4a0c tempest-VolumesImageMetadata-843895676 None] Acquiring lock "cinder-quobyte-ab176fcf-d540-47c8-8e14-5d225ef6515e" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:56:31 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-7cd08654-ddc0-490b-a36d-5081a3cf4a0c tempest-VolumesImageMetadata-843895676 None] Lock "cinder-quobyte-ab176fcf-d540-47c8-8e14-5d225ef6515e" acquired by "delete_volume" :: waited 0.022s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:56:31 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e69691e-ce50-42d4-9e65-a0d8f698f817]: (4, 'raw') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:56:31 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-7cd08654-ddc0-490b-a36d-5081a3cf4a0c tempest-VolumesImageMetadata-843895676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ab176fcf-d540-47c8-8e14-5d225ef6515e {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:31 devstack sudo[96704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ab176fcf-d540-47c8-8e14-5d225ef6515e Jul 10 15:56:31 devstack sudo[96704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:31 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-12435c04-4d7c-472c-b439-c191447d28a6 tempest-VolumesSnapshotTestJSON-1119395226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:56:32 devstack sudo[96702]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:32 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-0a5da688-12f4-4dc3-a280-70919ba5451f tempest-VolumeQuotasAdminTestJSON-1318972926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-bafbcf1a-fa50-4b78-a1a4-d3e505c6e759" returned: 0 in 0.755s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:32 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-0a5da688-12f4-4dc3-a280-70919ba5451f tempest-VolumeQuotasAdminTestJSON-1318972926 None] <== create_volume: return (1795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 15:56:32 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-0a5da688-12f4-4dc3-a280-70919ba5451f tempest-VolumeQuotasAdminTestJSON-1318972926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.799s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:56:32 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-12435c04-4d7c-472c-b439-c191447d28a6 tempest-VolumesSnapshotTestJSON-1119395226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.300s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:56:32 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-12435c04-4d7c-472c-b439-c191447d28a6 tempest-VolumesSnapshotTestJSON-1119395226 None] Creating offline snapshot fcea12fb-4db6-44eb-8681-4156787a41d9 of volume 6945f8cb-aca6-4ada-9615-b2eb533169f3 {{(pid=87420) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 15:56:32 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-0a5da688-12f4-4dc3-a280-70919ba5451f tempest-VolumeQuotasAdminTestJSON-1318972926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f5e43f5-dfaf-4ea5-9dce-65fc17b79dda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bafbcf1a-fa50-4b78-a1a4-d3e505c6e759', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:56:32 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-0a5da688-12f4-4dc3-a280-70919ba5451f tempest-VolumeQuotasAdminTestJSON-1318972926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e4f637b-db97-4e2b-ae1d-b7057b9d3e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:56:32 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[88db4745-d055-46d2-9ca2-f9b1c79c01e8]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:56:32 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-12435c04-4d7c-472c-b439-c191447d28a6 tempest-VolumesSnapshotTestJSON-1119395226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6945f8cb-aca6-4ada-9615-b2eb533169f3 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:32 devstack sudo[96700]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:32 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-0a5da688-12f4-4dc3-a280-70919ba5451f tempest-VolumeQuotasAdminTestJSON-1318972926 None] Volume volume-bafbcf1a-fa50-4b78-a1a4-d3e505c6e759 (bafbcf1a-fa50-4b78-a1a4-d3e505c6e759): created successfully Jul 10 15:56:32 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-0a5da688-12f4-4dc3-a280-70919ba5451f tempest-VolumeQuotasAdminTestJSON-1318972926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e4f637b-db97-4e2b-ae1d-b7057b9d3e35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:56:32 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-0a5da688-12f4-4dc3-a280-70919ba5451f tempest-VolumeQuotasAdminTestJSON-1318972926 None] Flow 'volume_create_manager' (f42aae0b-077d-4083-b9ea-d83b53e6bc81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:56:32 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f630c09f-d3f7-40f4-ae25-008ac02cf52f tempest-SnapshotsActionsTest-51400650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.5d42a5b2-5673-4169-8e1f-11cf60d2bbdb" returned: 0 in 0.892s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:32 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f630c09f-d3f7-40f4-ae25-008ac02cf52f tempest-SnapshotsActionsTest-51400650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.5d42a5b2-5673-4169-8e1f-11cf60d2bbdb {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:32 devstack sudo[96711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.5d42a5b2-5673-4169-8e1f-11cf60d2bbdb Jul 10 15:56:32 devstack sudo[96711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:32 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-0a5da688-12f4-4dc3-a280-70919ba5451f tempest-VolumeQuotasAdminTestJSON-1318972926 None] Created volume successfully. Jul 10 15:56:32 devstack sudo[96710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6945f8cb-aca6-4ada-9615-b2eb533169f3 Jul 10 15:56:32 devstack sudo[96710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:32 devstack sudo[96704]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:32 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-7cd08654-ddc0-490b-a36d-5081a3cf4a0c tempest-VolumesImageMetadata-843895676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ab176fcf-d540-47c8-8e14-5d225ef6515e" returned: 0 in 0.936s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:32 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-7cd08654-ddc0-490b-a36d-5081a3cf4a0c tempest-VolumesImageMetadata-843895676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ab176fcf-d540-47c8-8e14-5d225ef6515e {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:32 devstack sudo[96716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ab176fcf-d540-47c8-8e14-5d225ef6515e Jul 10 15:56:32 devstack sudo[96716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:32 devstack sudo[96711]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:32 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f630c09f-d3f7-40f4-ae25-008ac02cf52f tempest-SnapshotsActionsTest-51400650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.5d42a5b2-5673-4169-8e1f-11cf60d2bbdb" returned: 0 in 0.805s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:33 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-f630c09f-d3f7-40f4-ae25-008ac02cf52f tempest-SnapshotsActionsTest-51400650 None] Lock "cinder-quobyte-5d42a5b2-5673-4169-8e1f-11cf60d2bbdb" released by "_delete_snapshot" :: held 3.521s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:56:33 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-f630c09f-d3f7-40f4-ae25-008ac02cf52f tempest-SnapshotsActionsTest-51400650 None] Lock "cinder-quobyte-f2922929-98bb-4fec-bdd5-aad2d7870937" released by "delete_snapshot" :: held 3.554s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:56:33 devstack sudo[96710]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:33 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-12435c04-4d7c-472c-b439-c191447d28a6 tempest-VolumesSnapshotTestJSON-1119395226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6945f8cb-aca6-4ada-9615-b2eb533169f3" returned: 0 in 0.952s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:33 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-36ecf6cf-2789-4a5b-934f-34bb63e0a738 tempest-VolumeQuotasAdminTestJSON-1201996452 None] Transfer volume completed successfully. Jul 10 15:56:33 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-12435c04-4d7c-472c-b439-c191447d28a6 tempest-VolumesSnapshotTestJSON-1119395226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6945f8cb-aca6-4ada-9615-b2eb533169f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6945f8cb-aca6-4ada-9615-b2eb533169f3.fcea12fb-4db6-44eb-8681-4156787a41d9 1G {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:33 devstack sudo[96723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6945f8cb-aca6-4ada-9615-b2eb533169f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6945f8cb-aca6-4ada-9615-b2eb533169f3.fcea12fb-4db6-44eb-8681-4156787a41d9 1G Jul 10 15:56:33 devstack sudo[96723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:33 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-f630c09f-d3f7-40f4-ae25-008ac02cf52f tempest-SnapshotsActionsTest-51400650 None] Created reservations ['82cdae35-9e26-4cb7-bd6a-35951146fc54', 'cbc3d8ab-c7a2-4b65-9ad1-bb144af4fe05', 'd96a4388-3bfe-4789-ac96-949b0990f94c', '150aea29-2fe1-4e6a-96cf-2158936c38fd'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 15:56:33 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-f630c09f-d3f7-40f4-ae25-008ac02cf52f tempest-SnapshotsActionsTest-51400650 None] Delete snapshot completed successfully. Jul 10 15:56:33 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-f630c09f-d3f7-40f4-ae25-008ac02cf52f tempest-SnapshotsActionsTest-51400650 None] Lock "cinder-5d42a5b2-5673-4169-8e1f-11cf60d2bbdb-delete_snapshot" released by "delete_snapshot" :: held 3.769s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:56:33 devstack sudo[96716]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:33 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-7cd08654-ddc0-490b-a36d-5081a3cf4a0c tempest-VolumesImageMetadata-843895676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ab176fcf-d540-47c8-8e14-5d225ef6515e" returned: 1 in 0.882s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:33 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-7cd08654-ddc0-490b-a36d-5081a3cf4a0c tempest-VolumesImageMetadata-843895676 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ab176fcf-d540-47c8-8e14-5d225ef6515e' failed. Not Retrying. {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 15:56:33 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-7cd08654-ddc0-490b-a36d-5081a3cf4a0c tempest-VolumesImageMetadata-843895676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ab176fcf-d540-47c8-8e14-5d225ef6515e {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:33 devstack sudo[96728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ab176fcf-d540-47c8-8e14-5d225ef6515e Jul 10 15:56:33 devstack sudo[96728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:34 devstack sudo[96723]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:34 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-12435c04-4d7c-472c-b439-c191447d28a6 tempest-VolumesSnapshotTestJSON-1119395226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6945f8cb-aca6-4ada-9615-b2eb533169f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6945f8cb-aca6-4ada-9615-b2eb533169f3.fcea12fb-4db6-44eb-8681-4156787a41d9 1G" returned: 0 in 0.972s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:34 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-12435c04-4d7c-472c-b439-c191447d28a6 tempest-VolumesSnapshotTestJSON-1119395226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6945f8cb-aca6-4ada-9615-b2eb533169f3 -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6945f8cb-aca6-4ada-9615-b2eb533169f3.fcea12fb-4db6-44eb-8681-4156787a41d9 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:34 devstack sudo[96735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6945f8cb-aca6-4ada-9615-b2eb533169f3 -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6945f8cb-aca6-4ada-9615-b2eb533169f3.fcea12fb-4db6-44eb-8681-4156787a41d9 Jul 10 15:56:34 devstack sudo[96735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:34 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-220d0932-d0d2-4c89-b071-ecd5a14a707a tempest-SnapshotsActionsTest-1918108303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:56:34 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-0cbc13c8-829d-4ddd-b467-a6fe676dccae tempest-VolumeQuotasAdminTestJSON-246520357 None] Acquiring lock "cinder-bafbcf1a-fa50-4b78-a1a4-d3e505c6e759-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:56:34 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-0cbc13c8-829d-4ddd-b467-a6fe676dccae tempest-VolumeQuotasAdminTestJSON-246520357 None] Lock "cinder-bafbcf1a-fa50-4b78-a1a4-d3e505c6e759-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:56:34 devstack sudo[96728]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:34 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-7cd08654-ddc0-490b-a36d-5081a3cf4a0c tempest-VolumesImageMetadata-843895676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ab176fcf-d540-47c8-8e14-5d225ef6515e" returned: 0 in 0.798s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:34 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-7cd08654-ddc0-490b-a36d-5081a3cf4a0c tempest-VolumesImageMetadata-843895676 None] Lock "cinder-quobyte-ab176fcf-d540-47c8-8e14-5d225ef6515e" released by "delete_volume" :: held 2.716s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:56:34 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-0cbc13c8-829d-4ddd-b467-a6fe676dccae tempest-VolumeQuotasAdminTestJSON-246520357 None] Acquiring lock "cinder-quobyte-bafbcf1a-fa50-4b78-a1a4-d3e505c6e759" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:56:34 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-0cbc13c8-829d-4ddd-b467-a6fe676dccae tempest-VolumeQuotasAdminTestJSON-246520357 None] Lock "cinder-quobyte-bafbcf1a-fa50-4b78-a1a4-d3e505c6e759" acquired by "delete_volume" :: waited 0.014s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:56:34 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[8539d4f2-2d8c-45b8-aaa9-c79a6cfa1c4d]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:56:34 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-0cbc13c8-829d-4ddd-b467-a6fe676dccae tempest-VolumeQuotasAdminTestJSON-246520357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-bafbcf1a-fa50-4b78-a1a4-d3e505c6e759 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:34 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-7cd08654-ddc0-490b-a36d-5081a3cf4a0c tempest-VolumesImageMetadata-843895676 None] Created reservations ['d5f29f0e-969d-4e31-9ed6-3d5ac5706e38', '6f76c9e8-9a7d-41a3-ad06-9f57469344b9', 'e36f70b3-7b3e-4d18-bafd-af01cfdb540e', '1fe707f7-0678-4aa6-9d8d-de3cd177b9ce'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 15:56:34 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-7cd08654-ddc0-490b-a36d-5081a3cf4a0c tempest-VolumesImageMetadata-843895676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:56:34 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-7cd08654-ddc0-490b-a36d-5081a3cf4a0c tempest-VolumesImageMetadata-843895676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:56:34 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-7cd08654-ddc0-490b-a36d-5081a3cf4a0c tempest-VolumesImageMetadata-843895676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:56:34 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-7cd08654-ddc0-490b-a36d-5081a3cf4a0c tempest-VolumesImageMetadata-843895676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:56:34 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-7cd08654-ddc0-490b-a36d-5081a3cf4a0c tempest-VolumesImageMetadata-843895676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:56:34 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-7cd08654-ddc0-490b-a36d-5081a3cf4a0c tempest-VolumesImageMetadata-843895676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:34 devstack sudo[96737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-bafbcf1a-fa50-4b78-a1a4-d3e505c6e759 Jul 10 15:56:34 devstack sudo[96737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:34 devstack sudo[96738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 15:56:34 devstack sudo[96738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:34 devstack sudo[96735]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:34 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-12435c04-4d7c-472c-b439-c191447d28a6 tempest-VolumesSnapshotTestJSON-1119395226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6945f8cb-aca6-4ada-9615-b2eb533169f3 -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6945f8cb-aca6-4ada-9615-b2eb533169f3.fcea12fb-4db6-44eb-8681-4156787a41d9" returned: 0 in 0.774s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:34 devstack cinder-volume[87420]: WARNING cinder.volume.drivers.remotefs [None req-12435c04-4d7c-472c-b439-c191447d28a6 tempest-VolumesSnapshotTestJSON-1119395226 None] /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6945f8cb-aca6-4ada-9615-b2eb533169f3.fcea12fb-4db6-44eb-8681-4156787a41d9 is being set with open permissions: ugo+rw Jul 10 15:56:34 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-12435c04-4d7c-472c-b439-c191447d28a6 tempest-VolumesSnapshotTestJSON-1119395226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6945f8cb-aca6-4ada-9615-b2eb533169f3.fcea12fb-4db6-44eb-8681-4156787a41d9 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:34 devstack sudo[96744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6945f8cb-aca6-4ada-9615-b2eb533169f3.fcea12fb-4db6-44eb-8681-4156787a41d9 Jul 10 15:56:34 devstack sudo[96744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:35 devstack sudo[96738]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:35 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-7cd08654-ddc0-490b-a36d-5081a3cf4a0c tempest-VolumesImageMetadata-843895676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.731s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:35 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-7cd08654-ddc0-490b-a36d-5081a3cf4a0c tempest-VolumesImageMetadata-843895676 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 15:56:35 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-7cd08654-ddc0-490b-a36d-5081a3cf4a0c tempest-VolumesImageMetadata-843895676 None] Deleted volume successfully. Jul 10 15:56:35 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-7cd08654-ddc0-490b-a36d-5081a3cf4a0c tempest-VolumesImageMetadata-843895676 None] Lock "cinder-ab176fcf-d540-47c8-8e14-5d225ef6515e-delete_volume" released by "delete_volume" :: held 3.747s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:56:35 devstack sudo[96737]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:35 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-0cbc13c8-829d-4ddd-b467-a6fe676dccae tempest-VolumeQuotasAdminTestJSON-246520357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-bafbcf1a-fa50-4b78-a1a4-d3e505c6e759" returned: 0 in 0.885s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:35 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-0cbc13c8-829d-4ddd-b467-a6fe676dccae tempest-VolumeQuotasAdminTestJSON-246520357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-bafbcf1a-fa50-4b78-a1a4-d3e505c6e759 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:35 devstack sudo[96750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-bafbcf1a-fa50-4b78-a1a4-d3e505c6e759 Jul 10 15:56:35 devstack sudo[96750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:35 devstack sudo[96744]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:35 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-12435c04-4d7c-472c-b439-c191447d28a6 tempest-VolumesSnapshotTestJSON-1119395226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6945f8cb-aca6-4ada-9615-b2eb533169f3.fcea12fb-4db6-44eb-8681-4156787a41d9" returned: 0 in 0.730s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:35 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-12435c04-4d7c-472c-b439-c191447d28a6 tempest-VolumesSnapshotTestJSON-1119395226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6945f8cb-aca6-4ada-9615-b2eb533169f3.info {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:35 devstack sudo[96753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6945f8cb-aca6-4ada-9615-b2eb533169f3.info Jul 10 15:56:35 devstack sudo[96753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:35 devstack sudo[96750]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:35 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-0cbc13c8-829d-4ddd-b467-a6fe676dccae tempest-VolumeQuotasAdminTestJSON-246520357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-bafbcf1a-fa50-4b78-a1a4-d3e505c6e759" returned: 0 in 0.764s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:35 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-0cbc13c8-829d-4ddd-b467-a6fe676dccae tempest-VolumeQuotasAdminTestJSON-246520357 None] Lock "cinder-quobyte-bafbcf1a-fa50-4b78-a1a4-d3e505c6e759" released by "delete_volume" :: held 1.705s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:56:35 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-0cbc13c8-829d-4ddd-b467-a6fe676dccae tempest-VolumeQuotasAdminTestJSON-246520357 None] Created reservations ['e12a1d7f-093e-42cd-a734-25fa6bffdd12', '2918a922-453b-4ce8-936b-179ceebcf574', 'd49e5311-612a-4fb6-93aa-c7ecc3c9897f', 'a35c687d-2102-40a3-80bd-c1c4b5a4504f'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 15:56:36 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-0cbc13c8-829d-4ddd-b467-a6fe676dccae tempest-VolumeQuotasAdminTestJSON-246520357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:56:36 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-0cbc13c8-829d-4ddd-b467-a6fe676dccae tempest-VolumeQuotasAdminTestJSON-246520357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:56:36 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-0cbc13c8-829d-4ddd-b467-a6fe676dccae tempest-VolumeQuotasAdminTestJSON-246520357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:56:36 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-0cbc13c8-829d-4ddd-b467-a6fe676dccae tempest-VolumeQuotasAdminTestJSON-246520357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:56:36 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-0cbc13c8-829d-4ddd-b467-a6fe676dccae tempest-VolumeQuotasAdminTestJSON-246520357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:56:36 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-0cbc13c8-829d-4ddd-b467-a6fe676dccae tempest-VolumeQuotasAdminTestJSON-246520357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:36 devstack sudo[96757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 15:56:36 devstack sudo[96757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:36 devstack sudo[96753]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:36 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-12435c04-4d7c-472c-b439-c191447d28a6 tempest-VolumesSnapshotTestJSON-1119395226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6945f8cb-aca6-4ada-9615-b2eb533169f3.info" returned: 0 in 0.824s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:36 devstack cinder-volume[87420]: WARNING cinder.volume.drivers.remotefs [None req-12435c04-4d7c-472c-b439-c191447d28a6 tempest-VolumesSnapshotTestJSON-1119395226 None] /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6945f8cb-aca6-4ada-9615-b2eb533169f3.info is being set with open permissions: ugo+rw Jul 10 15:56:36 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-12435c04-4d7c-472c-b439-c191447d28a6 tempest-VolumesSnapshotTestJSON-1119395226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6945f8cb-aca6-4ada-9615-b2eb533169f3.info {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:36 devstack sudo[96760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6945f8cb-aca6-4ada-9615-b2eb533169f3.info Jul 10 15:56:36 devstack sudo[96760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:36 devstack sudo[96757]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:36 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-0cbc13c8-829d-4ddd-b467-a6fe676dccae tempest-VolumeQuotasAdminTestJSON-246520357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.746s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:36 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-0cbc13c8-829d-4ddd-b467-a6fe676dccae tempest-VolumeQuotasAdminTestJSON-246520357 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 15:56:36 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-0cbc13c8-829d-4ddd-b467-a6fe676dccae tempest-VolumeQuotasAdminTestJSON-246520357 None] Deleted volume successfully. Jul 10 15:56:36 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-0cbc13c8-829d-4ddd-b467-a6fe676dccae tempest-VolumeQuotasAdminTestJSON-246520357 None] Lock "cinder-bafbcf1a-fa50-4b78-a1a4-d3e505c6e759-delete_volume" released by "delete_volume" :: held 2.703s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:56:37 devstack sudo[96760]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:37 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-12435c04-4d7c-472c-b439-c191447d28a6 tempest-VolumesSnapshotTestJSON-1119395226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6945f8cb-aca6-4ada-9615-b2eb533169f3.info" returned: 0 in 0.785s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:37 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-12435c04-4d7c-472c-b439-c191447d28a6 tempest-VolumesSnapshotTestJSON-1119395226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.163s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:56:37 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-220d0932-d0d2-4c89-b071-ecd5a14a707a tempest-SnapshotsActionsTest-1918108303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.159s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:56:37 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-220d0932-d0d2-4c89-b071-ecd5a14a707a tempest-SnapshotsActionsTest-1918108303 None] Creating offline snapshot c82764be-b5d5-42d6-9d16-330206b21df6 of volume f2922929-98bb-4fec-bdd5-aad2d7870937 {{(pid=87420) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 15:56:37 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-12435c04-4d7c-472c-b439-c191447d28a6 tempest-VolumesSnapshotTestJSON-1119395226 None] Create snapshot completed successfully Jul 10 15:56:37 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed440a6c-5d79-4fa2-9fd4-cacb1aa1dc93]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:56:37 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-220d0932-d0d2-4c89-b071-ecd5a14a707a tempest-SnapshotsActionsTest-1918108303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.04b64570-a35a-4472-9f73-f425b6bccc9e {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:37 devstack sudo[96764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.04b64570-a35a-4472-9f73-f425b6bccc9e Jul 10 15:56:37 devstack sudo[96764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:38 devstack sudo[96764]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:38 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-220d0932-d0d2-4c89-b071-ecd5a14a707a tempest-SnapshotsActionsTest-1918108303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.04b64570-a35a-4472-9f73-f425b6bccc9e" returned: 0 in 0.855s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:38 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-220d0932-d0d2-4c89-b071-ecd5a14a707a tempest-SnapshotsActionsTest-1918108303 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f2922929-98bb-4fec-bdd5-aad2d7870937(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87420) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 15:56:38 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-220d0932-d0d2-4c89-b071-ecd5a14a707a tempest-SnapshotsActionsTest-1918108303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.04b64570-a35a-4472-9f73-f425b6bccc9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.c82764be-b5d5-42d6-9d16-330206b21df6 1G {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:38 devstack sudo[96770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.04b64570-a35a-4472-9f73-f425b6bccc9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.c82764be-b5d5-42d6-9d16-330206b21df6 1G Jul 10 15:56:38 devstack sudo[96770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:38 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-81d2f754-beed-4938-bc33-6e15da02918a tempest-VolumesMetadataTest-526702337 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 15:56:38 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-81d2f754-beed-4938-bc33-6e15da02918a tempest-VolumesMetadataTest-526702337 None] Flow 'volume_create_manager' (32529b1a-c3d6-4648-a5eb-4d388122e077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:56:38 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-81d2f754-beed-4938-bc33-6e15da02918a tempest-VolumesMetadataTest-526702337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de2780e5-84fa-4fec-a75f-a8beeff2b967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:56:38 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-81d2f754-beed-4938-bc33-6e15da02918a tempest-VolumesMetadataTest-526702337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de2780e5-84fa-4fec-a75f-a8beeff2b967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:56:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-206530797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66634c5e-e350-4459-a727-9c7cd33ece83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a039c208a93f4dbabbd0cf13a80723b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:56:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:56:38Z,use_quota=True,user_id='7d38cc8aaa4641758cd8bfd69de854b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:56:38 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-81d2f754-beed-4938-bc33-6e15da02918a tempest-VolumesMetadataTest-526702337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3feacbec-c37b-4114-b738-48989356eef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:56:38 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-81d2f754-beed-4938-bc33-6e15da02918a tempest-VolumesMetadataTest-526702337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3feacbec-c37b-4114-b738-48989356eef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:56:38 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-81d2f754-beed-4938-bc33-6e15da02918a tempest-VolumesMetadataTest-526702337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd904da7-f707-45b6-9808-d471efbf2926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:56:38 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-81d2f754-beed-4938-bc33-6e15da02918a tempest-VolumesMetadataTest-526702337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd904da7-f707-45b6-9808-d471efbf2926) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66634c5e-e350-4459-a727-9c7cd33ece83', 'volume_name': 'volume-66634c5e-e350-4459-a727-9c7cd33ece83', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:56:38 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-81d2f754-beed-4938-bc33-6e15da02918a tempest-VolumesMetadataTest-526702337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (599e20cb-b6fe-4ecd-8130-621293d11fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:56:38 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-81d2f754-beed-4938-bc33-6e15da02918a tempest-VolumesMetadataTest-526702337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (599e20cb-b6fe-4ecd-8130-621293d11fd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:56:38 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-81d2f754-beed-4938-bc33-6e15da02918a tempest-VolumesMetadataTest-526702337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c79adc8-19b5-42e7-92cf-c95f468749ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:56:38 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-81d2f754-beed-4938-bc33-6e15da02918a tempest-VolumesMetadataTest-526702337 None] Volume 66634c5e-e350-4459-a727-9c7cd33ece83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66634c5e-e350-4459-a727-9c7cd33ece83', 'volume_size': 1} Jul 10 15:56:38 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-81d2f754-beed-4938-bc33-6e15da02918a tempest-VolumesMetadataTest-526702337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:56:38 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-772024fe-e77d-482e-a1ad-9961600c8908 tempest-VolumesSnapshotTestJSON-1119395226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 15:56:38 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-772024fe-e77d-482e-a1ad-9961600c8908 tempest-VolumesSnapshotTestJSON-1119395226 None] Flow 'volume_create_manager' (d0fef4e8-f696-4acd-918c-af434d0f2138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:56:38 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-772024fe-e77d-482e-a1ad-9961600c8908 tempest-VolumesSnapshotTestJSON-1119395226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e8a3335-8fb0-488c-bfe5-b7b000793fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:56:38 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-772024fe-e77d-482e-a1ad-9961600c8908 tempest-VolumesSnapshotTestJSON-1119395226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e8a3335-8fb0-488c-bfe5-b7b000793fdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:56:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-554408220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d622bafa-66dc-47bc-aaff-4eb9fca1f70b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e643cb5b87b247789cb00bccc8c1eae1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:56:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=fcea12fb-4db6-44eb-8681-4156787a41d9,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:56:39Z,use_quota=True,user_id='8975db700f5543579bffa7dd0c86ba88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:56:38 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-772024fe-e77d-482e-a1ad-9961600c8908 tempest-VolumesSnapshotTestJSON-1119395226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (facb4412-5f57-4c37-bf4b-d95aec234625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:56:38 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-772024fe-e77d-482e-a1ad-9961600c8908 tempest-VolumesSnapshotTestJSON-1119395226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (facb4412-5f57-4c37-bf4b-d95aec234625) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:56:38 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-772024fe-e77d-482e-a1ad-9961600c8908 tempest-VolumesSnapshotTestJSON-1119395226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7aad975b-477e-49cd-ba06-203d8c770e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:56:38 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-772024fe-e77d-482e-a1ad-9961600c8908 tempest-VolumesSnapshotTestJSON-1119395226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7aad975b-477e-49cd-ba06-203d8c770e3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd622bafa-66dc-47bc-aaff-4eb9fca1f70b', 'volume_name': 'volume-d622bafa-66dc-47bc-aaff-4eb9fca1f70b', 'volume_size': 1, 'snapshot_id': 'fcea12fb-4db6-44eb-8681-4156787a41d9'}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:56:38 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-772024fe-e77d-482e-a1ad-9961600c8908 tempest-VolumesSnapshotTestJSON-1119395226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72db41f4-2347-49b4-954e-4a6f44a2c413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:56:38 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-772024fe-e77d-482e-a1ad-9961600c8908 tempest-VolumesSnapshotTestJSON-1119395226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72db41f4-2347-49b4-954e-4a6f44a2c413) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:56:38 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-772024fe-e77d-482e-a1ad-9961600c8908 tempest-VolumesSnapshotTestJSON-1119395226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0088b43e-381c-4d00-85ee-82860ef949b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:56:38 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-772024fe-e77d-482e-a1ad-9961600c8908 tempest-VolumesSnapshotTestJSON-1119395226 None] Volume d622bafa-66dc-47bc-aaff-4eb9fca1f70b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d622bafa-66dc-47bc-aaff-4eb9fca1f70b', 'volume_size': 1, 'snapshot_id': 'fcea12fb-4db6-44eb-8681-4156787a41d9'} Jul 10 15:56:38 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-772024fe-e77d-482e-a1ad-9961600c8908 tempest-VolumesSnapshotTestJSON-1119395226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:56:39 devstack sudo[96770]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:39 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-220d0932-d0d2-4c89-b071-ecd5a14a707a tempest-SnapshotsActionsTest-1918108303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.04b64570-a35a-4472-9f73-f425b6bccc9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.c82764be-b5d5-42d6-9d16-330206b21df6 1G" returned: 0 in 1.016s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:39 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-220d0932-d0d2-4c89-b071-ecd5a14a707a tempest-SnapshotsActionsTest-1918108303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2922929-98bb-4fec-bdd5-aad2d7870937.04b64570-a35a-4472-9f73-f425b6bccc9e -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.c82764be-b5d5-42d6-9d16-330206b21df6 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:39 devstack sudo[96776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2922929-98bb-4fec-bdd5-aad2d7870937.04b64570-a35a-4472-9f73-f425b6bccc9e -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.c82764be-b5d5-42d6-9d16-330206b21df6 Jul 10 15:56:39 devstack sudo[96776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:39 devstack sudo[96776]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:39 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-220d0932-d0d2-4c89-b071-ecd5a14a707a tempest-SnapshotsActionsTest-1918108303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2922929-98bb-4fec-bdd5-aad2d7870937.04b64570-a35a-4472-9f73-f425b6bccc9e -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.c82764be-b5d5-42d6-9d16-330206b21df6" returned: 0 in 0.761s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:39 devstack cinder-volume[87420]: WARNING cinder.volume.drivers.remotefs [None req-220d0932-d0d2-4c89-b071-ecd5a14a707a tempest-SnapshotsActionsTest-1918108303 None] /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.c82764be-b5d5-42d6-9d16-330206b21df6 is being set with open permissions: ugo+rw Jul 10 15:56:39 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-220d0932-d0d2-4c89-b071-ecd5a14a707a tempest-SnapshotsActionsTest-1918108303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.c82764be-b5d5-42d6-9d16-330206b21df6 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:40 devstack sudo[96781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.c82764be-b5d5-42d6-9d16-330206b21df6 Jul 10 15:56:40 devstack sudo[96781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:40 devstack sudo[96781]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:40 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-220d0932-d0d2-4c89-b071-ecd5a14a707a tempest-SnapshotsActionsTest-1918108303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.c82764be-b5d5-42d6-9d16-330206b21df6" returned: 0 in 0.741s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:40 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-220d0932-d0d2-4c89-b071-ecd5a14a707a tempest-SnapshotsActionsTest-1918108303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.499s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:56:40 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-81d2f754-beed-4938-bc33-6e15da02918a tempest-VolumesMetadataTest-526702337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.183s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:56:40 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-81d2f754-beed-4938-bc33-6e15da02918a tempest-VolumesMetadataTest-526702337 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:56:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-206530797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66634c5e-e350-4459-a727-9c7cd33ece83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a039c208a93f4dbabbd0cf13a80723b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:56:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:56:38Z,use_quota=True,user_id='7d38cc8aaa4641758cd8bfd69de854b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 15:56:40 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-81d2f754-beed-4938-bc33-6e15da02918a tempest-VolumesMetadataTest-526702337 None] Creating volume 66634c5e-e350-4459-a727-9c7cd33ece83 {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 15:56:40 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-81d2f754-beed-4938-bc33-6e15da02918a tempest-VolumesMetadataTest-526702337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:56:40 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-81d2f754-beed-4938-bc33-6e15da02918a tempest-VolumesMetadataTest-526702337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:56:40 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-81d2f754-beed-4938-bc33-6e15da02918a tempest-VolumesMetadataTest-526702337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:56:40 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-81d2f754-beed-4938-bc33-6e15da02918a tempest-VolumesMetadataTest-526702337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:56:40 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-81d2f754-beed-4938-bc33-6e15da02918a tempest-VolumesMetadataTest-526702337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:56:40 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-81d2f754-beed-4938-bc33-6e15da02918a tempest-VolumesMetadataTest-526702337 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 15:56:40 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-81d2f754-beed-4938-bc33-6e15da02918a tempest-VolumesMetadataTest-526702337 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 15:56:40 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-81d2f754-beed-4938-bc33-6e15da02918a tempest-VolumesMetadataTest-526702337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-66634c5e-e350-4459-a727-9c7cd33ece83 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:40 devstack sudo[96784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-66634c5e-e350-4459-a727-9c7cd33ece83 1073741824 Jul 10 15:56:40 devstack sudo[96784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:40 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-220d0932-d0d2-4c89-b071-ecd5a14a707a tempest-SnapshotsActionsTest-1918108303 None] Create snapshot completed successfully Jul 10 15:56:41 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-05316e83-bf60-412c-802c-a8f3fd81b90c tempest-SnapshotsActionsTest-51400650 None] Acquiring lock "cinder-c82764be-b5d5-42d6-9d16-330206b21df6-delete_snapshot" by "delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:56:41 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-05316e83-bf60-412c-802c-a8f3fd81b90c tempest-SnapshotsActionsTest-51400650 None] Lock "cinder-c82764be-b5d5-42d6-9d16-330206b21df6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:56:41 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-05316e83-bf60-412c-802c-a8f3fd81b90c tempest-SnapshotsActionsTest-51400650 None] Acquiring lock "cinder-quobyte-f2922929-98bb-4fec-bdd5-aad2d7870937" by "delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:56:41 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-05316e83-bf60-412c-802c-a8f3fd81b90c tempest-SnapshotsActionsTest-51400650 None] Lock "cinder-quobyte-f2922929-98bb-4fec-bdd5-aad2d7870937" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:56:41 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-05316e83-bf60-412c-802c-a8f3fd81b90c tempest-SnapshotsActionsTest-51400650 None] Acquiring lock "cinder-quobyte-c82764be-b5d5-42d6-9d16-330206b21df6" by "_delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:56:41 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-05316e83-bf60-412c-802c-a8f3fd81b90c tempest-SnapshotsActionsTest-51400650 None] Lock "cinder-quobyte-c82764be-b5d5-42d6-9d16-330206b21df6" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:56:41 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-05316e83-bf60-412c-802c-a8f3fd81b90c tempest-SnapshotsActionsTest-51400650 None] Deleting offline snapshot c82764be-b5d5-42d6-9d16-330206b21df6 of volume f2922929-98bb-4fec-bdd5-aad2d7870937 {{(pid=87420) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 15:56:41 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-05316e83-bf60-412c-802c-a8f3fd81b90c tempest-SnapshotsActionsTest-51400650 None] snapshot_file for this snap is: volume-f2922929-98bb-4fec-bdd5-aad2d7870937.c82764be-b5d5-42d6-9d16-330206b21df6 {{(pid=87420) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 15:56:41 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[29637497-ef4a-46ea-bc72-73bc3b76cf7c]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:56:41 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-05316e83-bf60-412c-802c-a8f3fd81b90c tempest-SnapshotsActionsTest-51400650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.c82764be-b5d5-42d6-9d16-330206b21df6 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:41 devstack sudo[96790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.c82764be-b5d5-42d6-9d16-330206b21df6 Jul 10 15:56:41 devstack sudo[96790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:41 devstack sudo[96784]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:41 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-81d2f754-beed-4938-bc33-6e15da02918a tempest-VolumesMetadataTest-526702337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-66634c5e-e350-4459-a727-9c7cd33ece83 1073741824" returned: 0 in 0.978s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:41 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-81d2f754-beed-4938-bc33-6e15da02918a tempest-VolumesMetadataTest-526702337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-66634c5e-e350-4459-a727-9c7cd33ece83 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:41 devstack sudo[96792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-66634c5e-e350-4459-a727-9c7cd33ece83 Jul 10 15:56:41 devstack sudo[96792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:42 devstack sudo[96790]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:42 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-05316e83-bf60-412c-802c-a8f3fd81b90c tempest-SnapshotsActionsTest-51400650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.c82764be-b5d5-42d6-9d16-330206b21df6" returned: 0 in 0.816s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:42 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-05316e83-bf60-412c-802c-a8f3fd81b90c tempest-SnapshotsActionsTest-51400650 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f2922929-98bb-4fec-bdd5-aad2d7870937(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87420) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 15:56:42 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4caab91-b60c-4fb8-94d1-fc48320b4686]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:56:42 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-05316e83-bf60-412c-802c-a8f3fd81b90c tempest-SnapshotsActionsTest-51400650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.04b64570-a35a-4472-9f73-f425b6bccc9e {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:42 devstack sudo[96792]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:42 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-81d2f754-beed-4938-bc33-6e15da02918a tempest-VolumesMetadataTest-526702337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-66634c5e-e350-4459-a727-9c7cd33ece83" returned: 0 in 0.701s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:42 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-81d2f754-beed-4938-bc33-6e15da02918a tempest-VolumesMetadataTest-526702337 None] <== create_volume: return (1731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 15:56:42 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-81d2f754-beed-4938-bc33-6e15da02918a tempest-VolumesMetadataTest-526702337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.735s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:56:42 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-772024fe-e77d-482e-a1ad-9961600c8908 tempest-VolumesSnapshotTestJSON-1119395226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.549s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:56:42 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-772024fe-e77d-482e-a1ad-9961600c8908 tempest-VolumesSnapshotTestJSON-1119395226 None] Acquiring lock "cinder-quobyte-fcea12fb-4db6-44eb-8681-4156787a41d9-d622bafa-66dc-47bc-aaff-4eb9fca1f70b" by "_create_volume_from_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:56:42 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-81d2f754-beed-4938-bc33-6e15da02918a tempest-VolumesMetadataTest-526702337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c79adc8-19b5-42e7-92cf-c95f468749ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66634c5e-e350-4459-a727-9c7cd33ece83', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:56:42 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-81d2f754-beed-4938-bc33-6e15da02918a tempest-VolumesMetadataTest-526702337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9611d4ac-67b1-490f-abf9-1fdf7ae4dfcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:56:42 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-772024fe-e77d-482e-a1ad-9961600c8908 tempest-VolumesSnapshotTestJSON-1119395226 None] Lock "cinder-quobyte-fcea12fb-4db6-44eb-8681-4156787a41d9-d622bafa-66dc-47bc-aaff-4eb9fca1f70b" acquired by "_create_volume_from_snapshot" :: waited 0.033s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:56:42 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-772024fe-e77d-482e-a1ad-9961600c8908 tempest-VolumesSnapshotTestJSON-1119395226 None] Creating volume d622bafa-66dc-47bc-aaff-4eb9fca1f70b from snapshot fcea12fb-4db6-44eb-8681-4156787a41d9 {{(pid=87420) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 10 15:56:42 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-772024fe-e77d-482e-a1ad-9961600c8908 tempest-VolumesSnapshotTestJSON-1119395226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:56:42 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-772024fe-e77d-482e-a1ad-9961600c8908 tempest-VolumesSnapshotTestJSON-1119395226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:56:42 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-772024fe-e77d-482e-a1ad-9961600c8908 tempest-VolumesSnapshotTestJSON-1119395226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:56:42 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-772024fe-e77d-482e-a1ad-9961600c8908 tempest-VolumesSnapshotTestJSON-1119395226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:56:42 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-772024fe-e77d-482e-a1ad-9961600c8908 tempest-VolumesSnapshotTestJSON-1119395226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:56:42 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-772024fe-e77d-482e-a1ad-9961600c8908 tempest-VolumesSnapshotTestJSON-1119395226 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 15:56:42 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-772024fe-e77d-482e-a1ad-9961600c8908 tempest-VolumesSnapshotTestJSON-1119395226 None] Acquiring lock "cinder-quobyte-d622bafa-66dc-47bc-aaff-4eb9fca1f70b" by "_copy_volume_from_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:56:42 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-81d2f754-beed-4938-bc33-6e15da02918a tempest-VolumesMetadataTest-526702337 None] Volume volume-66634c5e-e350-4459-a727-9c7cd33ece83 (66634c5e-e350-4459-a727-9c7cd33ece83): created successfully Jul 10 15:56:42 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-81d2f754-beed-4938-bc33-6e15da02918a tempest-VolumesMetadataTest-526702337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9611d4ac-67b1-490f-abf9-1fdf7ae4dfcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:56:42 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-81d2f754-beed-4938-bc33-6e15da02918a tempest-VolumesMetadataTest-526702337 None] Flow 'volume_create_manager' (32529b1a-c3d6-4648-a5eb-4d388122e077) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:56:42 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-772024fe-e77d-482e-a1ad-9961600c8908 tempest-VolumesSnapshotTestJSON-1119395226 None] Lock "cinder-quobyte-d622bafa-66dc-47bc-aaff-4eb9fca1f70b" acquired by "_copy_volume_from_snapshot" :: waited 0.055s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:56:42 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-772024fe-e77d-482e-a1ad-9961600c8908 tempest-VolumesSnapshotTestJSON-1119395226 None] snapshot: fcea12fb-4db6-44eb-8681-4156787a41d9, volume: d622bafa-66dc-47bc-aaff-4eb9fca1f70b, {{(pid=87420) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 15:56:42 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-81d2f754-beed-4938-bc33-6e15da02918a tempest-VolumesMetadataTest-526702337 None] Created volume successfully. Jul 10 15:56:42 devstack sudo[96798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.04b64570-a35a-4472-9f73-f425b6bccc9e Jul 10 15:56:42 devstack sudo[96798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:42 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-772024fe-e77d-482e-a1ad-9961600c8908 tempest-VolumesSnapshotTestJSON-1119395226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:56:42 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-772024fe-e77d-482e-a1ad-9961600c8908 tempest-VolumesSnapshotTestJSON-1119395226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:56:42 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-772024fe-e77d-482e-a1ad-9961600c8908 tempest-VolumesSnapshotTestJSON-1119395226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:56:42 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-772024fe-e77d-482e-a1ad-9961600c8908 tempest-VolumesSnapshotTestJSON-1119395226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:56:42 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-772024fe-e77d-482e-a1ad-9961600c8908 tempest-VolumesSnapshotTestJSON-1119395226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:56:42 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[6080a3f6-bfe2-44e5-9343-08a81ee4585f]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:56:42 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-772024fe-e77d-482e-a1ad-9961600c8908 tempest-VolumesSnapshotTestJSON-1119395226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6945f8cb-aca6-4ada-9615-b2eb533169f3.fcea12fb-4db6-44eb-8681-4156787a41d9 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:42 devstack sudo[96800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6945f8cb-aca6-4ada-9615-b2eb533169f3.fcea12fb-4db6-44eb-8681-4156787a41d9 Jul 10 15:56:42 devstack sudo[96800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:43 devstack sudo[96798]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:43 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-05316e83-bf60-412c-802c-a8f3fd81b90c tempest-SnapshotsActionsTest-51400650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.04b64570-a35a-4472-9f73-f425b6bccc9e" returned: 0 in 1.038s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:43 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-05316e83-bf60-412c-802c-a8f3fd81b90c tempest-SnapshotsActionsTest-51400650 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f2922929-98bb-4fec-bdd5-aad2d7870937(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87420) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 15:56:43 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-05316e83-bf60-412c-802c-a8f3fd81b90c tempest-SnapshotsActionsTest-51400650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.c82764be-b5d5-42d6-9d16-330206b21df6 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:43 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-d14218cc-a942-4fb8-a2f7-733c613a1d74 tempest-VolumesMetadataTest-526702337 None] Acquiring lock "cinder-66634c5e-e350-4459-a727-9c7cd33ece83-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:56:43 devstack sudo[96806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.c82764be-b5d5-42d6-9d16-330206b21df6 Jul 10 15:56:43 devstack sudo[96806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:43 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-d14218cc-a942-4fb8-a2f7-733c613a1d74 tempest-VolumesMetadataTest-526702337 None] Lock "cinder-66634c5e-e350-4459-a727-9c7cd33ece83-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:56:43 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-d14218cc-a942-4fb8-a2f7-733c613a1d74 tempest-VolumesMetadataTest-526702337 None] Acquiring lock "cinder-quobyte-66634c5e-e350-4459-a727-9c7cd33ece83" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:56:43 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-d14218cc-a942-4fb8-a2f7-733c613a1d74 tempest-VolumesMetadataTest-526702337 None] Lock "cinder-quobyte-66634c5e-e350-4459-a727-9c7cd33ece83" acquired by "delete_volume" :: waited 0.023s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:56:43 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[575248a9-eb67-42fe-9f8e-ec0d7169f111]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:56:43 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d14218cc-a942-4fb8-a2f7-733c613a1d74 tempest-VolumesMetadataTest-526702337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-66634c5e-e350-4459-a727-9c7cd33ece83 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:43 devstack sudo[96800]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:43 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-772024fe-e77d-482e-a1ad-9961600c8908 tempest-VolumesSnapshotTestJSON-1119395226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6945f8cb-aca6-4ada-9615-b2eb533169f3.fcea12fb-4db6-44eb-8681-4156787a41d9" returned: 0 in 1.088s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:43 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-772024fe-e77d-482e-a1ad-9961600c8908 tempest-VolumesSnapshotTestJSON-1119395226 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6945f8cb-aca6-4ada-9615-b2eb533169f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87420) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 15:56:43 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-772024fe-e77d-482e-a1ad-9961600c8908 tempest-VolumesSnapshotTestJSON-1119395226 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6945f8cb-aca6-4ada-9615-b2eb533169f3 {{(pid=87420) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 15:56:43 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-772024fe-e77d-482e-a1ad-9961600c8908 tempest-VolumesSnapshotTestJSON-1119395226 None] Creating direct copy from snapshot {{(pid=87420) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 15:56:43 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc38042-7fed-477f-9918-198951a465e8]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:56:43 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-772024fe-e77d-482e-a1ad-9961600c8908 tempest-VolumesSnapshotTestJSON-1119395226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6945f8cb-aca6-4ada-9615-b2eb533169f3 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:43 devstack sudo[96811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-66634c5e-e350-4459-a727-9c7cd33ece83 Jul 10 15:56:43 devstack sudo[96811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:43 devstack sudo[96812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6945f8cb-aca6-4ada-9615-b2eb533169f3 Jul 10 15:56:43 devstack sudo[96812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:44 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-97ba3c0a-daa7-4e83-a1c6-6b36ccc00260 tempest-VolumesServicesTestJSON-245805332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 15:56:44 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-97ba3c0a-daa7-4e83-a1c6-6b36ccc00260 tempest-VolumesServicesTestJSON-245805332 None] Flow 'volume_create_manager' (ceaad00c-707e-4e27-b1a0-c8eedfd14490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:56:44 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-97ba3c0a-daa7-4e83-a1c6-6b36ccc00260 tempest-VolumesServicesTestJSON-245805332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2757789-e829-43f0-99a2-9f1c80863aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:56:44 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-97ba3c0a-daa7-4e83-a1c6-6b36ccc00260 tempest-VolumesServicesTestJSON-245805332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2757789-e829-43f0-99a2-9f1c80863aaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:56:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-2121689839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73185248-b0c8-4268-8e83-50582cc4171c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f460cc9ac2442219cb0844da66ca22a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:56:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:56:44Z,use_quota=True,user_id='2cc8bcd6c8124fc694aab9c3cad7d81f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:56:44 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-97ba3c0a-daa7-4e83-a1c6-6b36ccc00260 tempest-VolumesServicesTestJSON-245805332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a84812a-ff0f-4837-b45d-cc2bad854ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:56:44 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-97ba3c0a-daa7-4e83-a1c6-6b36ccc00260 tempest-VolumesServicesTestJSON-245805332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a84812a-ff0f-4837-b45d-cc2bad854ab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:56:44 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-97ba3c0a-daa7-4e83-a1c6-6b36ccc00260 tempest-VolumesServicesTestJSON-245805332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74c2d759-5a59-40b1-bbdc-f6613841cd81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:56:44 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-97ba3c0a-daa7-4e83-a1c6-6b36ccc00260 tempest-VolumesServicesTestJSON-245805332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74c2d759-5a59-40b1-bbdc-f6613841cd81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73185248-b0c8-4268-8e83-50582cc4171c', 'volume_name': 'volume-73185248-b0c8-4268-8e83-50582cc4171c', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:56:44 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-97ba3c0a-daa7-4e83-a1c6-6b36ccc00260 tempest-VolumesServicesTestJSON-245805332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7152cb30-12a8-4bea-a5b3-ec388c06b36a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:56:44 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-97ba3c0a-daa7-4e83-a1c6-6b36ccc00260 tempest-VolumesServicesTestJSON-245805332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7152cb30-12a8-4bea-a5b3-ec388c06b36a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:56:44 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-97ba3c0a-daa7-4e83-a1c6-6b36ccc00260 tempest-VolumesServicesTestJSON-245805332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1211f73e-fb1c-46a4-a5ab-ccbb83c566ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:56:44 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-97ba3c0a-daa7-4e83-a1c6-6b36ccc00260 tempest-VolumesServicesTestJSON-245805332 None] Volume 73185248-b0c8-4268-8e83-50582cc4171c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73185248-b0c8-4268-8e83-50582cc4171c', 'volume_size': 1} Jul 10 15:56:44 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-97ba3c0a-daa7-4e83-a1c6-6b36ccc00260 tempest-VolumesServicesTestJSON-245805332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:56:44 devstack sudo[96806]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:44 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-05316e83-bf60-412c-802c-a8f3fd81b90c tempest-SnapshotsActionsTest-51400650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.c82764be-b5d5-42d6-9d16-330206b21df6" returned: 0 in 0.945s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:44 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-05316e83-bf60-412c-802c-a8f3fd81b90c tempest-SnapshotsActionsTest-51400650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.c82764be-b5d5-42d6-9d16-330206b21df6 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:44 devstack sudo[96820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.c82764be-b5d5-42d6-9d16-330206b21df6 Jul 10 15:56:44 devstack sudo[96820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:44 devstack sudo[96811]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:44 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d14218cc-a942-4fb8-a2f7-733c613a1d74 tempest-VolumesMetadataTest-526702337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-66634c5e-e350-4459-a727-9c7cd33ece83" returned: 0 in 0.893s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:44 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d14218cc-a942-4fb8-a2f7-733c613a1d74 tempest-VolumesMetadataTest-526702337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-66634c5e-e350-4459-a727-9c7cd33ece83 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:44 devstack sudo[96826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-66634c5e-e350-4459-a727-9c7cd33ece83 Jul 10 15:56:44 devstack sudo[96826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:44 devstack sudo[96812]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:44 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-772024fe-e77d-482e-a1ad-9961600c8908 tempest-VolumesSnapshotTestJSON-1119395226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6945f8cb-aca6-4ada-9615-b2eb533169f3" returned: 0 in 0.964s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:44 devstack cinder-volume[87420]: DEBUG cinder.utils [None req-772024fe-e77d-482e-a1ad-9961600c8908 tempest-VolumesSnapshotTestJSON-1119395226 None] Path /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d622bafa-66dc-47bc-aaff-4eb9fca1f70b not found in is_blk_device check {{(pid=87420) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 15:56:44 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-772024fe-e77d-482e-a1ad-9961600c8908 tempest-VolumesSnapshotTestJSON-1119395226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6945f8cb-aca6-4ada-9615-b2eb533169f3 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d622bafa-66dc-47bc-aaff-4eb9fca1f70b {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:44 devstack sudo[96835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6945f8cb-aca6-4ada-9615-b2eb533169f3 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d622bafa-66dc-47bc-aaff-4eb9fca1f70b Jul 10 15:56:44 devstack sudo[96835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:45 devstack sudo[96820]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:45 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-05316e83-bf60-412c-802c-a8f3fd81b90c tempest-SnapshotsActionsTest-51400650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.c82764be-b5d5-42d6-9d16-330206b21df6" returned: 0 in 0.695s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:45 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-05316e83-bf60-412c-802c-a8f3fd81b90c tempest-SnapshotsActionsTest-51400650 None] Lock "cinder-quobyte-c82764be-b5d5-42d6-9d16-330206b21df6" released by "_delete_snapshot" :: held 3.616s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:56:45 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-05316e83-bf60-412c-802c-a8f3fd81b90c tempest-SnapshotsActionsTest-51400650 None] Lock "cinder-quobyte-f2922929-98bb-4fec-bdd5-aad2d7870937" released by "delete_snapshot" :: held 3.641s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:56:45 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-05316e83-bf60-412c-802c-a8f3fd81b90c tempest-SnapshotsActionsTest-51400650 None] Created reservations ['34da64ca-f8e9-422f-a7c9-2a2a3a9e682b', 'bd28edea-161f-4ff5-ab26-3af2e7289a71', '39782bcf-44aa-4e49-977d-0ea9511db3c4', 'ea167452-083b-4761-896a-b6901ef4af02'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 15:56:45 devstack sudo[96826]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:45 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d14218cc-a942-4fb8-a2f7-733c613a1d74 tempest-VolumesMetadataTest-526702337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-66634c5e-e350-4459-a727-9c7cd33ece83" returned: 0 in 0.718s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:45 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-d14218cc-a942-4fb8-a2f7-733c613a1d74 tempest-VolumesMetadataTest-526702337 None] Lock "cinder-quobyte-66634c5e-e350-4459-a727-9c7cd33ece83" released by "delete_volume" :: held 1.664s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:56:45 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-05316e83-bf60-412c-802c-a8f3fd81b90c tempest-SnapshotsActionsTest-51400650 None] Delete snapshot completed successfully. Jul 10 15:56:45 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-05316e83-bf60-412c-802c-a8f3fd81b90c tempest-SnapshotsActionsTest-51400650 None] Lock "cinder-c82764be-b5d5-42d6-9d16-330206b21df6-delete_snapshot" released by "delete_snapshot" :: held 3.837s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:56:45 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-d14218cc-a942-4fb8-a2f7-733c613a1d74 tempest-VolumesMetadataTest-526702337 None] Created reservations ['68ecdc37-3feb-4a6d-8286-2d63e379cec2', '52733e00-aa81-45a6-bfb8-146f301762d1', 'af056901-2b1f-4640-8e57-7ba56c81c6d7', '6fbcb51c-1caf-45ac-8437-f2a6064ed274'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 15:56:45 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-d14218cc-a942-4fb8-a2f7-733c613a1d74 tempest-VolumesMetadataTest-526702337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:56:45 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-d14218cc-a942-4fb8-a2f7-733c613a1d74 tempest-VolumesMetadataTest-526702337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:56:45 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-d14218cc-a942-4fb8-a2f7-733c613a1d74 tempest-VolumesMetadataTest-526702337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:56:45 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-d14218cc-a942-4fb8-a2f7-733c613a1d74 tempest-VolumesMetadataTest-526702337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:56:45 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-d14218cc-a942-4fb8-a2f7-733c613a1d74 tempest-VolumesMetadataTest-526702337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:56:45 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d14218cc-a942-4fb8-a2f7-733c613a1d74 tempest-VolumesMetadataTest-526702337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:45 devstack sudo[96842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 15:56:45 devstack sudo[96842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:46 devstack sudo[96842]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:46 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d14218cc-a942-4fb8-a2f7-733c613a1d74 tempest-VolumesMetadataTest-526702337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 1.225s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:46 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-d14218cc-a942-4fb8-a2f7-733c613a1d74 tempest-VolumesMetadataTest-526702337 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 15:56:46 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-d14218cc-a942-4fb8-a2f7-733c613a1d74 tempest-VolumesMetadataTest-526702337 None] Deleted volume successfully. Jul 10 15:56:46 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-d14218cc-a942-4fb8-a2f7-733c613a1d74 tempest-VolumesMetadataTest-526702337 None] Lock "cinder-66634c5e-e350-4459-a727-9c7cd33ece83-delete_volume" released by "delete_volume" :: held 3.245s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:56:47 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-7a79ebdd-f049-457f-b6f0-9c25d36ef977 tempest-SnapshotsActionsTest-1918108303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:56:50 devstack sudo[96835]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:50 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-772024fe-e77d-482e-a1ad-9961600c8908 tempest-VolumesSnapshotTestJSON-1119395226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6945f8cb-aca6-4ada-9615-b2eb533169f3 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d622bafa-66dc-47bc-aaff-4eb9fca1f70b" returned: 0 in 5.489s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:50 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6c90ab3-2ace-414e-9771-5b223f0d4e25]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:56:50 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-772024fe-e77d-482e-a1ad-9961600c8908 tempest-VolumesSnapshotTestJSON-1119395226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6945f8cb-aca6-4ada-9615-b2eb533169f3 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:50 devstack sudo[96853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6945f8cb-aca6-4ada-9615-b2eb533169f3 Jul 10 15:56:50 devstack sudo[96853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:51 devstack sudo[96853]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:51 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-772024fe-e77d-482e-a1ad-9961600c8908 tempest-VolumesSnapshotTestJSON-1119395226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6945f8cb-aca6-4ada-9615-b2eb533169f3" returned: 0 in 0.994s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:51 devstack cinder-volume[87420]: DEBUG cinder.image.image_utils [None req-772024fe-e77d-482e-a1ad-9961600c8908 tempest-VolumesSnapshotTestJSON-1119395226 None] Image conversion details: src /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6945f8cb-aca6-4ada-9615-b2eb533169f3, size 1024.00 MB, duration 5.49 sec, destination /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d622bafa-66dc-47bc-aaff-4eb9fca1f70b {{(pid=87420) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 15:56:51 devstack cinder-volume[87420]: INFO cinder.image.image_utils [None req-772024fe-e77d-482e-a1ad-9961600c8908 tempest-VolumesSnapshotTestJSON-1119395226 None] Converted 1024.00 MB image at 186.53 MB/s Jul 10 15:56:51 devstack cinder-volume[87420]: WARNING cinder.volume.drivers.remotefs [None req-772024fe-e77d-482e-a1ad-9961600c8908 tempest-VolumesSnapshotTestJSON-1119395226 None] /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d622bafa-66dc-47bc-aaff-4eb9fca1f70b is being set with open permissions: ugo+rw Jul 10 15:56:51 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-772024fe-e77d-482e-a1ad-9961600c8908 tempest-VolumesSnapshotTestJSON-1119395226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d622bafa-66dc-47bc-aaff-4eb9fca1f70b {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:51 devstack sudo[96858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d622bafa-66dc-47bc-aaff-4eb9fca1f70b Jul 10 15:56:51 devstack sudo[96858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:51 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-4731204f-cd1f-412b-8331-ad80284b6534 tempest-VolumesCloneNegativeTest-1095028282 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 15:56:51 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-4731204f-cd1f-412b-8331-ad80284b6534 tempest-VolumesCloneNegativeTest-1095028282 None] Flow 'volume_create_manager' (32e9a27b-6878-4551-9370-518d727dd05c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:56:51 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-4731204f-cd1f-412b-8331-ad80284b6534 tempest-VolumesCloneNegativeTest-1095028282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e33e7ef-2a6b-4a1c-b001-165e98f9b260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:56:51 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-4731204f-cd1f-412b-8331-ad80284b6534 tempest-VolumesCloneNegativeTest-1095028282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e33e7ef-2a6b-4a1c-b001-165e98f9b260) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:56:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-2014308337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9f89989-619a-4b5c-9997-445ae612552d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe0f66f3008f4c3ca2620693fb633e7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:56:51Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:56:51Z,use_quota=True,user_id='b66e5fb6b7a6471f8308a149d11ccb54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:56:51 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-4731204f-cd1f-412b-8331-ad80284b6534 tempest-VolumesCloneNegativeTest-1095028282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f2acf93-7974-4a5f-974e-79deabc08ccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:56:51 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-4731204f-cd1f-412b-8331-ad80284b6534 tempest-VolumesCloneNegativeTest-1095028282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f2acf93-7974-4a5f-974e-79deabc08ccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:56:51 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-4731204f-cd1f-412b-8331-ad80284b6534 tempest-VolumesCloneNegativeTest-1095028282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a28d299-32d1-4b91-82d3-4a82344b2a8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:56:51 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-4731204f-cd1f-412b-8331-ad80284b6534 tempest-VolumesCloneNegativeTest-1095028282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a28d299-32d1-4b91-82d3-4a82344b2a8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9f89989-619a-4b5c-9997-445ae612552d', 'volume_name': 'volume-e9f89989-619a-4b5c-9997-445ae612552d', 'volume_size': 2}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:56:51 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-4731204f-cd1f-412b-8331-ad80284b6534 tempest-VolumesCloneNegativeTest-1095028282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (762043ef-e579-4c96-9e0d-5a1c8c08e8b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:56:51 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-4731204f-cd1f-412b-8331-ad80284b6534 tempest-VolumesCloneNegativeTest-1095028282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (762043ef-e579-4c96-9e0d-5a1c8c08e8b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:56:51 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-4731204f-cd1f-412b-8331-ad80284b6534 tempest-VolumesCloneNegativeTest-1095028282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca39f459-5f50-4f0e-92f1-fea14f5d0551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:56:51 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-4731204f-cd1f-412b-8331-ad80284b6534 tempest-VolumesCloneNegativeTest-1095028282 None] Volume e9f89989-619a-4b5c-9997-445ae612552d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9f89989-619a-4b5c-9997-445ae612552d', 'volume_size': 2} Jul 10 15:56:51 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-4731204f-cd1f-412b-8331-ad80284b6534 tempest-VolumesCloneNegativeTest-1095028282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:56:51 devstack sudo[96858]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:51 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-772024fe-e77d-482e-a1ad-9961600c8908 tempest-VolumesSnapshotTestJSON-1119395226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d622bafa-66dc-47bc-aaff-4eb9fca1f70b" returned: 0 in 0.634s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:51 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-772024fe-e77d-482e-a1ad-9961600c8908 tempest-VolumesSnapshotTestJSON-1119395226 None] Lock "cinder-quobyte-d622bafa-66dc-47bc-aaff-4eb9fca1f70b" released by "_copy_volume_from_snapshot" :: held 9.319s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:56:51 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-772024fe-e77d-482e-a1ad-9961600c8908 tempest-VolumesSnapshotTestJSON-1119395226 None] Lock "cinder-quobyte-fcea12fb-4db6-44eb-8681-4156787a41d9-d622bafa-66dc-47bc-aaff-4eb9fca1f70b" released by "_create_volume_from_snapshot" :: held 9.396s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:56:51 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-772024fe-e77d-482e-a1ad-9961600c8908 tempest-VolumesSnapshotTestJSON-1119395226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.431s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:56:51 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-97ba3c0a-daa7-4e83-a1c6-6b36ccc00260 tempest-VolumesServicesTestJSON-245805332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.537s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:56:51 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-97ba3c0a-daa7-4e83-a1c6-6b36ccc00260 tempest-VolumesServicesTestJSON-245805332 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:56:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-2121689839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73185248-b0c8-4268-8e83-50582cc4171c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f460cc9ac2442219cb0844da66ca22a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:56:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:56:44Z,use_quota=True,user_id='2cc8bcd6c8124fc694aab9c3cad7d81f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 15:56:51 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-97ba3c0a-daa7-4e83-a1c6-6b36ccc00260 tempest-VolumesServicesTestJSON-245805332 None] Creating volume 73185248-b0c8-4268-8e83-50582cc4171c {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 15:56:51 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-97ba3c0a-daa7-4e83-a1c6-6b36ccc00260 tempest-VolumesServicesTestJSON-245805332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:56:51 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-97ba3c0a-daa7-4e83-a1c6-6b36ccc00260 tempest-VolumesServicesTestJSON-245805332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:56:51 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-97ba3c0a-daa7-4e83-a1c6-6b36ccc00260 tempest-VolumesServicesTestJSON-245805332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:56:51 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-97ba3c0a-daa7-4e83-a1c6-6b36ccc00260 tempest-VolumesServicesTestJSON-245805332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:56:51 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-97ba3c0a-daa7-4e83-a1c6-6b36ccc00260 tempest-VolumesServicesTestJSON-245805332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:56:51 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-97ba3c0a-daa7-4e83-a1c6-6b36ccc00260 tempest-VolumesServicesTestJSON-245805332 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 15:56:51 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-97ba3c0a-daa7-4e83-a1c6-6b36ccc00260 tempest-VolumesServicesTestJSON-245805332 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 15:56:51 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-97ba3c0a-daa7-4e83-a1c6-6b36ccc00260 tempest-VolumesServicesTestJSON-245805332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-73185248-b0c8-4268-8e83-50582cc4171c 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:51 devstack sudo[96861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-73185248-b0c8-4268-8e83-50582cc4171c 1073741824 Jul 10 15:56:51 devstack sudo[96861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:51 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-772024fe-e77d-482e-a1ad-9961600c8908 tempest-VolumesSnapshotTestJSON-1119395226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0088b43e-381c-4d00-85ee-82860ef949b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d622bafa-66dc-47bc-aaff-4eb9fca1f70b', 'volume_size': 1, 'snapshot_id': 'fcea12fb-4db6-44eb-8681-4156787a41d9'}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:56:51 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-772024fe-e77d-482e-a1ad-9961600c8908 tempest-VolumesSnapshotTestJSON-1119395226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de468bfc-f7d1-48a3-affc-e7e883a15e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:56:52 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-772024fe-e77d-482e-a1ad-9961600c8908 tempest-VolumesSnapshotTestJSON-1119395226 None] Volume volume-d622bafa-66dc-47bc-aaff-4eb9fca1f70b (d622bafa-66dc-47bc-aaff-4eb9fca1f70b): created successfully Jul 10 15:56:52 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-772024fe-e77d-482e-a1ad-9961600c8908 tempest-VolumesSnapshotTestJSON-1119395226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de468bfc-f7d1-48a3-affc-e7e883a15e12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:56:52 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-772024fe-e77d-482e-a1ad-9961600c8908 tempest-VolumesSnapshotTestJSON-1119395226 None] Flow 'volume_create_manager' (d0fef4e8-f696-4acd-918c-af434d0f2138) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:56:52 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-772024fe-e77d-482e-a1ad-9961600c8908 tempest-VolumesSnapshotTestJSON-1119395226 None] Created volume successfully. Jul 10 15:56:52 devstack sudo[96861]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:52 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-97ba3c0a-daa7-4e83-a1c6-6b36ccc00260 tempest-VolumesServicesTestJSON-245805332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-73185248-b0c8-4268-8e83-50582cc4171c 1073741824" returned: 0 in 0.807s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:52 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-97ba3c0a-daa7-4e83-a1c6-6b36ccc00260 tempest-VolumesServicesTestJSON-245805332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-73185248-b0c8-4268-8e83-50582cc4171c {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:52 devstack sudo[96867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-73185248-b0c8-4268-8e83-50582cc4171c Jul 10 15:56:52 devstack sudo[96867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:53 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-17d9ac82-abde-42ae-8a54-d2b94da8a098 tempest-VolumesSnapshotTestJSON-1119395226 None] Acquiring lock "cinder-d622bafa-66dc-47bc-aaff-4eb9fca1f70b-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:56:53 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-17d9ac82-abde-42ae-8a54-d2b94da8a098 tempest-VolumesSnapshotTestJSON-1119395226 None] Lock "cinder-d622bafa-66dc-47bc-aaff-4eb9fca1f70b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:56:53 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-17d9ac82-abde-42ae-8a54-d2b94da8a098 tempest-VolumesSnapshotTestJSON-1119395226 None] Acquiring lock "cinder-quobyte-d622bafa-66dc-47bc-aaff-4eb9fca1f70b" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:56:53 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-17d9ac82-abde-42ae-8a54-d2b94da8a098 tempest-VolumesSnapshotTestJSON-1119395226 None] Lock "cinder-quobyte-d622bafa-66dc-47bc-aaff-4eb9fca1f70b" acquired by "delete_volume" :: waited 0.030s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:56:53 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[febb0584-c7b3-4ce2-b305-360580cd23ed]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:56:53 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-17d9ac82-abde-42ae-8a54-d2b94da8a098 tempest-VolumesSnapshotTestJSON-1119395226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d622bafa-66dc-47bc-aaff-4eb9fca1f70b {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:53 devstack sudo[96867]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:53 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-97ba3c0a-daa7-4e83-a1c6-6b36ccc00260 tempest-VolumesServicesTestJSON-245805332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-73185248-b0c8-4268-8e83-50582cc4171c" returned: 0 in 0.647s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:53 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-97ba3c0a-daa7-4e83-a1c6-6b36ccc00260 tempest-VolumesServicesTestJSON-245805332 None] <== create_volume: return (1492ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 15:56:53 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-97ba3c0a-daa7-4e83-a1c6-6b36ccc00260 tempest-VolumesServicesTestJSON-245805332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.496s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:56:53 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-7a79ebdd-f049-457f-b6f0-9c25d36ef977 tempest-SnapshotsActionsTest-1918108303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.419s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:56:53 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-97ba3c0a-daa7-4e83-a1c6-6b36ccc00260 tempest-VolumesServicesTestJSON-245805332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1211f73e-fb1c-46a4-a5ab-ccbb83c566ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73185248-b0c8-4268-8e83-50582cc4171c', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:56:53 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-97ba3c0a-daa7-4e83-a1c6-6b36ccc00260 tempest-VolumesServicesTestJSON-245805332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bf04ddc-a598-4d66-96d6-5009c2ffae6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:56:53 devstack sudo[96871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d622bafa-66dc-47bc-aaff-4eb9fca1f70b Jul 10 15:56:53 devstack sudo[96871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:53 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-7a79ebdd-f049-457f-b6f0-9c25d36ef977 tempest-SnapshotsActionsTest-1918108303 None] Creating offline snapshot c92e82d0-a65a-4bc4-bac9-0986870d2c98 of volume f2922929-98bb-4fec-bdd5-aad2d7870937 {{(pid=87420) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 15:56:53 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-97ba3c0a-daa7-4e83-a1c6-6b36ccc00260 tempest-VolumesServicesTestJSON-245805332 None] Volume volume-73185248-b0c8-4268-8e83-50582cc4171c (73185248-b0c8-4268-8e83-50582cc4171c): created successfully Jul 10 15:56:53 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-97ba3c0a-daa7-4e83-a1c6-6b36ccc00260 tempest-VolumesServicesTestJSON-245805332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bf04ddc-a598-4d66-96d6-5009c2ffae6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:56:53 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-97ba3c0a-daa7-4e83-a1c6-6b36ccc00260 tempest-VolumesServicesTestJSON-245805332 None] Flow 'volume_create_manager' (ceaad00c-707e-4e27-b1a0-c8eedfd14490) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:56:53 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed0f782b-bfdf-45b0-890b-c02990080296]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:56:53 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-7a79ebdd-f049-457f-b6f0-9c25d36ef977 tempest-SnapshotsActionsTest-1918108303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.04b64570-a35a-4472-9f73-f425b6bccc9e {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:53 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-97ba3c0a-daa7-4e83-a1c6-6b36ccc00260 tempest-VolumesServicesTestJSON-245805332 None] Created volume successfully. Jul 10 15:56:53 devstack sudo[96873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.04b64570-a35a-4472-9f73-f425b6bccc9e Jul 10 15:56:53 devstack sudo[96873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:54 devstack sudo[96871]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:54 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-17d9ac82-abde-42ae-8a54-d2b94da8a098 tempest-VolumesSnapshotTestJSON-1119395226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d622bafa-66dc-47bc-aaff-4eb9fca1f70b" returned: 0 in 0.755s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:54 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-17d9ac82-abde-42ae-8a54-d2b94da8a098 tempest-VolumesSnapshotTestJSON-1119395226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d622bafa-66dc-47bc-aaff-4eb9fca1f70b {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:54 devstack sudo[96878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d622bafa-66dc-47bc-aaff-4eb9fca1f70b Jul 10 15:56:54 devstack sudo[96878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:54 devstack sudo[96873]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:54 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-7a79ebdd-f049-457f-b6f0-9c25d36ef977 tempest-SnapshotsActionsTest-1918108303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.04b64570-a35a-4472-9f73-f425b6bccc9e" returned: 0 in 0.762s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:54 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-7a79ebdd-f049-457f-b6f0-9c25d36ef977 tempest-SnapshotsActionsTest-1918108303 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f2922929-98bb-4fec-bdd5-aad2d7870937(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87420) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 15:56:54 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-7a79ebdd-f049-457f-b6f0-9c25d36ef977 tempest-SnapshotsActionsTest-1918108303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.04b64570-a35a-4472-9f73-f425b6bccc9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.c92e82d0-a65a-4bc4-bac9-0986870d2c98 1G {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:54 devstack sudo[96883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.04b64570-a35a-4472-9f73-f425b6bccc9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.c92e82d0-a65a-4bc4-bac9-0986870d2c98 1G Jul 10 15:56:54 devstack sudo[96883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:54 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-26d13380-f0d1-4ed0-bd95-972ec659874d tempest-VolumesServicesTestJSON-245805332 None] Acquiring lock "cinder-73185248-b0c8-4268-8e83-50582cc4171c-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:56:54 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-26d13380-f0d1-4ed0-bd95-972ec659874d tempest-VolumesServicesTestJSON-245805332 None] Lock "cinder-73185248-b0c8-4268-8e83-50582cc4171c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:56:54 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-26d13380-f0d1-4ed0-bd95-972ec659874d tempest-VolumesServicesTestJSON-245805332 None] Acquiring lock "cinder-quobyte-73185248-b0c8-4268-8e83-50582cc4171c" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:56:54 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-26d13380-f0d1-4ed0-bd95-972ec659874d tempest-VolumesServicesTestJSON-245805332 None] Lock "cinder-quobyte-73185248-b0c8-4268-8e83-50582cc4171c" acquired by "delete_volume" :: waited 0.015s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:56:54 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[29d7f056-8c88-4e5f-bcb0-e1f72292d148]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:56:54 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-26d13380-f0d1-4ed0-bd95-972ec659874d tempest-VolumesServicesTestJSON-245805332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-73185248-b0c8-4268-8e83-50582cc4171c {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:54 devstack sudo[96878]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:54 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-17d9ac82-abde-42ae-8a54-d2b94da8a098 tempest-VolumesSnapshotTestJSON-1119395226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d622bafa-66dc-47bc-aaff-4eb9fca1f70b" returned: 0 in 0.675s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:54 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-17d9ac82-abde-42ae-8a54-d2b94da8a098 tempest-VolumesSnapshotTestJSON-1119395226 None] Lock "cinder-quobyte-d622bafa-66dc-47bc-aaff-4eb9fca1f70b" released by "delete_volume" :: held 1.485s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:56:54 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-17d9ac82-abde-42ae-8a54-d2b94da8a098 tempest-VolumesSnapshotTestJSON-1119395226 None] Created reservations ['47aeec20-2f2e-4e5b-9b69-a9db112ca2a1', 'b97b5e02-5eef-4e91-aeac-b053d00b8808', '0937413f-740a-432d-a28a-1d2e64527571', '62a40980-40e3-4f95-aefb-a8559117f1de'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 15:56:54 devstack sudo[96886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-73185248-b0c8-4268-8e83-50582cc4171c Jul 10 15:56:54 devstack sudo[96886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:54 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-17d9ac82-abde-42ae-8a54-d2b94da8a098 tempest-VolumesSnapshotTestJSON-1119395226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:56:54 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-17d9ac82-abde-42ae-8a54-d2b94da8a098 tempest-VolumesSnapshotTestJSON-1119395226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:56:54 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-17d9ac82-abde-42ae-8a54-d2b94da8a098 tempest-VolumesSnapshotTestJSON-1119395226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:56:54 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-17d9ac82-abde-42ae-8a54-d2b94da8a098 tempest-VolumesSnapshotTestJSON-1119395226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:56:54 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-17d9ac82-abde-42ae-8a54-d2b94da8a098 tempest-VolumesSnapshotTestJSON-1119395226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:56:54 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-17d9ac82-abde-42ae-8a54-d2b94da8a098 tempest-VolumesSnapshotTestJSON-1119395226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:54 devstack sudo[96888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 15:56:54 devstack sudo[96888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:55 devstack sudo[96883]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:55 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-7a79ebdd-f049-457f-b6f0-9c25d36ef977 tempest-SnapshotsActionsTest-1918108303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.04b64570-a35a-4472-9f73-f425b6bccc9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.c92e82d0-a65a-4bc4-bac9-0986870d2c98 1G" returned: 0 in 0.946s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:55 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-7a79ebdd-f049-457f-b6f0-9c25d36ef977 tempest-SnapshotsActionsTest-1918108303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2922929-98bb-4fec-bdd5-aad2d7870937.04b64570-a35a-4472-9f73-f425b6bccc9e -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.c92e82d0-a65a-4bc4-bac9-0986870d2c98 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:55 devstack sudo[96894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2922929-98bb-4fec-bdd5-aad2d7870937.04b64570-a35a-4472-9f73-f425b6bccc9e -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.c92e82d0-a65a-4bc4-bac9-0986870d2c98 Jul 10 15:56:55 devstack sudo[96894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:55 devstack sudo[96888]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:55 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-17d9ac82-abde-42ae-8a54-d2b94da8a098 tempest-VolumesSnapshotTestJSON-1119395226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.679s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:55 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-17d9ac82-abde-42ae-8a54-d2b94da8a098 tempest-VolumesSnapshotTestJSON-1119395226 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 15:56:55 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-17d9ac82-abde-42ae-8a54-d2b94da8a098 tempest-VolumesSnapshotTestJSON-1119395226 None] Deleted volume successfully. Jul 10 15:56:55 devstack sudo[96886]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:55 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-26d13380-f0d1-4ed0-bd95-972ec659874d tempest-VolumesServicesTestJSON-245805332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-73185248-b0c8-4268-8e83-50582cc4171c" returned: 0 in 0.889s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:55 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-26d13380-f0d1-4ed0-bd95-972ec659874d tempest-VolumesServicesTestJSON-245805332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-73185248-b0c8-4268-8e83-50582cc4171c {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:55 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-a0e48140-f53f-437d-9871-2d1e9db55328 tempest-VolumesSnapshotTestJSON-1119395226 None] Acquiring lock "cinder-fcea12fb-4db6-44eb-8681-4156787a41d9-delete_snapshot" by "delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:56:55 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-17d9ac82-abde-42ae-8a54-d2b94da8a098 tempest-VolumesSnapshotTestJSON-1119395226 None] Lock "cinder-d622bafa-66dc-47bc-aaff-4eb9fca1f70b-delete_volume" released by "delete_volume" :: held 2.426s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:56:55 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-a0e48140-f53f-437d-9871-2d1e9db55328 tempest-VolumesSnapshotTestJSON-1119395226 None] Lock "cinder-fcea12fb-4db6-44eb-8681-4156787a41d9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:56:55 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-a0e48140-f53f-437d-9871-2d1e9db55328 tempest-VolumesSnapshotTestJSON-1119395226 None] Acquiring lock "cinder-quobyte-6945f8cb-aca6-4ada-9615-b2eb533169f3" by "delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:56:55 devstack sudo[96900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-73185248-b0c8-4268-8e83-50582cc4171c Jul 10 15:56:55 devstack sudo[96900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:55 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-a0e48140-f53f-437d-9871-2d1e9db55328 tempest-VolumesSnapshotTestJSON-1119395226 None] Lock "cinder-quobyte-6945f8cb-aca6-4ada-9615-b2eb533169f3" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:56:55 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-a0e48140-f53f-437d-9871-2d1e9db55328 tempest-VolumesSnapshotTestJSON-1119395226 None] Acquiring lock "cinder-quobyte-fcea12fb-4db6-44eb-8681-4156787a41d9" by "_delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:56:55 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-a0e48140-f53f-437d-9871-2d1e9db55328 tempest-VolumesSnapshotTestJSON-1119395226 None] Lock "cinder-quobyte-fcea12fb-4db6-44eb-8681-4156787a41d9" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:56:55 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-a0e48140-f53f-437d-9871-2d1e9db55328 tempest-VolumesSnapshotTestJSON-1119395226 None] Deleting offline snapshot fcea12fb-4db6-44eb-8681-4156787a41d9 of volume 6945f8cb-aca6-4ada-9615-b2eb533169f3 {{(pid=87420) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 15:56:55 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-a0e48140-f53f-437d-9871-2d1e9db55328 tempest-VolumesSnapshotTestJSON-1119395226 None] snapshot_file for this snap is: volume-6945f8cb-aca6-4ada-9615-b2eb533169f3.fcea12fb-4db6-44eb-8681-4156787a41d9 {{(pid=87420) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 15:56:55 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c766803-6684-4583-9084-0a6022c6a25d]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:56:55 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a0e48140-f53f-437d-9871-2d1e9db55328 tempest-VolumesSnapshotTestJSON-1119395226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6945f8cb-aca6-4ada-9615-b2eb533169f3.fcea12fb-4db6-44eb-8681-4156787a41d9 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:55 devstack sudo[96902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6945f8cb-aca6-4ada-9615-b2eb533169f3.fcea12fb-4db6-44eb-8681-4156787a41d9 Jul 10 15:56:55 devstack sudo[96902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:56 devstack sudo[96894]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:56 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-7a79ebdd-f049-457f-b6f0-9c25d36ef977 tempest-SnapshotsActionsTest-1918108303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2922929-98bb-4fec-bdd5-aad2d7870937.04b64570-a35a-4472-9f73-f425b6bccc9e -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.c92e82d0-a65a-4bc4-bac9-0986870d2c98" returned: 0 in 0.774s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:56 devstack cinder-volume[87420]: WARNING cinder.volume.drivers.remotefs [None req-7a79ebdd-f049-457f-b6f0-9c25d36ef977 tempest-SnapshotsActionsTest-1918108303 None] /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.c92e82d0-a65a-4bc4-bac9-0986870d2c98 is being set with open permissions: ugo+rw Jul 10 15:56:56 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-7a79ebdd-f049-457f-b6f0-9c25d36ef977 tempest-SnapshotsActionsTest-1918108303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.c92e82d0-a65a-4bc4-bac9-0986870d2c98 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:56 devstack sudo[96907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.c92e82d0-a65a-4bc4-bac9-0986870d2c98 Jul 10 15:56:56 devstack sudo[96907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:56 devstack sudo[96900]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:56 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-26d13380-f0d1-4ed0-bd95-972ec659874d tempest-VolumesServicesTestJSON-245805332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-73185248-b0c8-4268-8e83-50582cc4171c" returned: 0 in 0.707s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:56 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-26d13380-f0d1-4ed0-bd95-972ec659874d tempest-VolumesServicesTestJSON-245805332 None] Lock "cinder-quobyte-73185248-b0c8-4268-8e83-50582cc4171c" released by "delete_volume" :: held 1.646s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:56:56 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-26d13380-f0d1-4ed0-bd95-972ec659874d tempest-VolumesServicesTestJSON-245805332 None] Created reservations ['01de2227-47b5-4a20-89c8-85b9bf1195ce', 'ed73c538-d1d4-4996-b633-2fc85a3886be', '4688c1da-2e04-47b1-b677-1fd74ba81891', 'cc009b42-0941-4e22-a440-6878624084ae'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 15:56:56 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-26d13380-f0d1-4ed0-bd95-972ec659874d tempest-VolumesServicesTestJSON-245805332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:56:56 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-26d13380-f0d1-4ed0-bd95-972ec659874d tempest-VolumesServicesTestJSON-245805332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:56:56 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-26d13380-f0d1-4ed0-bd95-972ec659874d tempest-VolumesServicesTestJSON-245805332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:56:56 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-26d13380-f0d1-4ed0-bd95-972ec659874d tempest-VolumesServicesTestJSON-245805332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:56:56 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-26d13380-f0d1-4ed0-bd95-972ec659874d tempest-VolumesServicesTestJSON-245805332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:56:56 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-26d13380-f0d1-4ed0-bd95-972ec659874d tempest-VolumesServicesTestJSON-245805332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:56 devstack sudo[96913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 15:56:56 devstack sudo[96913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:56 devstack sudo[96902]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:56 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a0e48140-f53f-437d-9871-2d1e9db55328 tempest-VolumesSnapshotTestJSON-1119395226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6945f8cb-aca6-4ada-9615-b2eb533169f3.fcea12fb-4db6-44eb-8681-4156787a41d9" returned: 0 in 0.850s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:56 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-a0e48140-f53f-437d-9871-2d1e9db55328 tempest-VolumesSnapshotTestJSON-1119395226 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6945f8cb-aca6-4ada-9615-b2eb533169f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87420) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 15:56:56 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a7fbfd-be8a-402a-8ca2-34641c25eccc]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:56:56 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a0e48140-f53f-437d-9871-2d1e9db55328 tempest-VolumesSnapshotTestJSON-1119395226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6945f8cb-aca6-4ada-9615-b2eb533169f3 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:56 devstack sudo[96907]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:56 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-7a79ebdd-f049-457f-b6f0-9c25d36ef977 tempest-SnapshotsActionsTest-1918108303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.c92e82d0-a65a-4bc4-bac9-0986870d2c98" returned: 0 in 0.671s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:56 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-7a79ebdd-f049-457f-b6f0-9c25d36ef977 tempest-SnapshotsActionsTest-1918108303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.308s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:56:56 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-4731204f-cd1f-412b-8331-ad80284b6534 tempest-VolumesCloneNegativeTest-1095028282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.351s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:56:56 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-4731204f-cd1f-412b-8331-ad80284b6534 tempest-VolumesCloneNegativeTest-1095028282 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:56:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-2014308337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9f89989-619a-4b5c-9997-445ae612552d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe0f66f3008f4c3ca2620693fb633e7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:56:51Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:56:51Z,use_quota=True,user_id='b66e5fb6b7a6471f8308a149d11ccb54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 15:56:56 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-4731204f-cd1f-412b-8331-ad80284b6534 tempest-VolumesCloneNegativeTest-1095028282 None] Creating volume e9f89989-619a-4b5c-9997-445ae612552d {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 15:56:56 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-4731204f-cd1f-412b-8331-ad80284b6534 tempest-VolumesCloneNegativeTest-1095028282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:56:56 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-4731204f-cd1f-412b-8331-ad80284b6534 tempest-VolumesCloneNegativeTest-1095028282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:56:56 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-4731204f-cd1f-412b-8331-ad80284b6534 tempest-VolumesCloneNegativeTest-1095028282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:56:56 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-4731204f-cd1f-412b-8331-ad80284b6534 tempest-VolumesCloneNegativeTest-1095028282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:56:56 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-4731204f-cd1f-412b-8331-ad80284b6534 tempest-VolumesCloneNegativeTest-1095028282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:56:56 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-4731204f-cd1f-412b-8331-ad80284b6534 tempest-VolumesCloneNegativeTest-1095028282 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 15:56:56 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-4731204f-cd1f-412b-8331-ad80284b6534 tempest-VolumesCloneNegativeTest-1095028282 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 15:56:56 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4731204f-cd1f-412b-8331-ad80284b6534 tempest-VolumesCloneNegativeTest-1095028282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-e9f89989-619a-4b5c-9997-445ae612552d 2147483648 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:56 devstack sudo[96916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6945f8cb-aca6-4ada-9615-b2eb533169f3 Jul 10 15:56:56 devstack sudo[96916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:56 devstack sudo[96917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-e9f89989-619a-4b5c-9997-445ae612552d 2147483648 Jul 10 15:56:56 devstack sudo[96917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:56 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-7a79ebdd-f049-457f-b6f0-9c25d36ef977 tempest-SnapshotsActionsTest-1918108303 None] Create snapshot completed successfully Jul 10 15:56:57 devstack sudo[96913]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:57 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-26d13380-f0d1-4ed0-bd95-972ec659874d tempest-VolumesServicesTestJSON-245805332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.723s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:57 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-26d13380-f0d1-4ed0-bd95-972ec659874d tempest-VolumesServicesTestJSON-245805332 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 15:56:57 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-26d13380-f0d1-4ed0-bd95-972ec659874d tempest-VolumesServicesTestJSON-245805332 None] Deleted volume successfully. Jul 10 15:56:57 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-26d13380-f0d1-4ed0-bd95-972ec659874d tempest-VolumesServicesTestJSON-245805332 None] Lock "cinder-73185248-b0c8-4268-8e83-50582cc4171c-delete_volume" released by "delete_volume" :: held 2.607s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:56:57 devstack sudo[96916]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:57 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a0e48140-f53f-437d-9871-2d1e9db55328 tempest-VolumesSnapshotTestJSON-1119395226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6945f8cb-aca6-4ada-9615-b2eb533169f3" returned: 0 in 0.853s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:57 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a0e48140-f53f-437d-9871-2d1e9db55328 tempest-VolumesSnapshotTestJSON-1119395226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6945f8cb-aca6-4ada-9615-b2eb533169f3.fcea12fb-4db6-44eb-8681-4156787a41d9 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:57 devstack sudo[96929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6945f8cb-aca6-4ada-9615-b2eb533169f3.fcea12fb-4db6-44eb-8681-4156787a41d9 Jul 10 15:56:57 devstack sudo[96929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:57 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-a5d343c1-2d47-4f07-b8d6-a80c34f0bfa3 tempest-SnapshotsActionsTest-51400650 None] Acquiring lock "cinder-c92e82d0-a65a-4bc4-bac9-0986870d2c98-delete_snapshot" by "delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:56:57 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-a5d343c1-2d47-4f07-b8d6-a80c34f0bfa3 tempest-SnapshotsActionsTest-51400650 None] Lock "cinder-c92e82d0-a65a-4bc4-bac9-0986870d2c98-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:56:57 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-a5d343c1-2d47-4f07-b8d6-a80c34f0bfa3 tempest-SnapshotsActionsTest-51400650 None] Acquiring lock "cinder-quobyte-f2922929-98bb-4fec-bdd5-aad2d7870937" by "delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:56:57 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-a5d343c1-2d47-4f07-b8d6-a80c34f0bfa3 tempest-SnapshotsActionsTest-51400650 None] Lock "cinder-quobyte-f2922929-98bb-4fec-bdd5-aad2d7870937" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:56:57 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-a5d343c1-2d47-4f07-b8d6-a80c34f0bfa3 tempest-SnapshotsActionsTest-51400650 None] Acquiring lock "cinder-quobyte-c92e82d0-a65a-4bc4-bac9-0986870d2c98" by "_delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:56:57 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-a5d343c1-2d47-4f07-b8d6-a80c34f0bfa3 tempest-SnapshotsActionsTest-51400650 None] Lock "cinder-quobyte-c92e82d0-a65a-4bc4-bac9-0986870d2c98" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:56:57 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-a5d343c1-2d47-4f07-b8d6-a80c34f0bfa3 tempest-SnapshotsActionsTest-51400650 None] Deleting offline snapshot c92e82d0-a65a-4bc4-bac9-0986870d2c98 of volume f2922929-98bb-4fec-bdd5-aad2d7870937 {{(pid=87420) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 15:56:57 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-a5d343c1-2d47-4f07-b8d6-a80c34f0bfa3 tempest-SnapshotsActionsTest-51400650 None] snapshot_file for this snap is: volume-f2922929-98bb-4fec-bdd5-aad2d7870937.c92e82d0-a65a-4bc4-bac9-0986870d2c98 {{(pid=87420) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 15:56:57 devstack sudo[96917]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:57 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4731204f-cd1f-412b-8331-ad80284b6534 tempest-VolumesCloneNegativeTest-1095028282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-e9f89989-619a-4b5c-9997-445ae612552d 2147483648" returned: 0 in 1.083s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:57 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[aae35dee-2ac6-4e56-8ce9-d38fe43feac0]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:56:57 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a5d343c1-2d47-4f07-b8d6-a80c34f0bfa3 tempest-SnapshotsActionsTest-51400650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.c92e82d0-a65a-4bc4-bac9-0986870d2c98 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:57 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4731204f-cd1f-412b-8331-ad80284b6534 tempest-VolumesCloneNegativeTest-1095028282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-e9f89989-619a-4b5c-9997-445ae612552d {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:57 devstack sudo[96932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-e9f89989-619a-4b5c-9997-445ae612552d Jul 10 15:56:57 devstack sudo[96932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:57 devstack sudo[96931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.c92e82d0-a65a-4bc4-bac9-0986870d2c98 Jul 10 15:56:57 devstack sudo[96931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:58 devstack sudo[96929]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:58 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a0e48140-f53f-437d-9871-2d1e9db55328 tempest-VolumesSnapshotTestJSON-1119395226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6945f8cb-aca6-4ada-9615-b2eb533169f3.fcea12fb-4db6-44eb-8681-4156787a41d9" returned: 0 in 0.892s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:58 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a0e48140-f53f-437d-9871-2d1e9db55328 tempest-VolumesSnapshotTestJSON-1119395226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6945f8cb-aca6-4ada-9615-b2eb533169f3.fcea12fb-4db6-44eb-8681-4156787a41d9 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:58 devstack sudo[96938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6945f8cb-aca6-4ada-9615-b2eb533169f3.fcea12fb-4db6-44eb-8681-4156787a41d9 Jul 10 15:56:58 devstack sudo[96938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:58 devstack sudo[96932]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:58 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4731204f-cd1f-412b-8331-ad80284b6534 tempest-VolumesCloneNegativeTest-1095028282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-e9f89989-619a-4b5c-9997-445ae612552d" returned: 0 in 0.795s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:58 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-4731204f-cd1f-412b-8331-ad80284b6534 tempest-VolumesCloneNegativeTest-1095028282 None] <== create_volume: return (1959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 15:56:58 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-4731204f-cd1f-412b-8331-ad80284b6534 tempest-VolumesCloneNegativeTest-1095028282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.962s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:56:58 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-4731204f-cd1f-412b-8331-ad80284b6534 tempest-VolumesCloneNegativeTest-1095028282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca39f459-5f50-4f0e-92f1-fea14f5d0551) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9f89989-619a-4b5c-9997-445ae612552d', 'volume_size': 2}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:56:58 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-4731204f-cd1f-412b-8331-ad80284b6534 tempest-VolumesCloneNegativeTest-1095028282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a19607ee-9cda-4e85-b81e-36d7cff26dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:56:58 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-4731204f-cd1f-412b-8331-ad80284b6534 tempest-VolumesCloneNegativeTest-1095028282 None] Volume volume-e9f89989-619a-4b5c-9997-445ae612552d (e9f89989-619a-4b5c-9997-445ae612552d): created successfully Jul 10 15:56:58 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-4731204f-cd1f-412b-8331-ad80284b6534 tempest-VolumesCloneNegativeTest-1095028282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a19607ee-9cda-4e85-b81e-36d7cff26dd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:56:58 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-4731204f-cd1f-412b-8331-ad80284b6534 tempest-VolumesCloneNegativeTest-1095028282 None] Flow 'volume_create_manager' (32e9a27b-6878-4551-9370-518d727dd05c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:56:58 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-4731204f-cd1f-412b-8331-ad80284b6534 tempest-VolumesCloneNegativeTest-1095028282 None] Created volume successfully. Jul 10 15:56:58 devstack sudo[96931]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:58 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a5d343c1-2d47-4f07-b8d6-a80c34f0bfa3 tempest-SnapshotsActionsTest-51400650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.c92e82d0-a65a-4bc4-bac9-0986870d2c98" returned: 0 in 0.980s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:58 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-a5d343c1-2d47-4f07-b8d6-a80c34f0bfa3 tempest-SnapshotsActionsTest-51400650 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f2922929-98bb-4fec-bdd5-aad2d7870937(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87420) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 15:56:58 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6795bef-a855-4ca3-be95-1ad800b78fac]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:56:58 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a5d343c1-2d47-4f07-b8d6-a80c34f0bfa3 tempest-SnapshotsActionsTest-51400650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.04b64570-a35a-4472-9f73-f425b6bccc9e {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:58 devstack sudo[96945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.04b64570-a35a-4472-9f73-f425b6bccc9e Jul 10 15:56:58 devstack sudo[96945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:56:59 devstack sudo[96938]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:59 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a0e48140-f53f-437d-9871-2d1e9db55328 tempest-VolumesSnapshotTestJSON-1119395226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6945f8cb-aca6-4ada-9615-b2eb533169f3.fcea12fb-4db6-44eb-8681-4156787a41d9" returned: 0 in 0.806s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:59 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-a0e48140-f53f-437d-9871-2d1e9db55328 tempest-VolumesSnapshotTestJSON-1119395226 None] Lock "cinder-quobyte-fcea12fb-4db6-44eb-8681-4156787a41d9" released by "_delete_snapshot" :: held 3.537s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:56:59 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-a0e48140-f53f-437d-9871-2d1e9db55328 tempest-VolumesSnapshotTestJSON-1119395226 None] Lock "cinder-quobyte-6945f8cb-aca6-4ada-9615-b2eb533169f3" released by "delete_snapshot" :: held 3.565s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:56:59 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-a0e48140-f53f-437d-9871-2d1e9db55328 tempest-VolumesSnapshotTestJSON-1119395226 None] Created reservations ['6526ba52-1f56-4b37-92d9-529aa8f6c422', '71fe7ce8-69e9-4a15-93b4-29dcf6c5575e', '132611ff-f301-4d91-a79b-7cd58e6e6dad', 'a0bc04e5-1560-4782-bd46-dd5fa7d8a345'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 15:56:59 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-a0e48140-f53f-437d-9871-2d1e9db55328 tempest-VolumesSnapshotTestJSON-1119395226 None] Delete snapshot completed successfully. Jul 10 15:56:59 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-a0e48140-f53f-437d-9871-2d1e9db55328 tempest-VolumesSnapshotTestJSON-1119395226 None] Lock "cinder-fcea12fb-4db6-44eb-8681-4156787a41d9-delete_snapshot" released by "delete_snapshot" :: held 3.713s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:56:59 devstack sudo[96945]: pam_unix(sudo:session): session closed for user root Jul 10 15:56:59 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a5d343c1-2d47-4f07-b8d6-a80c34f0bfa3 tempest-SnapshotsActionsTest-51400650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.04b64570-a35a-4472-9f73-f425b6bccc9e" returned: 0 in 0.820s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:56:59 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-a5d343c1-2d47-4f07-b8d6-a80c34f0bfa3 tempest-SnapshotsActionsTest-51400650 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f2922929-98bb-4fec-bdd5-aad2d7870937(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87420) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 15:56:59 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a5d343c1-2d47-4f07-b8d6-a80c34f0bfa3 tempest-SnapshotsActionsTest-51400650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.c92e82d0-a65a-4bc4-bac9-0986870d2c98 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:56:59 devstack sudo[96951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.c92e82d0-a65a-4bc4-bac9-0986870d2c98 Jul 10 15:56:59 devstack sudo[96951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:57:00 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-641844d4-1bb5-4bbf-a1ae-57a03d71f106 tempest-VolumesSnapshotTestJSON-1119395226 None] Acquiring lock "cinder-6945f8cb-aca6-4ada-9615-b2eb533169f3-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:57:00 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-641844d4-1bb5-4bbf-a1ae-57a03d71f106 tempest-VolumesSnapshotTestJSON-1119395226 None] Lock "cinder-6945f8cb-aca6-4ada-9615-b2eb533169f3-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:57:00 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-1aa43b7d-13e6-46e8-b1dc-fec5e230a742 tempest-VolumesCloneNegativeTest-1095028282 None] Acquiring lock "cinder-e9f89989-619a-4b5c-9997-445ae612552d-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:57:00 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-1aa43b7d-13e6-46e8-b1dc-fec5e230a742 tempest-VolumesCloneNegativeTest-1095028282 None] Lock "cinder-e9f89989-619a-4b5c-9997-445ae612552d-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:57:00 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-641844d4-1bb5-4bbf-a1ae-57a03d71f106 tempest-VolumesSnapshotTestJSON-1119395226 None] Acquiring lock "cinder-quobyte-6945f8cb-aca6-4ada-9615-b2eb533169f3" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:57:00 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-641844d4-1bb5-4bbf-a1ae-57a03d71f106 tempest-VolumesSnapshotTestJSON-1119395226 None] Lock "cinder-quobyte-6945f8cb-aca6-4ada-9615-b2eb533169f3" acquired by "delete_volume" :: waited 0.025s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:57:00 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-1aa43b7d-13e6-46e8-b1dc-fec5e230a742 tempest-VolumesCloneNegativeTest-1095028282 None] Acquiring lock "cinder-quobyte-e9f89989-619a-4b5c-9997-445ae612552d" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:57:00 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[630b9fdb-01af-48f1-8eb5-30d463821547]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:57:00 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-641844d4-1bb5-4bbf-a1ae-57a03d71f106 tempest-VolumesSnapshotTestJSON-1119395226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6945f8cb-aca6-4ada-9615-b2eb533169f3 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:57:00 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-1aa43b7d-13e6-46e8-b1dc-fec5e230a742 tempest-VolumesCloneNegativeTest-1095028282 None] Lock "cinder-quobyte-e9f89989-619a-4b5c-9997-445ae612552d" acquired by "delete_volume" :: waited 0.029s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:57:00 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[20cf2a96-41fd-4d01-82fd-34954f1351bd]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:57:00 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-1aa43b7d-13e6-46e8-b1dc-fec5e230a742 tempest-VolumesCloneNegativeTest-1095028282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-e9f89989-619a-4b5c-9997-445ae612552d {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:57:00 devstack sudo[96953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6945f8cb-aca6-4ada-9615-b2eb533169f3 Jul 10 15:57:00 devstack sudo[96953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:57:00 devstack sudo[96954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-e9f89989-619a-4b5c-9997-445ae612552d Jul 10 15:57:00 devstack sudo[96954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:57:00 devstack sudo[96951]: pam_unix(sudo:session): session closed for user root Jul 10 15:57:00 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a5d343c1-2d47-4f07-b8d6-a80c34f0bfa3 tempest-SnapshotsActionsTest-51400650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.c92e82d0-a65a-4bc4-bac9-0986870d2c98" returned: 0 in 0.967s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:57:00 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a5d343c1-2d47-4f07-b8d6-a80c34f0bfa3 tempest-SnapshotsActionsTest-51400650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.c92e82d0-a65a-4bc4-bac9-0986870d2c98 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:57:00 devstack sudo[96961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.c92e82d0-a65a-4bc4-bac9-0986870d2c98 Jul 10 15:57:00 devstack sudo[96961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:57:01 devstack sudo[96953]: pam_unix(sudo:session): session closed for user root Jul 10 15:57:01 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-641844d4-1bb5-4bbf-a1ae-57a03d71f106 tempest-VolumesSnapshotTestJSON-1119395226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6945f8cb-aca6-4ada-9615-b2eb533169f3" returned: 0 in 0.935s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:57:01 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-641844d4-1bb5-4bbf-a1ae-57a03d71f106 tempest-VolumesSnapshotTestJSON-1119395226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6945f8cb-aca6-4ada-9615-b2eb533169f3 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:57:01 devstack sudo[96969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6945f8cb-aca6-4ada-9615-b2eb533169f3 Jul 10 15:57:01 devstack sudo[96969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:57:01 devstack sudo[96954]: pam_unix(sudo:session): session closed for user root Jul 10 15:57:01 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-1aa43b7d-13e6-46e8-b1dc-fec5e230a742 tempest-VolumesCloneNegativeTest-1095028282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-e9f89989-619a-4b5c-9997-445ae612552d" returned: 0 in 0.931s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:57:01 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-1aa43b7d-13e6-46e8-b1dc-fec5e230a742 tempest-VolumesCloneNegativeTest-1095028282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-e9f89989-619a-4b5c-9997-445ae612552d {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:57:01 devstack sudo[96971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-e9f89989-619a-4b5c-9997-445ae612552d Jul 10 15:57:01 devstack sudo[96971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:57:01 devstack sudo[96961]: pam_unix(sudo:session): session closed for user root Jul 10 15:57:01 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a5d343c1-2d47-4f07-b8d6-a80c34f0bfa3 tempest-SnapshotsActionsTest-51400650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.c92e82d0-a65a-4bc4-bac9-0986870d2c98" returned: 0 in 0.740s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:57:01 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-a5d343c1-2d47-4f07-b8d6-a80c34f0bfa3 tempest-SnapshotsActionsTest-51400650 None] Lock "cinder-quobyte-c92e82d0-a65a-4bc4-bac9-0986870d2c98" released by "_delete_snapshot" :: held 3.629s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:57:01 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-a5d343c1-2d47-4f07-b8d6-a80c34f0bfa3 tempest-SnapshotsActionsTest-51400650 None] Lock "cinder-quobyte-f2922929-98bb-4fec-bdd5-aad2d7870937" released by "delete_snapshot" :: held 3.666s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:57:01 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-a5d343c1-2d47-4f07-b8d6-a80c34f0bfa3 tempest-SnapshotsActionsTest-51400650 None] Created reservations ['77ee3ff8-df4d-42b5-ade4-0432d8247eec', '579a578d-4291-4c2d-a0f2-7e8607f46040', '94b0ffec-9db5-4c17-b9cf-b6d174cf2088', '054c8527-cc88-4304-935c-1f67436c2e6d'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 15:57:01 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-a5d343c1-2d47-4f07-b8d6-a80c34f0bfa3 tempest-SnapshotsActionsTest-51400650 None] Delete snapshot completed successfully. Jul 10 15:57:01 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-a5d343c1-2d47-4f07-b8d6-a80c34f0bfa3 tempest-SnapshotsActionsTest-51400650 None] Lock "cinder-c92e82d0-a65a-4bc4-bac9-0986870d2c98-delete_snapshot" released by "delete_snapshot" :: held 3.906s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:57:01 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b759f8b-ae08-4bfd-87ec-95e121b1e92a tempest-SnapshotMetadataTestJSON-658352555 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 15:57:01 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-8b759f8b-ae08-4bfd-87ec-95e121b1e92a tempest-SnapshotMetadataTestJSON-658352555 None] Flow 'volume_create_manager' (536ebd9a-7f85-4ab4-9ee6-a8368377fa7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:57:01 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-8b759f8b-ae08-4bfd-87ec-95e121b1e92a tempest-SnapshotMetadataTestJSON-658352555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d25f81c-1821-4dbc-bea6-89a14fee78b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:57:01 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-8b759f8b-ae08-4bfd-87ec-95e121b1e92a tempest-SnapshotMetadataTestJSON-658352555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d25f81c-1821-4dbc-bea6-89a14fee78b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:57:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-117040873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1628609-3369-45cb-9a79-9504df81c0f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66d82f3bbc584890a13e57e584999ef2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:57:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:57:02Z,use_quota=True,user_id='a7a4b57fa70c4060b5119edca8e17267',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:57:01 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-8b759f8b-ae08-4bfd-87ec-95e121b1e92a tempest-SnapshotMetadataTestJSON-658352555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1fcb36d-91a3-4bf2-b18d-ecbd7b2fcb0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:57:01 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-8b759f8b-ae08-4bfd-87ec-95e121b1e92a tempest-SnapshotMetadataTestJSON-658352555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1fcb36d-91a3-4bf2-b18d-ecbd7b2fcb0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:57:01 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-8b759f8b-ae08-4bfd-87ec-95e121b1e92a tempest-SnapshotMetadataTestJSON-658352555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1644bdbd-b146-42f9-adde-511e04bd714b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:57:01 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-8b759f8b-ae08-4bfd-87ec-95e121b1e92a tempest-SnapshotMetadataTestJSON-658352555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1644bdbd-b146-42f9-adde-511e04bd714b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1628609-3369-45cb-9a79-9504df81c0f6', 'volume_name': 'volume-d1628609-3369-45cb-9a79-9504df81c0f6', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:57:01 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-8b759f8b-ae08-4bfd-87ec-95e121b1e92a tempest-SnapshotMetadataTestJSON-658352555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90461bb7-4781-4d77-a32e-f676c7e8becc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:57:01 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-8b759f8b-ae08-4bfd-87ec-95e121b1e92a tempest-SnapshotMetadataTestJSON-658352555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90461bb7-4781-4d77-a32e-f676c7e8becc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:57:01 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-8b759f8b-ae08-4bfd-87ec-95e121b1e92a tempest-SnapshotMetadataTestJSON-658352555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (951e2e9b-4577-442a-8e70-de586a323a8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:57:01 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-8b759f8b-ae08-4bfd-87ec-95e121b1e92a tempest-SnapshotMetadataTestJSON-658352555 None] Volume d1628609-3369-45cb-9a79-9504df81c0f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1628609-3369-45cb-9a79-9504df81c0f6', 'volume_size': 1} Jul 10 15:57:01 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-8b759f8b-ae08-4bfd-87ec-95e121b1e92a tempest-SnapshotMetadataTestJSON-658352555 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:57:01 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-8b759f8b-ae08-4bfd-87ec-95e121b1e92a tempest-SnapshotMetadataTestJSON-658352555 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:57:01 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-8b759f8b-ae08-4bfd-87ec-95e121b1e92a tempest-SnapshotMetadataTestJSON-658352555 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:57:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-117040873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1628609-3369-45cb-9a79-9504df81c0f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66d82f3bbc584890a13e57e584999ef2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:57:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:57:02Z,use_quota=True,user_id='a7a4b57fa70c4060b5119edca8e17267',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 15:57:01 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-8b759f8b-ae08-4bfd-87ec-95e121b1e92a tempest-SnapshotMetadataTestJSON-658352555 None] Creating volume d1628609-3369-45cb-9a79-9504df81c0f6 {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 15:57:01 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-8b759f8b-ae08-4bfd-87ec-95e121b1e92a tempest-SnapshotMetadataTestJSON-658352555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:57:01 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-8b759f8b-ae08-4bfd-87ec-95e121b1e92a tempest-SnapshotMetadataTestJSON-658352555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:57:01 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-8b759f8b-ae08-4bfd-87ec-95e121b1e92a tempest-SnapshotMetadataTestJSON-658352555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:57:01 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-8b759f8b-ae08-4bfd-87ec-95e121b1e92a tempest-SnapshotMetadataTestJSON-658352555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:57:01 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-8b759f8b-ae08-4bfd-87ec-95e121b1e92a tempest-SnapshotMetadataTestJSON-658352555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:57:01 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-8b759f8b-ae08-4bfd-87ec-95e121b1e92a tempest-SnapshotMetadataTestJSON-658352555 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 15:57:01 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-8b759f8b-ae08-4bfd-87ec-95e121b1e92a tempest-SnapshotMetadataTestJSON-658352555 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 15:57:01 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8b759f8b-ae08-4bfd-87ec-95e121b1e92a tempest-SnapshotMetadataTestJSON-658352555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d1628609-3369-45cb-9a79-9504df81c0f6 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:57:01 devstack sudo[96974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d1628609-3369-45cb-9a79-9504df81c0f6 1073741824 Jul 10 15:57:01 devstack sudo[96974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:57:02 devstack sudo[96969]: pam_unix(sudo:session): session closed for user root Jul 10 15:57:02 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-641844d4-1bb5-4bbf-a1ae-57a03d71f106 tempest-VolumesSnapshotTestJSON-1119395226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6945f8cb-aca6-4ada-9615-b2eb533169f3" returned: 0 in 0.865s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:57:02 devstack sudo[96971]: pam_unix(sudo:session): session closed for user root Jul 10 15:57:02 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-1aa43b7d-13e6-46e8-b1dc-fec5e230a742 tempest-VolumesCloneNegativeTest-1095028282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-e9f89989-619a-4b5c-9997-445ae612552d" returned: 0 in 0.845s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:57:02 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-641844d4-1bb5-4bbf-a1ae-57a03d71f106 tempest-VolumesSnapshotTestJSON-1119395226 None] Lock "cinder-quobyte-6945f8cb-aca6-4ada-9615-b2eb533169f3" released by "delete_volume" :: held 1.891s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:57:02 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-1aa43b7d-13e6-46e8-b1dc-fec5e230a742 tempest-VolumesCloneNegativeTest-1095028282 None] Lock "cinder-quobyte-e9f89989-619a-4b5c-9997-445ae612552d" released by "delete_volume" :: held 1.843s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:57:02 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-641844d4-1bb5-4bbf-a1ae-57a03d71f106 tempest-VolumesSnapshotTestJSON-1119395226 None] Created reservations ['9367877d-467f-4bce-94f6-2ae586b8140b', '9733586e-1e71-41a6-b758-2c2f8c2c2b83', 'd7c53839-0e54-4992-afbe-5232bed73b92', 'e62819fb-143e-4b35-9a0a-a9bc86f9ac6d'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 15:57:02 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-1aa43b7d-13e6-46e8-b1dc-fec5e230a742 tempest-VolumesCloneNegativeTest-1095028282 None] Created reservations ['aae9aad2-8655-4cd0-9dfe-7ac62d21f770', '9818286b-1a2c-4cb6-9751-956c5d7679c6', 'eb99346f-7dfc-4ed0-9aed-10641f44b249', '6273b223-e341-4e5c-8663-29b5dffa3454'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 15:57:02 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-1aa43b7d-13e6-46e8-b1dc-fec5e230a742 tempest-VolumesCloneNegativeTest-1095028282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:57:02 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-1aa43b7d-13e6-46e8-b1dc-fec5e230a742 tempest-VolumesCloneNegativeTest-1095028282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:57:02 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-1aa43b7d-13e6-46e8-b1dc-fec5e230a742 tempest-VolumesCloneNegativeTest-1095028282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:57:02 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-1aa43b7d-13e6-46e8-b1dc-fec5e230a742 tempest-VolumesCloneNegativeTest-1095028282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:57:02 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-1aa43b7d-13e6-46e8-b1dc-fec5e230a742 tempest-VolumesCloneNegativeTest-1095028282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:57:02 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-1aa43b7d-13e6-46e8-b1dc-fec5e230a742 tempest-VolumesCloneNegativeTest-1095028282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:57:02 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-641844d4-1bb5-4bbf-a1ae-57a03d71f106 tempest-VolumesSnapshotTestJSON-1119395226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:57:02 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-641844d4-1bb5-4bbf-a1ae-57a03d71f106 tempest-VolumesSnapshotTestJSON-1119395226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:57:02 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-641844d4-1bb5-4bbf-a1ae-57a03d71f106 tempest-VolumesSnapshotTestJSON-1119395226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:57:02 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-641844d4-1bb5-4bbf-a1ae-57a03d71f106 tempest-VolumesSnapshotTestJSON-1119395226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:57:02 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-641844d4-1bb5-4bbf-a1ae-57a03d71f106 tempest-VolumesSnapshotTestJSON-1119395226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:57:02 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-641844d4-1bb5-4bbf-a1ae-57a03d71f106 tempest-VolumesSnapshotTestJSON-1119395226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:57:02 devstack sudo[96978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 15:57:02 devstack sudo[96978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:57:02 devstack sudo[96979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 15:57:02 devstack sudo[96979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:57:02 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-33a83564-e491-4bbd-af49-b28d8213d274 tempest-SnapshotsActionsTest-1918108303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:57:02 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-d64818ab-269f-4aed-8b54-2518706a16c3 tempest-VolumesSnapshotTestJSON-1119395226 None] Acquiring lock "cinder-9e17de25-b06f-472d-8562-fb636ea4efae-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:57:02 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-d64818ab-269f-4aed-8b54-2518706a16c3 tempest-VolumesSnapshotTestJSON-1119395226 None] Lock "cinder-9e17de25-b06f-472d-8562-fb636ea4efae-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:57:02 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-d64818ab-269f-4aed-8b54-2518706a16c3 tempest-VolumesSnapshotTestJSON-1119395226 None] Acquiring lock "cinder-quobyte-9e17de25-b06f-472d-8562-fb636ea4efae" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:57:02 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-d64818ab-269f-4aed-8b54-2518706a16c3 tempest-VolumesSnapshotTestJSON-1119395226 None] Lock "cinder-quobyte-9e17de25-b06f-472d-8562-fb636ea4efae" acquired by "delete_volume" :: waited 0.030s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:57:02 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[f03bebd9-da53-4e0f-a501-42dc3bcd54b5]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:57:02 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d64818ab-269f-4aed-8b54-2518706a16c3 tempest-VolumesSnapshotTestJSON-1119395226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-9e17de25-b06f-472d-8562-fb636ea4efae {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:57:03 devstack sudo[96986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-9e17de25-b06f-472d-8562-fb636ea4efae Jul 10 15:57:03 devstack sudo[96986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:57:03 devstack sudo[96974]: pam_unix(sudo:session): session closed for user root Jul 10 15:57:03 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8b759f8b-ae08-4bfd-87ec-95e121b1e92a tempest-SnapshotMetadataTestJSON-658352555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d1628609-3369-45cb-9a79-9504df81c0f6 1073741824" returned: 0 in 1.329s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:57:03 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8b759f8b-ae08-4bfd-87ec-95e121b1e92a tempest-SnapshotMetadataTestJSON-658352555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d1628609-3369-45cb-9a79-9504df81c0f6 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:57:03 devstack sudo[96990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d1628609-3369-45cb-9a79-9504df81c0f6 Jul 10 15:57:03 devstack sudo[96990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:57:03 devstack sudo[96978]: pam_unix(sudo:session): session closed for user root Jul 10 15:57:03 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-1aa43b7d-13e6-46e8-b1dc-fec5e230a742 tempest-VolumesCloneNegativeTest-1095028282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 1.071s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:57:03 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-1aa43b7d-13e6-46e8-b1dc-fec5e230a742 tempest-VolumesCloneNegativeTest-1095028282 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 15:57:03 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-1aa43b7d-13e6-46e8-b1dc-fec5e230a742 tempest-VolumesCloneNegativeTest-1095028282 None] Deleted volume successfully. Jul 10 15:57:03 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-1aa43b7d-13e6-46e8-b1dc-fec5e230a742 tempest-VolumesCloneNegativeTest-1095028282 None] Lock "cinder-e9f89989-619a-4b5c-9997-445ae612552d-delete_volume" released by "delete_volume" :: held 3.264s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:57:03 devstack sudo[96979]: pam_unix(sudo:session): session closed for user root Jul 10 15:57:03 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-641844d4-1bb5-4bbf-a1ae-57a03d71f106 tempest-VolumesSnapshotTestJSON-1119395226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 1.141s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:57:03 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-641844d4-1bb5-4bbf-a1ae-57a03d71f106 tempest-VolumesSnapshotTestJSON-1119395226 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 15:57:03 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-641844d4-1bb5-4bbf-a1ae-57a03d71f106 tempest-VolumesSnapshotTestJSON-1119395226 None] Deleted volume successfully. Jul 10 15:57:03 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-641844d4-1bb5-4bbf-a1ae-57a03d71f106 tempest-VolumesSnapshotTestJSON-1119395226 None] Lock "cinder-6945f8cb-aca6-4ada-9615-b2eb533169f3-delete_volume" released by "delete_volume" :: held 3.404s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:57:03 devstack sudo[96986]: pam_unix(sudo:session): session closed for user root Jul 10 15:57:03 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d64818ab-269f-4aed-8b54-2518706a16c3 tempest-VolumesSnapshotTestJSON-1119395226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-9e17de25-b06f-472d-8562-fb636ea4efae" returned: 0 in 0.970s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:57:03 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d64818ab-269f-4aed-8b54-2518706a16c3 tempest-VolumesSnapshotTestJSON-1119395226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-9e17de25-b06f-472d-8562-fb636ea4efae {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:57:03 devstack sudo[96995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-9e17de25-b06f-472d-8562-fb636ea4efae Jul 10 15:57:03 devstack sudo[96995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:57:03 devstack sudo[96990]: pam_unix(sudo:session): session closed for user root Jul 10 15:57:03 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8b759f8b-ae08-4bfd-87ec-95e121b1e92a tempest-SnapshotMetadataTestJSON-658352555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d1628609-3369-45cb-9a79-9504df81c0f6" returned: 0 in 0.803s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:57:03 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-8b759f8b-ae08-4bfd-87ec-95e121b1e92a tempest-SnapshotMetadataTestJSON-658352555 None] <== create_volume: return (2205ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 15:57:03 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-8b759f8b-ae08-4bfd-87ec-95e121b1e92a tempest-SnapshotMetadataTestJSON-658352555 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.207s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:57:03 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-33a83564-e491-4bbd-af49-b28d8213d274 tempest-SnapshotsActionsTest-1918108303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.572s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:57:04 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-33a83564-e491-4bbd-af49-b28d8213d274 tempest-SnapshotsActionsTest-1918108303 None] Creating offline snapshot c0bb4765-ab90-4255-a71d-d6d53e5053a9 of volume f2922929-98bb-4fec-bdd5-aad2d7870937 {{(pid=87420) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 15:57:04 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-8b759f8b-ae08-4bfd-87ec-95e121b1e92a tempest-SnapshotMetadataTestJSON-658352555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (951e2e9b-4577-442a-8e70-de586a323a8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1628609-3369-45cb-9a79-9504df81c0f6', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:57:04 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-8b759f8b-ae08-4bfd-87ec-95e121b1e92a tempest-SnapshotMetadataTestJSON-658352555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26061bac-f5dd-406d-be49-9dcd2f9ce67c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:57:04 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[d33eff74-f24f-4c04-8714-abac5d283aed]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:57:04 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-33a83564-e491-4bbd-af49-b28d8213d274 tempest-SnapshotsActionsTest-1918108303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.04b64570-a35a-4472-9f73-f425b6bccc9e {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:57:04 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-8b759f8b-ae08-4bfd-87ec-95e121b1e92a tempest-SnapshotMetadataTestJSON-658352555 None] Volume volume-d1628609-3369-45cb-9a79-9504df81c0f6 (d1628609-3369-45cb-9a79-9504df81c0f6): created successfully Jul 10 15:57:04 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-8b759f8b-ae08-4bfd-87ec-95e121b1e92a tempest-SnapshotMetadataTestJSON-658352555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26061bac-f5dd-406d-be49-9dcd2f9ce67c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:57:04 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-8b759f8b-ae08-4bfd-87ec-95e121b1e92a tempest-SnapshotMetadataTestJSON-658352555 None] Flow 'volume_create_manager' (536ebd9a-7f85-4ab4-9ee6-a8368377fa7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:57:04 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-8b759f8b-ae08-4bfd-87ec-95e121b1e92a tempest-SnapshotMetadataTestJSON-658352555 None] Created volume successfully. Jul 10 15:57:04 devstack sudo[96998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.04b64570-a35a-4472-9f73-f425b6bccc9e Jul 10 15:57:04 devstack sudo[96998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:57:04 devstack sudo[96995]: pam_unix(sudo:session): session closed for user root Jul 10 15:57:04 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d64818ab-269f-4aed-8b54-2518706a16c3 tempest-VolumesSnapshotTestJSON-1119395226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-9e17de25-b06f-472d-8562-fb636ea4efae" returned: 0 in 0.726s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:57:04 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-d64818ab-269f-4aed-8b54-2518706a16c3 tempest-VolumesSnapshotTestJSON-1119395226 None] Lock "cinder-quobyte-9e17de25-b06f-472d-8562-fb636ea4efae" released by "delete_volume" :: held 1.778s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:57:04 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-d64818ab-269f-4aed-8b54-2518706a16c3 tempest-VolumesSnapshotTestJSON-1119395226 None] Created reservations ['418ae538-1ed9-4317-b7d4-8b700df276a5', 'acbd954c-40aa-4560-9000-b3c577ed2be8', '767650ef-a604-49f6-8fa3-dc87e5d00800', '642649db-3b1b-4cde-bb7c-73f7c5f25d6b'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 15:57:04 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-d64818ab-269f-4aed-8b54-2518706a16c3 tempest-VolumesSnapshotTestJSON-1119395226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:57:04 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-d64818ab-269f-4aed-8b54-2518706a16c3 tempest-VolumesSnapshotTestJSON-1119395226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:57:04 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-d64818ab-269f-4aed-8b54-2518706a16c3 tempest-VolumesSnapshotTestJSON-1119395226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:57:04 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-d64818ab-269f-4aed-8b54-2518706a16c3 tempest-VolumesSnapshotTestJSON-1119395226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:57:04 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-d64818ab-269f-4aed-8b54-2518706a16c3 tempest-VolumesSnapshotTestJSON-1119395226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:57:04 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d64818ab-269f-4aed-8b54-2518706a16c3 tempest-VolumesSnapshotTestJSON-1119395226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:57:04 devstack sudo[97001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 15:57:04 devstack sudo[97001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:57:04 devstack sudo[96998]: pam_unix(sudo:session): session closed for user root Jul 10 15:57:04 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-33a83564-e491-4bbd-af49-b28d8213d274 tempest-SnapshotsActionsTest-1918108303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.04b64570-a35a-4472-9f73-f425b6bccc9e" returned: 0 in 0.900s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:57:04 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-33a83564-e491-4bbd-af49-b28d8213d274 tempest-SnapshotsActionsTest-1918108303 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f2922929-98bb-4fec-bdd5-aad2d7870937(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87420) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 15:57:04 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-33a83564-e491-4bbd-af49-b28d8213d274 tempest-SnapshotsActionsTest-1918108303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.04b64570-a35a-4472-9f73-f425b6bccc9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.c0bb4765-ab90-4255-a71d-d6d53e5053a9 1G {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:57:05 devstack sudo[97006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.04b64570-a35a-4472-9f73-f425b6bccc9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.c0bb4765-ab90-4255-a71d-d6d53e5053a9 1G Jul 10 15:57:05 devstack sudo[97006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:57:05 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-1103f3f9-89f4-468e-b765-cb1bb3a9d18e tempest-SnapshotMetadataTestJSON-658352555 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:57:05 devstack sudo[97001]: pam_unix(sudo:session): session closed for user root Jul 10 15:57:05 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d64818ab-269f-4aed-8b54-2518706a16c3 tempest-VolumesSnapshotTestJSON-1119395226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.896s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:57:05 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-d64818ab-269f-4aed-8b54-2518706a16c3 tempest-VolumesSnapshotTestJSON-1119395226 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 15:57:05 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-d64818ab-269f-4aed-8b54-2518706a16c3 tempest-VolumesSnapshotTestJSON-1119395226 None] Deleted volume successfully. Jul 10 15:57:05 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-d64818ab-269f-4aed-8b54-2518706a16c3 tempest-VolumesSnapshotTestJSON-1119395226 None] Lock "cinder-9e17de25-b06f-472d-8562-fb636ea4efae-delete_volume" released by "delete_volume" :: held 2.948s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:57:06 devstack sudo[97006]: pam_unix(sudo:session): session closed for user root Jul 10 15:57:06 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-33a83564-e491-4bbd-af49-b28d8213d274 tempest-SnapshotsActionsTest-1918108303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.04b64570-a35a-4472-9f73-f425b6bccc9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.c0bb4765-ab90-4255-a71d-d6d53e5053a9 1G" returned: 0 in 1.091s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:57:06 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-33a83564-e491-4bbd-af49-b28d8213d274 tempest-SnapshotsActionsTest-1918108303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2922929-98bb-4fec-bdd5-aad2d7870937.04b64570-a35a-4472-9f73-f425b6bccc9e -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.c0bb4765-ab90-4255-a71d-d6d53e5053a9 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:57:06 devstack sudo[97013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2922929-98bb-4fec-bdd5-aad2d7870937.04b64570-a35a-4472-9f73-f425b6bccc9e -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.c0bb4765-ab90-4255-a71d-d6d53e5053a9 Jul 10 15:57:06 devstack sudo[97013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:57:06 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-34d21054-26f4-4345-b6c5-bd873b7ccb68 tempest-VolumesGetTest-474292535 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 15:57:06 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-34d21054-26f4-4345-b6c5-bd873b7ccb68 tempest-VolumesGetTest-474292535 None] Flow 'volume_create_manager' (7b028bcc-af37-41a6-9dcb-1c9b780f08e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:57:06 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-34d21054-26f4-4345-b6c5-bd873b7ccb68 tempest-VolumesGetTest-474292535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2529840-a52a-4c91-a440-709b5706f743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:57:06 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-34d21054-26f4-4345-b6c5-bd873b7ccb68 tempest-VolumesGetTest-474292535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2529840-a52a-4c91-a440-709b5706f743) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:57:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1532934681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=807a4247-0ce3-4abc-a04d-45c1c9e7acb8,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='7e1e4affd8f342e2a93b8606ed90299a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:57:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:57:06Z,use_quota=True,user_id='fd5c633b5ab34f4fa42d3bf6bcfa01a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:57:06 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-34d21054-26f4-4345-b6c5-bd873b7ccb68 tempest-VolumesGetTest-474292535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (514cc59b-2d04-42e6-8dd7-fb534a860985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:57:06 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-34d21054-26f4-4345-b6c5-bd873b7ccb68 tempest-VolumesGetTest-474292535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (514cc59b-2d04-42e6-8dd7-fb534a860985) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:57:06 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-34d21054-26f4-4345-b6c5-bd873b7ccb68 tempest-VolumesGetTest-474292535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62bec9bc-8fa7-4743-bf40-497122c9647b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:57:06 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-34d21054-26f4-4345-b6c5-bd873b7ccb68 tempest-VolumesGetTest-474292535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62bec9bc-8fa7-4743-bf40-497122c9647b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '807a4247-0ce3-4abc-a04d-45c1c9e7acb8', 'volume_name': 'volume-807a4247-0ce3-4abc-a04d-45c1c9e7acb8', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:57:06 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-34d21054-26f4-4345-b6c5-bd873b7ccb68 tempest-VolumesGetTest-474292535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c34bae7-0e05-4488-9c56-b45059b13a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:57:06 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-34d21054-26f4-4345-b6c5-bd873b7ccb68 tempest-VolumesGetTest-474292535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c34bae7-0e05-4488-9c56-b45059b13a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:57:06 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-34d21054-26f4-4345-b6c5-bd873b7ccb68 tempest-VolumesGetTest-474292535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b890b0c-1b49-42bc-9328-cd910e1a7972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:57:06 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-34d21054-26f4-4345-b6c5-bd873b7ccb68 tempest-VolumesGetTest-474292535 None] Volume 807a4247-0ce3-4abc-a04d-45c1c9e7acb8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-807a4247-0ce3-4abc-a04d-45c1c9e7acb8', 'volume_size': 1} Jul 10 15:57:06 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-34d21054-26f4-4345-b6c5-bd873b7ccb68 tempest-VolumesGetTest-474292535 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:57:06 devstack sudo[97013]: pam_unix(sudo:session): session closed for user root Jul 10 15:57:06 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-33a83564-e491-4bbd-af49-b28d8213d274 tempest-SnapshotsActionsTest-1918108303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2922929-98bb-4fec-bdd5-aad2d7870937.04b64570-a35a-4472-9f73-f425b6bccc9e -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.c0bb4765-ab90-4255-a71d-d6d53e5053a9" returned: 0 in 0.741s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:57:06 devstack cinder-volume[87420]: WARNING cinder.volume.drivers.remotefs [None req-33a83564-e491-4bbd-af49-b28d8213d274 tempest-SnapshotsActionsTest-1918108303 None] /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.c0bb4765-ab90-4255-a71d-d6d53e5053a9 is being set with open permissions: ugo+rw Jul 10 15:57:06 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-33a83564-e491-4bbd-af49-b28d8213d274 tempest-SnapshotsActionsTest-1918108303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.c0bb4765-ab90-4255-a71d-d6d53e5053a9 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:57:06 devstack sudo[97020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.c0bb4765-ab90-4255-a71d-d6d53e5053a9 Jul 10 15:57:06 devstack sudo[97020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:57:07 devstack sudo[97020]: pam_unix(sudo:session): session closed for user root Jul 10 15:57:07 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-33a83564-e491-4bbd-af49-b28d8213d274 tempest-SnapshotsActionsTest-1918108303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.c0bb4765-ab90-4255-a71d-d6d53e5053a9" returned: 0 in 0.702s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:57:07 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-33a83564-e491-4bbd-af49-b28d8213d274 tempest-SnapshotsActionsTest-1918108303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.586s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:57:07 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-1103f3f9-89f4-468e-b765-cb1bb3a9d18e tempest-SnapshotMetadataTestJSON-658352555 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.350s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:57:07 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-1103f3f9-89f4-468e-b765-cb1bb3a9d18e tempest-SnapshotMetadataTestJSON-658352555 None] Creating offline snapshot 5e430bd0-073c-4d4c-827d-abf18feff002 of volume d1628609-3369-45cb-9a79-9504df81c0f6 {{(pid=87420) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 15:57:07 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[9803ecf1-adda-4685-b887-d9b6577809d7]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:57:07 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-1103f3f9-89f4-468e-b765-cb1bb3a9d18e tempest-SnapshotMetadataTestJSON-658352555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d1628609-3369-45cb-9a79-9504df81c0f6 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:57:07 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-33a83564-e491-4bbd-af49-b28d8213d274 tempest-SnapshotsActionsTest-1918108303 None] Create snapshot completed successfully Jul 10 15:57:07 devstack sudo[97023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d1628609-3369-45cb-9a79-9504df81c0f6 Jul 10 15:57:07 devstack sudo[97023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:57:08 devstack sudo[97023]: pam_unix(sudo:session): session closed for user root Jul 10 15:57:08 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-1103f3f9-89f4-468e-b765-cb1bb3a9d18e tempest-SnapshotMetadataTestJSON-658352555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d1628609-3369-45cb-9a79-9504df81c0f6" returned: 0 in 0.959s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:57:08 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-1103f3f9-89f4-468e-b765-cb1bb3a9d18e tempest-SnapshotMetadataTestJSON-658352555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d1628609-3369-45cb-9a79-9504df81c0f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d1628609-3369-45cb-9a79-9504df81c0f6.5e430bd0-073c-4d4c-827d-abf18feff002 1G {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:57:08 devstack sudo[97028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d1628609-3369-45cb-9a79-9504df81c0f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d1628609-3369-45cb-9a79-9504df81c0f6.5e430bd0-073c-4d4c-827d-abf18feff002 1G Jul 10 15:57:08 devstack sudo[97028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:57:08 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-dd0a9ff3-4d36-4a13-b30b-a3e2d3615d2a tempest-SnapshotsActionsTest-51400650 None] Acquiring lock "cinder-c0bb4765-ab90-4255-a71d-d6d53e5053a9-delete_snapshot" by "delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:57:08 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-dd0a9ff3-4d36-4a13-b30b-a3e2d3615d2a tempest-SnapshotsActionsTest-51400650 None] Lock "cinder-c0bb4765-ab90-4255-a71d-d6d53e5053a9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:57:08 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-dd0a9ff3-4d36-4a13-b30b-a3e2d3615d2a tempest-SnapshotsActionsTest-51400650 None] Acquiring lock "cinder-quobyte-f2922929-98bb-4fec-bdd5-aad2d7870937" by "delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:57:08 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-dd0a9ff3-4d36-4a13-b30b-a3e2d3615d2a tempest-SnapshotsActionsTest-51400650 None] Lock "cinder-quobyte-f2922929-98bb-4fec-bdd5-aad2d7870937" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:57:08 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-dd0a9ff3-4d36-4a13-b30b-a3e2d3615d2a tempest-SnapshotsActionsTest-51400650 None] Acquiring lock "cinder-quobyte-c0bb4765-ab90-4255-a71d-d6d53e5053a9" by "_delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:57:08 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-dd0a9ff3-4d36-4a13-b30b-a3e2d3615d2a tempest-SnapshotsActionsTest-51400650 None] Lock "cinder-quobyte-c0bb4765-ab90-4255-a71d-d6d53e5053a9" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:57:08 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-dd0a9ff3-4d36-4a13-b30b-a3e2d3615d2a tempest-SnapshotsActionsTest-51400650 None] Deleting offline snapshot c0bb4765-ab90-4255-a71d-d6d53e5053a9 of volume f2922929-98bb-4fec-bdd5-aad2d7870937 {{(pid=87420) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 15:57:08 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-dd0a9ff3-4d36-4a13-b30b-a3e2d3615d2a tempest-SnapshotsActionsTest-51400650 None] snapshot_file for this snap is: volume-f2922929-98bb-4fec-bdd5-aad2d7870937.c0bb4765-ab90-4255-a71d-d6d53e5053a9 {{(pid=87420) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 15:57:08 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[b94cd416-095a-44c7-864b-2a8d123a61a3]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:57:08 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-dd0a9ff3-4d36-4a13-b30b-a3e2d3615d2a tempest-SnapshotsActionsTest-51400650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.c0bb4765-ab90-4255-a71d-d6d53e5053a9 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:57:09 devstack sudo[97031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.c0bb4765-ab90-4255-a71d-d6d53e5053a9 Jul 10 15:57:09 devstack sudo[97031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:57:09 devstack sudo[97028]: pam_unix(sudo:session): session closed for user root Jul 10 15:57:09 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-1103f3f9-89f4-468e-b765-cb1bb3a9d18e tempest-SnapshotMetadataTestJSON-658352555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d1628609-3369-45cb-9a79-9504df81c0f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d1628609-3369-45cb-9a79-9504df81c0f6.5e430bd0-073c-4d4c-827d-abf18feff002 1G" returned: 0 in 0.982s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:57:09 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-1103f3f9-89f4-468e-b765-cb1bb3a9d18e tempest-SnapshotMetadataTestJSON-658352555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1628609-3369-45cb-9a79-9504df81c0f6 -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d1628609-3369-45cb-9a79-9504df81c0f6.5e430bd0-073c-4d4c-827d-abf18feff002 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:57:09 devstack sudo[97036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1628609-3369-45cb-9a79-9504df81c0f6 -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d1628609-3369-45cb-9a79-9504df81c0f6.5e430bd0-073c-4d4c-827d-abf18feff002 Jul 10 15:57:09 devstack sudo[97036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:57:09 devstack sudo[97031]: pam_unix(sudo:session): session closed for user root Jul 10 15:57:09 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-dd0a9ff3-4d36-4a13-b30b-a3e2d3615d2a tempest-SnapshotsActionsTest-51400650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.c0bb4765-ab90-4255-a71d-d6d53e5053a9" returned: 0 in 0.891s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:57:09 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-dd0a9ff3-4d36-4a13-b30b-a3e2d3615d2a tempest-SnapshotsActionsTest-51400650 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f2922929-98bb-4fec-bdd5-aad2d7870937(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87420) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 15:57:09 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[f353e96a-32dc-41bc-a68e-ec6618b846c7]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:57:09 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-dd0a9ff3-4d36-4a13-b30b-a3e2d3615d2a tempest-SnapshotsActionsTest-51400650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.04b64570-a35a-4472-9f73-f425b6bccc9e {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:57:10 devstack sudo[97041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.04b64570-a35a-4472-9f73-f425b6bccc9e Jul 10 15:57:10 devstack sudo[97041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:57:10 devstack sudo[97036]: pam_unix(sudo:session): session closed for user root Jul 10 15:57:10 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-1103f3f9-89f4-468e-b765-cb1bb3a9d18e tempest-SnapshotMetadataTestJSON-658352555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1628609-3369-45cb-9a79-9504df81c0f6 -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d1628609-3369-45cb-9a79-9504df81c0f6.5e430bd0-073c-4d4c-827d-abf18feff002" returned: 0 in 0.752s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:57:10 devstack cinder-volume[87420]: WARNING cinder.volume.drivers.remotefs [None req-1103f3f9-89f4-468e-b765-cb1bb3a9d18e tempest-SnapshotMetadataTestJSON-658352555 None] /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d1628609-3369-45cb-9a79-9504df81c0f6.5e430bd0-073c-4d4c-827d-abf18feff002 is being set with open permissions: ugo+rw Jul 10 15:57:10 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-1103f3f9-89f4-468e-b765-cb1bb3a9d18e tempest-SnapshotMetadataTestJSON-658352555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d1628609-3369-45cb-9a79-9504df81c0f6.5e430bd0-073c-4d4c-827d-abf18feff002 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:57:10 devstack sudo[97048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d1628609-3369-45cb-9a79-9504df81c0f6.5e430bd0-073c-4d4c-827d-abf18feff002 Jul 10 15:57:10 devstack sudo[97048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:57:10 devstack sudo[97041]: pam_unix(sudo:session): session closed for user root Jul 10 15:57:10 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-dd0a9ff3-4d36-4a13-b30b-a3e2d3615d2a tempest-SnapshotsActionsTest-51400650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.04b64570-a35a-4472-9f73-f425b6bccc9e" returned: 0 in 0.866s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:57:10 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-dd0a9ff3-4d36-4a13-b30b-a3e2d3615d2a tempest-SnapshotsActionsTest-51400650 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f2922929-98bb-4fec-bdd5-aad2d7870937(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87420) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 15:57:10 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-dd0a9ff3-4d36-4a13-b30b-a3e2d3615d2a tempest-SnapshotsActionsTest-51400650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.c0bb4765-ab90-4255-a71d-d6d53e5053a9 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:57:10 devstack sudo[97054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.c0bb4765-ab90-4255-a71d-d6d53e5053a9 Jul 10 15:57:10 devstack sudo[97054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:57:11 devstack sudo[97048]: pam_unix(sudo:session): session closed for user root Jul 10 15:57:11 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-1103f3f9-89f4-468e-b765-cb1bb3a9d18e tempest-SnapshotMetadataTestJSON-658352555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d1628609-3369-45cb-9a79-9504df81c0f6.5e430bd0-073c-4d4c-827d-abf18feff002" returned: 0 in 0.759s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:57:11 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-1103f3f9-89f4-468e-b765-cb1bb3a9d18e tempest-SnapshotMetadataTestJSON-658352555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d1628609-3369-45cb-9a79-9504df81c0f6.info {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:57:11 devstack sudo[97057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d1628609-3369-45cb-9a79-9504df81c0f6.info Jul 10 15:57:11 devstack sudo[97057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:57:11 devstack sudo[97054]: pam_unix(sudo:session): session closed for user root Jul 10 15:57:11 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-dd0a9ff3-4d36-4a13-b30b-a3e2d3615d2a tempest-SnapshotsActionsTest-51400650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.c0bb4765-ab90-4255-a71d-d6d53e5053a9" returned: 0 in 0.879s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:57:11 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-dd0a9ff3-4d36-4a13-b30b-a3e2d3615d2a tempest-SnapshotsActionsTest-51400650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.c0bb4765-ab90-4255-a71d-d6d53e5053a9 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:57:11 devstack sudo[97062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.c0bb4765-ab90-4255-a71d-d6d53e5053a9 Jul 10 15:57:11 devstack sudo[97062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:57:11 devstack sudo[97057]: pam_unix(sudo:session): session closed for user root Jul 10 15:57:11 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-1103f3f9-89f4-468e-b765-cb1bb3a9d18e tempest-SnapshotMetadataTestJSON-658352555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d1628609-3369-45cb-9a79-9504df81c0f6.info" returned: 0 in 0.797s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:57:11 devstack cinder-volume[87420]: WARNING cinder.volume.drivers.remotefs [None req-1103f3f9-89f4-468e-b765-cb1bb3a9d18e tempest-SnapshotMetadataTestJSON-658352555 None] /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d1628609-3369-45cb-9a79-9504df81c0f6.info is being set with open permissions: ugo+rw Jul 10 15:57:11 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-1103f3f9-89f4-468e-b765-cb1bb3a9d18e tempest-SnapshotMetadataTestJSON-658352555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d1628609-3369-45cb-9a79-9504df81c0f6.info {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:57:11 devstack sudo[97065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d1628609-3369-45cb-9a79-9504df81c0f6.info Jul 10 15:57:11 devstack sudo[97065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:57:12 devstack sudo[97062]: pam_unix(sudo:session): session closed for user root Jul 10 15:57:12 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-dd0a9ff3-4d36-4a13-b30b-a3e2d3615d2a tempest-SnapshotsActionsTest-51400650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.c0bb4765-ab90-4255-a71d-d6d53e5053a9" returned: 0 in 0.715s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:57:12 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-dd0a9ff3-4d36-4a13-b30b-a3e2d3615d2a tempest-SnapshotsActionsTest-51400650 None] Lock "cinder-quobyte-c0bb4765-ab90-4255-a71d-d6d53e5053a9" released by "_delete_snapshot" :: held 3.478s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:57:12 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-dd0a9ff3-4d36-4a13-b30b-a3e2d3615d2a tempest-SnapshotsActionsTest-51400650 None] Lock "cinder-quobyte-f2922929-98bb-4fec-bdd5-aad2d7870937" released by "delete_snapshot" :: held 3.506s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:57:12 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-dd0a9ff3-4d36-4a13-b30b-a3e2d3615d2a tempest-SnapshotsActionsTest-51400650 None] Created reservations ['10d178cb-25a3-4d0b-86a5-12a24e885853', 'aafc77d6-7b01-4bb7-8557-db201ea28aeb', '640e5dc4-6caf-40a9-a781-e01dcae61c7a', 'b5accf85-f3f9-4b91-8766-21d48ab99996'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 15:57:12 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-dd0a9ff3-4d36-4a13-b30b-a3e2d3615d2a tempest-SnapshotsActionsTest-51400650 None] Delete snapshot completed successfully. Jul 10 15:57:12 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-dd0a9ff3-4d36-4a13-b30b-a3e2d3615d2a tempest-SnapshotsActionsTest-51400650 None] Lock "cinder-c0bb4765-ab90-4255-a71d-d6d53e5053a9-delete_snapshot" released by "delete_snapshot" :: held 3.695s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:57:12 devstack sudo[97065]: pam_unix(sudo:session): session closed for user root Jul 10 15:57:12 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-1103f3f9-89f4-468e-b765-cb1bb3a9d18e tempest-SnapshotMetadataTestJSON-658352555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d1628609-3369-45cb-9a79-9504df81c0f6.info" returned: 0 in 0.720s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:57:12 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-1103f3f9-89f4-468e-b765-cb1bb3a9d18e tempest-SnapshotMetadataTestJSON-658352555 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.077s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:57:12 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-34d21054-26f4-4345-b6c5-bd873b7ccb68 tempest-VolumesGetTest-474292535 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.446s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:57:12 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-34d21054-26f4-4345-b6c5-bd873b7ccb68 tempest-VolumesGetTest-474292535 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:57:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1532934681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=807a4247-0ce3-4abc-a04d-45c1c9e7acb8,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='7e1e4affd8f342e2a93b8606ed90299a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:57:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:57:06Z,use_quota=True,user_id='fd5c633b5ab34f4fa42d3bf6bcfa01a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 15:57:12 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-34d21054-26f4-4345-b6c5-bd873b7ccb68 tempest-VolumesGetTest-474292535 None] Creating volume 807a4247-0ce3-4abc-a04d-45c1c9e7acb8 {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 15:57:12 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-34d21054-26f4-4345-b6c5-bd873b7ccb68 tempest-VolumesGetTest-474292535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:57:12 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-34d21054-26f4-4345-b6c5-bd873b7ccb68 tempest-VolumesGetTest-474292535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:57:12 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-34d21054-26f4-4345-b6c5-bd873b7ccb68 tempest-VolumesGetTest-474292535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:57:12 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-34d21054-26f4-4345-b6c5-bd873b7ccb68 tempest-VolumesGetTest-474292535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:57:12 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-34d21054-26f4-4345-b6c5-bd873b7ccb68 tempest-VolumesGetTest-474292535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:57:12 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-34d21054-26f4-4345-b6c5-bd873b7ccb68 tempest-VolumesGetTest-474292535 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 15:57:12 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-34d21054-26f4-4345-b6c5-bd873b7ccb68 tempest-VolumesGetTest-474292535 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 15:57:12 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-34d21054-26f4-4345-b6c5-bd873b7ccb68 tempest-VolumesGetTest-474292535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-807a4247-0ce3-4abc-a04d-45c1c9e7acb8 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:57:12 devstack sudo[97069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-807a4247-0ce3-4abc-a04d-45c1c9e7acb8 1073741824 Jul 10 15:57:12 devstack sudo[97069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:57:12 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-1103f3f9-89f4-468e-b765-cb1bb3a9d18e tempest-SnapshotMetadataTestJSON-658352555 None] Create snapshot completed successfully Jul 10 15:57:13 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-07889f1a-d098-46a7-85fc-01eed9c24d2b tempest-SnapshotsActionsTest-1918108303 None] Acquiring lock "cinder-04b64570-a35a-4472-9f73-f425b6bccc9e-delete_snapshot" by "delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:57:13 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-07889f1a-d098-46a7-85fc-01eed9c24d2b tempest-SnapshotsActionsTest-1918108303 None] Lock "cinder-04b64570-a35a-4472-9f73-f425b6bccc9e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:57:13 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-07889f1a-d098-46a7-85fc-01eed9c24d2b tempest-SnapshotsActionsTest-1918108303 None] Acquiring lock "cinder-quobyte-f2922929-98bb-4fec-bdd5-aad2d7870937" by "delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:57:13 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-07889f1a-d098-46a7-85fc-01eed9c24d2b tempest-SnapshotsActionsTest-1918108303 None] Lock "cinder-quobyte-f2922929-98bb-4fec-bdd5-aad2d7870937" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:57:13 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-07889f1a-d098-46a7-85fc-01eed9c24d2b tempest-SnapshotsActionsTest-1918108303 None] Acquiring lock "cinder-quobyte-04b64570-a35a-4472-9f73-f425b6bccc9e" by "_delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:57:13 devstack sudo[97069]: pam_unix(sudo:session): session closed for user root Jul 10 15:57:13 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-07889f1a-d098-46a7-85fc-01eed9c24d2b tempest-SnapshotsActionsTest-1918108303 None] Lock "cinder-quobyte-04b64570-a35a-4472-9f73-f425b6bccc9e" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:57:13 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-07889f1a-d098-46a7-85fc-01eed9c24d2b tempest-SnapshotsActionsTest-1918108303 None] Deleting offline snapshot 04b64570-a35a-4472-9f73-f425b6bccc9e of volume f2922929-98bb-4fec-bdd5-aad2d7870937 {{(pid=87420) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 15:57:13 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-07889f1a-d098-46a7-85fc-01eed9c24d2b tempest-SnapshotsActionsTest-1918108303 None] snapshot_file for this snap is: volume-f2922929-98bb-4fec-bdd5-aad2d7870937.04b64570-a35a-4472-9f73-f425b6bccc9e {{(pid=87420) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 15:57:13 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-34d21054-26f4-4345-b6c5-bd873b7ccb68 tempest-VolumesGetTest-474292535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-807a4247-0ce3-4abc-a04d-45c1c9e7acb8 1073741824" returned: 0 in 1.004s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:57:13 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc54358-9251-4301-ac0c-29455718421e]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:57:13 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-07889f1a-d098-46a7-85fc-01eed9c24d2b tempest-SnapshotsActionsTest-1918108303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.04b64570-a35a-4472-9f73-f425b6bccc9e {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:57:13 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-34d21054-26f4-4345-b6c5-bd873b7ccb68 tempest-VolumesGetTest-474292535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-807a4247-0ce3-4abc-a04d-45c1c9e7acb8 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:57:13 devstack sudo[97077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-807a4247-0ce3-4abc-a04d-45c1c9e7acb8 Jul 10 15:57:13 devstack sudo[97077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:57:13 devstack sudo[97076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.04b64570-a35a-4472-9f73-f425b6bccc9e Jul 10 15:57:13 devstack sudo[97076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:57:14 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-26457615-dc18-437e-9489-f59a6f23b23f tempest-SnapshotMetadataTestJSON-658352555 None] Acquiring lock "cinder-5e430bd0-073c-4d4c-827d-abf18feff002-delete_snapshot" by "delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:57:14 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-26457615-dc18-437e-9489-f59a6f23b23f tempest-SnapshotMetadataTestJSON-658352555 None] Lock "cinder-5e430bd0-073c-4d4c-827d-abf18feff002-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:57:14 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-26457615-dc18-437e-9489-f59a6f23b23f tempest-SnapshotMetadataTestJSON-658352555 None] Acquiring lock "cinder-quobyte-d1628609-3369-45cb-9a79-9504df81c0f6" by "delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:57:14 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-26457615-dc18-437e-9489-f59a6f23b23f tempest-SnapshotMetadataTestJSON-658352555 None] Lock "cinder-quobyte-d1628609-3369-45cb-9a79-9504df81c0f6" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:57:14 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-26457615-dc18-437e-9489-f59a6f23b23f tempest-SnapshotMetadataTestJSON-658352555 None] Acquiring lock "cinder-quobyte-5e430bd0-073c-4d4c-827d-abf18feff002" by "_delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:57:14 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-26457615-dc18-437e-9489-f59a6f23b23f tempest-SnapshotMetadataTestJSON-658352555 None] Lock "cinder-quobyte-5e430bd0-073c-4d4c-827d-abf18feff002" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:57:14 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-26457615-dc18-437e-9489-f59a6f23b23f tempest-SnapshotMetadataTestJSON-658352555 None] Deleting offline snapshot 5e430bd0-073c-4d4c-827d-abf18feff002 of volume d1628609-3369-45cb-9a79-9504df81c0f6 {{(pid=87420) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 15:57:14 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-26457615-dc18-437e-9489-f59a6f23b23f tempest-SnapshotMetadataTestJSON-658352555 None] snapshot_file for this snap is: volume-d1628609-3369-45cb-9a79-9504df81c0f6.5e430bd0-073c-4d4c-827d-abf18feff002 {{(pid=87420) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 15:57:14 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a3af446-6ac8-4ce5-aab1-2d9d2eee3de7]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:57:14 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-26457615-dc18-437e-9489-f59a6f23b23f tempest-SnapshotMetadataTestJSON-658352555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d1628609-3369-45cb-9a79-9504df81c0f6.5e430bd0-073c-4d4c-827d-abf18feff002 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:57:14 devstack sudo[97076]: pam_unix(sudo:session): session closed for user root Jul 10 15:57:14 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-07889f1a-d098-46a7-85fc-01eed9c24d2b tempest-SnapshotsActionsTest-1918108303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.04b64570-a35a-4472-9f73-f425b6bccc9e" returned: 0 in 1.020s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:57:14 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-07889f1a-d098-46a7-85fc-01eed9c24d2b tempest-SnapshotsActionsTest-1918108303 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f2922929-98bb-4fec-bdd5-aad2d7870937(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87420) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 15:57:14 devstack sudo[97077]: pam_unix(sudo:session): session closed for user root Jul 10 15:57:14 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-34d21054-26f4-4345-b6c5-bd873b7ccb68 tempest-VolumesGetTest-474292535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-807a4247-0ce3-4abc-a04d-45c1c9e7acb8" returned: 0 in 1.016s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:57:14 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-34d21054-26f4-4345-b6c5-bd873b7ccb68 tempest-VolumesGetTest-474292535 None] <== create_volume: return (2081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 15:57:14 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-34d21054-26f4-4345-b6c5-bd873b7ccb68 tempest-VolumesGetTest-474292535 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.084s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:57:14 devstack sudo[97085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d1628609-3369-45cb-9a79-9504df81c0f6.5e430bd0-073c-4d4c-827d-abf18feff002 Jul 10 15:57:14 devstack sudo[97085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:57:14 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea1f6d70-6c64-4ae5-964a-82cba24ba2cf]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:57:14 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-07889f1a-d098-46a7-85fc-01eed9c24d2b tempest-SnapshotsActionsTest-1918108303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:57:14 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-34d21054-26f4-4345-b6c5-bd873b7ccb68 tempest-VolumesGetTest-474292535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b890b0c-1b49-42bc-9328-cd910e1a7972) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-807a4247-0ce3-4abc-a04d-45c1c9e7acb8', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:57:14 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-34d21054-26f4-4345-b6c5-bd873b7ccb68 tempest-VolumesGetTest-474292535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f9eef58-8739-4b9f-9c4f-c4b8db1ad4a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:57:14 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-34d21054-26f4-4345-b6c5-bd873b7ccb68 tempest-VolumesGetTest-474292535 None] Volume volume-807a4247-0ce3-4abc-a04d-45c1c9e7acb8 (807a4247-0ce3-4abc-a04d-45c1c9e7acb8): created successfully Jul 10 15:57:14 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-34d21054-26f4-4345-b6c5-bd873b7ccb68 tempest-VolumesGetTest-474292535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f9eef58-8739-4b9f-9c4f-c4b8db1ad4a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:57:14 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-34d21054-26f4-4345-b6c5-bd873b7ccb68 tempest-VolumesGetTest-474292535 None] Flow 'volume_create_manager' (7b028bcc-af37-41a6-9dcb-1c9b780f08e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:57:14 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-34d21054-26f4-4345-b6c5-bd873b7ccb68 tempest-VolumesGetTest-474292535 None] Created volume successfully. Jul 10 15:57:14 devstack sudo[97087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937 Jul 10 15:57:14 devstack sudo[97087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:57:15 devstack sudo[97085]: pam_unix(sudo:session): session closed for user root Jul 10 15:57:15 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-26457615-dc18-437e-9489-f59a6f23b23f tempest-SnapshotMetadataTestJSON-658352555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d1628609-3369-45cb-9a79-9504df81c0f6.5e430bd0-073c-4d4c-827d-abf18feff002" returned: 0 in 0.825s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:57:15 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-26457615-dc18-437e-9489-f59a6f23b23f tempest-SnapshotMetadataTestJSON-658352555 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d1628609-3369-45cb-9a79-9504df81c0f6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87420) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 15:57:15 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[43dcac5f-cf03-476a-b17d-c61c53c5dbd9]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:57:15 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-26457615-dc18-437e-9489-f59a6f23b23f tempest-SnapshotMetadataTestJSON-658352555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d1628609-3369-45cb-9a79-9504df81c0f6 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:57:15 devstack sudo[97095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d1628609-3369-45cb-9a79-9504df81c0f6 Jul 10 15:57:15 devstack sudo[97095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:57:15 devstack sudo[97087]: pam_unix(sudo:session): session closed for user root Jul 10 15:57:15 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-07889f1a-d098-46a7-85fc-01eed9c24d2b tempest-SnapshotsActionsTest-1918108303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937" returned: 0 in 0.987s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:57:15 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-07889f1a-d098-46a7-85fc-01eed9c24d2b tempest-SnapshotsActionsTest-1918108303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.04b64570-a35a-4472-9f73-f425b6bccc9e {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:57:15 devstack sudo[97097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.04b64570-a35a-4472-9f73-f425b6bccc9e Jul 10 15:57:15 devstack sudo[97097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:57:16 devstack sudo[97095]: pam_unix(sudo:session): session closed for user root Jul 10 15:57:16 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-26457615-dc18-437e-9489-f59a6f23b23f tempest-SnapshotMetadataTestJSON-658352555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d1628609-3369-45cb-9a79-9504df81c0f6" returned: 0 in 1.071s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:57:16 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-26457615-dc18-437e-9489-f59a6f23b23f tempest-SnapshotMetadataTestJSON-658352555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d1628609-3369-45cb-9a79-9504df81c0f6.5e430bd0-073c-4d4c-827d-abf18feff002 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:57:16 devstack sudo[97105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d1628609-3369-45cb-9a79-9504df81c0f6.5e430bd0-073c-4d4c-827d-abf18feff002 Jul 10 15:57:16 devstack sudo[97105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:57:16 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d5ecae2-1101-4087-a471-b311218fdc00 tempest-VolumesGetTest-474292535 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 15:57:16 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-2d5ecae2-1101-4087-a471-b311218fdc00 tempest-VolumesGetTest-474292535 None] Flow 'volume_create_manager' (4b2359ba-53fa-4ee4-94ec-0c95e4429e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:57:16 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-2d5ecae2-1101-4087-a471-b311218fdc00 tempest-VolumesGetTest-474292535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (155f390a-0596-48c4-9dfd-cca98131594b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:57:16 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-2d5ecae2-1101-4087-a471-b311218fdc00 tempest-VolumesGetTest-474292535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (155f390a-0596-48c4-9dfd-cca98131594b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:57:16Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2132583387',display_name='tempest-VolumesGetTest-Volume-2060615926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60838e6d-edfe-42c1-8483-b0ed6757aa85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e1e4affd8f342e2a93b8606ed90299a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:57:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:57:17Z,use_quota=True,user_id='fd5c633b5ab34f4fa42d3bf6bcfa01a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:57:16 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-2d5ecae2-1101-4087-a471-b311218fdc00 tempest-VolumesGetTest-474292535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f6bf092-ab96-44c7-be75-068da2bec9cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:57:16 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-2d5ecae2-1101-4087-a471-b311218fdc00 tempest-VolumesGetTest-474292535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f6bf092-ab96-44c7-be75-068da2bec9cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:57:16 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-2d5ecae2-1101-4087-a471-b311218fdc00 tempest-VolumesGetTest-474292535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e0664fb-dd47-42c1-9c28-b0d8ea1c75a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:57:16 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-2d5ecae2-1101-4087-a471-b311218fdc00 tempest-VolumesGetTest-474292535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e0664fb-dd47-42c1-9c28-b0d8ea1c75a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60838e6d-edfe-42c1-8483-b0ed6757aa85', 'volume_name': 'volume-60838e6d-edfe-42c1-8483-b0ed6757aa85', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:57:16 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-2d5ecae2-1101-4087-a471-b311218fdc00 tempest-VolumesGetTest-474292535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f24647b0-68d9-47ad-ab49-3d063859eaf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:57:16 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-2d5ecae2-1101-4087-a471-b311218fdc00 tempest-VolumesGetTest-474292535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f24647b0-68d9-47ad-ab49-3d063859eaf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:57:16 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-2d5ecae2-1101-4087-a471-b311218fdc00 tempest-VolumesGetTest-474292535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78ac7511-e300-4f07-8ff6-2bef6df08937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:57:16 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-2d5ecae2-1101-4087-a471-b311218fdc00 tempest-VolumesGetTest-474292535 None] Volume 60838e6d-edfe-42c1-8483-b0ed6757aa85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60838e6d-edfe-42c1-8483-b0ed6757aa85', 'volume_size': 1} Jul 10 15:57:16 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-2d5ecae2-1101-4087-a471-b311218fdc00 tempest-VolumesGetTest-474292535 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:57:16 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-2d5ecae2-1101-4087-a471-b311218fdc00 tempest-VolumesGetTest-474292535 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:57:16 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-2d5ecae2-1101-4087-a471-b311218fdc00 tempest-VolumesGetTest-474292535 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:57:16Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2132583387',display_name='tempest-VolumesGetTest-Volume-2060615926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60838e6d-edfe-42c1-8483-b0ed6757aa85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e1e4affd8f342e2a93b8606ed90299a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:57:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:57:17Z,use_quota=True,user_id='fd5c633b5ab34f4fa42d3bf6bcfa01a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 15:57:16 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-2d5ecae2-1101-4087-a471-b311218fdc00 tempest-VolumesGetTest-474292535 None] Creating volume 60838e6d-edfe-42c1-8483-b0ed6757aa85 {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 15:57:16 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-2d5ecae2-1101-4087-a471-b311218fdc00 tempest-VolumesGetTest-474292535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:57:16 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-2d5ecae2-1101-4087-a471-b311218fdc00 tempest-VolumesGetTest-474292535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:57:16 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-2d5ecae2-1101-4087-a471-b311218fdc00 tempest-VolumesGetTest-474292535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:57:16 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-2d5ecae2-1101-4087-a471-b311218fdc00 tempest-VolumesGetTest-474292535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:57:16 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-2d5ecae2-1101-4087-a471-b311218fdc00 tempest-VolumesGetTest-474292535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:57:16 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-2d5ecae2-1101-4087-a471-b311218fdc00 tempest-VolumesGetTest-474292535 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 15:57:16 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-2d5ecae2-1101-4087-a471-b311218fdc00 tempest-VolumesGetTest-474292535 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 15:57:16 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-2d5ecae2-1101-4087-a471-b311218fdc00 tempest-VolumesGetTest-474292535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-60838e6d-edfe-42c1-8483-b0ed6757aa85 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:57:16 devstack sudo[97107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-60838e6d-edfe-42c1-8483-b0ed6757aa85 1073741824 Jul 10 15:57:16 devstack sudo[97107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:57:16 devstack sudo[97097]: pam_unix(sudo:session): session closed for user root Jul 10 15:57:16 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-07889f1a-d098-46a7-85fc-01eed9c24d2b tempest-SnapshotsActionsTest-1918108303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.04b64570-a35a-4472-9f73-f425b6bccc9e" returned: 0 in 1.165s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:57:16 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-07889f1a-d098-46a7-85fc-01eed9c24d2b tempest-SnapshotsActionsTest-1918108303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.04b64570-a35a-4472-9f73-f425b6bccc9e {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:57:16 devstack sudo[97109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.04b64570-a35a-4472-9f73-f425b6bccc9e Jul 10 15:57:16 devstack sudo[97109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:57:17 devstack cinder-volume[87420]: DEBUG oslo_service.periodic_task [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87420) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 15:57:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:57:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:57:17 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:57:17 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:57:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:57:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:57:17 devstack sudo[97114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 15:57:17 devstack sudo[97114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:57:17 devstack sudo[97105]: pam_unix(sudo:session): session closed for user root Jul 10 15:57:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-26457615-dc18-437e-9489-f59a6f23b23f tempest-SnapshotMetadataTestJSON-658352555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d1628609-3369-45cb-9a79-9504df81c0f6.5e430bd0-073c-4d4c-827d-abf18feff002" returned: 0 in 0.950s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:57:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-26457615-dc18-437e-9489-f59a6f23b23f tempest-SnapshotMetadataTestJSON-658352555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d1628609-3369-45cb-9a79-9504df81c0f6.5e430bd0-073c-4d4c-827d-abf18feff002 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:57:17 devstack sudo[97120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d1628609-3369-45cb-9a79-9504df81c0f6.5e430bd0-073c-4d4c-827d-abf18feff002 Jul 10 15:57:17 devstack sudo[97120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:57:17 devstack sudo[97107]: pam_unix(sudo:session): session closed for user root Jul 10 15:57:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-2d5ecae2-1101-4087-a471-b311218fdc00 tempest-VolumesGetTest-474292535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-60838e6d-edfe-42c1-8483-b0ed6757aa85 1073741824" returned: 0 in 1.044s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:57:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-2d5ecae2-1101-4087-a471-b311218fdc00 tempest-VolumesGetTest-474292535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-60838e6d-edfe-42c1-8483-b0ed6757aa85 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:57:17 devstack sudo[97109]: pam_unix(sudo:session): session closed for user root Jul 10 15:57:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-07889f1a-d098-46a7-85fc-01eed9c24d2b tempest-SnapshotsActionsTest-1918108303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937.04b64570-a35a-4472-9f73-f425b6bccc9e" returned: 0 in 1.042s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:57:18 devstack sudo[97123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-60838e6d-edfe-42c1-8483-b0ed6757aa85 Jul 10 15:57:18 devstack sudo[97123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:57:18 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-07889f1a-d098-46a7-85fc-01eed9c24d2b tempest-SnapshotsActionsTest-1918108303 None] Lock "cinder-quobyte-04b64570-a35a-4472-9f73-f425b6bccc9e" released by "_delete_snapshot" :: held 4.370s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:57:18 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-07889f1a-d098-46a7-85fc-01eed9c24d2b tempest-SnapshotsActionsTest-1918108303 None] Lock "cinder-quobyte-f2922929-98bb-4fec-bdd5-aad2d7870937" released by "delete_snapshot" :: held 4.403s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:57:18 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-07889f1a-d098-46a7-85fc-01eed9c24d2b tempest-SnapshotsActionsTest-1918108303 None] Created reservations ['ddcf8c1a-f51a-4340-b769-5bd442c57121', 'f7e98193-ae13-408a-a857-258afcbdbc14', '07f3fc89-966d-4d7b-a7c2-5b30b206b685', '3829a2fc-83a8-4ba8-a756-d570b2b19e08'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 15:57:18 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-07889f1a-d098-46a7-85fc-01eed9c24d2b tempest-SnapshotsActionsTest-1918108303 None] Delete snapshot completed successfully. Jul 10 15:57:18 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-07889f1a-d098-46a7-85fc-01eed9c24d2b tempest-SnapshotsActionsTest-1918108303 None] Lock "cinder-04b64570-a35a-4472-9f73-f425b6bccc9e-delete_snapshot" released by "delete_snapshot" :: held 4.636s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:57:18 devstack sudo[97114]: pam_unix(sudo:session): session closed for user root Jul 10 15:57:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.882s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:57:18 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 15:57:18 devstack cinder-volume[87420]: DEBUG oslo_service.periodic_task [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Running periodic task VolumeManager._thread_info {{(pid=87420) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 15:57:18 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] thread count: 28 {{(pid=87420) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 15:57:18 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] thread info: [<_MainThread(MainThread, started 133639250378880)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87420) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 15:57:18 devstack sudo[97120]: pam_unix(sudo:session): session closed for user root Jul 10 15:57:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-26457615-dc18-437e-9489-f59a6f23b23f tempest-SnapshotMetadataTestJSON-658352555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d1628609-3369-45cb-9a79-9504df81c0f6.5e430bd0-073c-4d4c-827d-abf18feff002" returned: 0 in 0.942s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:57:18 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-26457615-dc18-437e-9489-f59a6f23b23f tempest-SnapshotMetadataTestJSON-658352555 None] Lock "cinder-quobyte-5e430bd0-073c-4d4c-827d-abf18feff002" released by "_delete_snapshot" :: held 4.021s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:57:18 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-26457615-dc18-437e-9489-f59a6f23b23f tempest-SnapshotMetadataTestJSON-658352555 None] Lock "cinder-quobyte-d1628609-3369-45cb-9a79-9504df81c0f6" released by "delete_snapshot" :: held 4.057s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:57:18 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-26457615-dc18-437e-9489-f59a6f23b23f tempest-SnapshotMetadataTestJSON-658352555 None] Created reservations ['dc801b34-a38b-4dc8-ba58-6dad72dd3f1e', '7d86f97a-2a1e-46d1-9f9e-0baf3cae3888', 'd5558c1f-f7e2-4909-b1a3-0f3dfb4a6311', '07f463af-59c9-4884-a5ee-c1526927190c'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 15:57:18 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-26457615-dc18-437e-9489-f59a6f23b23f tempest-SnapshotMetadataTestJSON-658352555 None] Delete snapshot completed successfully. Jul 10 15:57:18 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-26457615-dc18-437e-9489-f59a6f23b23f tempest-SnapshotMetadataTestJSON-658352555 None] Lock "cinder-5e430bd0-073c-4d4c-827d-abf18feff002-delete_snapshot" released by "delete_snapshot" :: held 4.253s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:57:18 devstack sudo[97123]: pam_unix(sudo:session): session closed for user root Jul 10 15:57:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-2d5ecae2-1101-4087-a471-b311218fdc00 tempest-VolumesGetTest-474292535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-60838e6d-edfe-42c1-8483-b0ed6757aa85" returned: 0 in 0.878s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:57:18 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-2d5ecae2-1101-4087-a471-b311218fdc00 tempest-VolumesGetTest-474292535 None] <== create_volume: return (1986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 15:57:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-2d5ecae2-1101-4087-a471-b311218fdc00 tempest-VolumesGetTest-474292535 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.990s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:57:18 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-2d5ecae2-1101-4087-a471-b311218fdc00 tempest-VolumesGetTest-474292535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78ac7511-e300-4f07-8ff6-2bef6df08937) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60838e6d-edfe-42c1-8483-b0ed6757aa85', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:57:18 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-2d5ecae2-1101-4087-a471-b311218fdc00 tempest-VolumesGetTest-474292535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bb3615f-235d-4249-addf-3f73addb8982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:57:18 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-2d5ecae2-1101-4087-a471-b311218fdc00 tempest-VolumesGetTest-474292535 None] Volume volume-60838e6d-edfe-42c1-8483-b0ed6757aa85 (60838e6d-edfe-42c1-8483-b0ed6757aa85): created successfully Jul 10 15:57:18 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-2d5ecae2-1101-4087-a471-b311218fdc00 tempest-VolumesGetTest-474292535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bb3615f-235d-4249-addf-3f73addb8982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:57:18 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-2d5ecae2-1101-4087-a471-b311218fdc00 tempest-VolumesGetTest-474292535 None] Flow 'volume_create_manager' (4b2359ba-53fa-4ee4-94ec-0c95e4429e94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:57:18 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-2d5ecae2-1101-4087-a471-b311218fdc00 tempest-VolumesGetTest-474292535 None] Created volume successfully. Jul 10 15:57:18 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-b351de7e-e250-469a-878b-0c8f3d2a2caa tempest-SnapshotMetadataTestJSON-658352555 None] Acquiring lock "cinder-d1628609-3369-45cb-9a79-9504df81c0f6-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:57:19 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-dc2101a1-7189-4dba-996f-767a7c78f191 tempest-SnapshotsActionsTest-1918108303 None] Acquiring lock "cinder-f2922929-98bb-4fec-bdd5-aad2d7870937-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:57:19 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-b351de7e-e250-469a-878b-0c8f3d2a2caa tempest-SnapshotMetadataTestJSON-658352555 None] Lock "cinder-d1628609-3369-45cb-9a79-9504df81c0f6-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:57:19 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-dc2101a1-7189-4dba-996f-767a7c78f191 tempest-SnapshotsActionsTest-1918108303 None] Lock "cinder-f2922929-98bb-4fec-bdd5-aad2d7870937-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:57:19 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-b351de7e-e250-469a-878b-0c8f3d2a2caa tempest-SnapshotMetadataTestJSON-658352555 None] Acquiring lock "cinder-quobyte-d1628609-3369-45cb-9a79-9504df81c0f6" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:57:19 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-dc2101a1-7189-4dba-996f-767a7c78f191 tempest-SnapshotsActionsTest-1918108303 None] Acquiring lock "cinder-quobyte-f2922929-98bb-4fec-bdd5-aad2d7870937" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:57:19 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-b351de7e-e250-469a-878b-0c8f3d2a2caa tempest-SnapshotMetadataTestJSON-658352555 None] Lock "cinder-quobyte-d1628609-3369-45cb-9a79-9504df81c0f6" acquired by "delete_volume" :: waited 0.027s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:57:19 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-dc2101a1-7189-4dba-996f-767a7c78f191 tempest-SnapshotsActionsTest-1918108303 None] Lock "cinder-quobyte-f2922929-98bb-4fec-bdd5-aad2d7870937" acquired by "delete_volume" :: waited 0.051s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:57:19 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3320e4d-ca67-4ea5-a9b2-c3431ddf6bf2]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:57:19 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-b351de7e-e250-469a-878b-0c8f3d2a2caa tempest-SnapshotMetadataTestJSON-658352555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d1628609-3369-45cb-9a79-9504df81c0f6 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:57:19 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb0fe1a-2969-47e6-8381-c97f9540d9aa]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:57:19 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-dc2101a1-7189-4dba-996f-767a7c78f191 tempest-SnapshotsActionsTest-1918108303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:57:19 devstack sudo[97128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d1628609-3369-45cb-9a79-9504df81c0f6 Jul 10 15:57:19 devstack sudo[97128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:57:19 devstack sudo[97129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937 Jul 10 15:57:19 devstack sudo[97129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:57:20 devstack sudo[97129]: pam_unix(sudo:session): session closed for user root Jul 10 15:57:20 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-dc2101a1-7189-4dba-996f-767a7c78f191 tempest-SnapshotsActionsTest-1918108303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937" returned: 0 in 0.824s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:57:20 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-dc2101a1-7189-4dba-996f-767a7c78f191 tempest-SnapshotsActionsTest-1918108303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:57:20 devstack sudo[97128]: pam_unix(sudo:session): session closed for user root Jul 10 15:57:20 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-b351de7e-e250-469a-878b-0c8f3d2a2caa tempest-SnapshotMetadataTestJSON-658352555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d1628609-3369-45cb-9a79-9504df81c0f6" returned: 0 in 0.881s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:57:20 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-b351de7e-e250-469a-878b-0c8f3d2a2caa tempest-SnapshotMetadataTestJSON-658352555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d1628609-3369-45cb-9a79-9504df81c0f6 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:57:20 devstack sudo[97139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937 Jul 10 15:57:20 devstack sudo[97139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:57:20 devstack sudo[97140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d1628609-3369-45cb-9a79-9504df81c0f6 Jul 10 15:57:20 devstack sudo[97140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:57:20 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-6bb60c15-7307-46ec-a30e-8bb05fe04196 tempest-VolumesGetTest-474292535 None] Acquiring lock "cinder-60838e6d-edfe-42c1-8483-b0ed6757aa85-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:57:20 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-6bb60c15-7307-46ec-a30e-8bb05fe04196 tempest-VolumesGetTest-474292535 None] Lock "cinder-60838e6d-edfe-42c1-8483-b0ed6757aa85-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:57:20 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-6bb60c15-7307-46ec-a30e-8bb05fe04196 tempest-VolumesGetTest-474292535 None] Acquiring lock "cinder-quobyte-60838e6d-edfe-42c1-8483-b0ed6757aa85" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:57:20 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-6bb60c15-7307-46ec-a30e-8bb05fe04196 tempest-VolumesGetTest-474292535 None] Lock "cinder-quobyte-60838e6d-edfe-42c1-8483-b0ed6757aa85" acquired by "delete_volume" :: waited 0.030s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:57:20 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa394424-ff4d-4373-af5f-79b5cbfa9e74]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:57:20 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6bb60c15-7307-46ec-a30e-8bb05fe04196 tempest-VolumesGetTest-474292535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-60838e6d-edfe-42c1-8483-b0ed6757aa85 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:57:20 devstack sudo[97143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-60838e6d-edfe-42c1-8483-b0ed6757aa85 Jul 10 15:57:20 devstack sudo[97143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:57:20 devstack sudo[97140]: pam_unix(sudo:session): session closed for user root Jul 10 15:57:20 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-b351de7e-e250-469a-878b-0c8f3d2a2caa tempest-SnapshotMetadataTestJSON-658352555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d1628609-3369-45cb-9a79-9504df81c0f6" returned: 0 in 0.904s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:57:20 devstack sudo[97139]: pam_unix(sudo:session): session closed for user root Jul 10 15:57:21 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-dc2101a1-7189-4dba-996f-767a7c78f191 tempest-SnapshotsActionsTest-1918108303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f2922929-98bb-4fec-bdd5-aad2d7870937" returned: 0 in 0.964s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:57:21 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-b351de7e-e250-469a-878b-0c8f3d2a2caa tempest-SnapshotMetadataTestJSON-658352555 None] Lock "cinder-quobyte-d1628609-3369-45cb-9a79-9504df81c0f6" released by "delete_volume" :: held 1.879s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:57:21 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-dc2101a1-7189-4dba-996f-767a7c78f191 tempest-SnapshotsActionsTest-1918108303 None] Lock "cinder-quobyte-f2922929-98bb-4fec-bdd5-aad2d7870937" released by "delete_volume" :: held 1.863s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:57:21 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-b351de7e-e250-469a-878b-0c8f3d2a2caa tempest-SnapshotMetadataTestJSON-658352555 None] Created reservations ['333268c1-ed8d-4207-a4df-a8e28447e2b9', '0acc7b66-205c-4176-b01f-22fc6e32d93c', '95cba3f4-cb86-4707-a4ff-6137fbbce97c', '5da10e65-6d78-4e90-b640-51762f474c5f'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 15:57:21 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-dc2101a1-7189-4dba-996f-767a7c78f191 tempest-SnapshotsActionsTest-1918108303 None] Created reservations ['01e6669d-78d5-481a-af4e-847596ff8e04', 'eb174e20-ac96-48f2-b84a-119466f40e98', '5dbbf769-b7de-4e13-85b6-c5437e50777d', 'fa01b82c-3839-476a-b11f-4059e4c8bb69'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 15:57:21 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-b351de7e-e250-469a-878b-0c8f3d2a2caa tempest-SnapshotMetadataTestJSON-658352555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:57:21 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-b351de7e-e250-469a-878b-0c8f3d2a2caa tempest-SnapshotMetadataTestJSON-658352555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:57:21 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-b351de7e-e250-469a-878b-0c8f3d2a2caa tempest-SnapshotMetadataTestJSON-658352555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:57:21 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-b351de7e-e250-469a-878b-0c8f3d2a2caa tempest-SnapshotMetadataTestJSON-658352555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:57:21 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-b351de7e-e250-469a-878b-0c8f3d2a2caa tempest-SnapshotMetadataTestJSON-658352555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:57:21 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-b351de7e-e250-469a-878b-0c8f3d2a2caa tempest-SnapshotMetadataTestJSON-658352555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:57:21 devstack sudo[97150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 15:57:21 devstack sudo[97150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:57:21 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-dc2101a1-7189-4dba-996f-767a7c78f191 tempest-SnapshotsActionsTest-1918108303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:57:21 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-dc2101a1-7189-4dba-996f-767a7c78f191 tempest-SnapshotsActionsTest-1918108303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:57:21 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-dc2101a1-7189-4dba-996f-767a7c78f191 tempest-SnapshotsActionsTest-1918108303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:57:21 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-dc2101a1-7189-4dba-996f-767a7c78f191 tempest-SnapshotsActionsTest-1918108303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:57:21 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-dc2101a1-7189-4dba-996f-767a7c78f191 tempest-SnapshotsActionsTest-1918108303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:57:21 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-dc2101a1-7189-4dba-996f-767a7c78f191 tempest-SnapshotsActionsTest-1918108303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:57:21 devstack sudo[97143]: pam_unix(sudo:session): session closed for user root Jul 10 15:57:21 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6bb60c15-7307-46ec-a30e-8bb05fe04196 tempest-VolumesGetTest-474292535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-60838e6d-edfe-42c1-8483-b0ed6757aa85" returned: 0 in 0.995s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:57:21 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6bb60c15-7307-46ec-a30e-8bb05fe04196 tempest-VolumesGetTest-474292535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-60838e6d-edfe-42c1-8483-b0ed6757aa85 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:57:21 devstack sudo[97152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 15:57:21 devstack sudo[97152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:57:21 devstack sudo[97153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-60838e6d-edfe-42c1-8483-b0ed6757aa85 Jul 10 15:57:21 devstack sudo[97153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:57:22 devstack sudo[97153]: pam_unix(sudo:session): session closed for user root Jul 10 15:57:22 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6bb60c15-7307-46ec-a30e-8bb05fe04196 tempest-VolumesGetTest-474292535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-60838e6d-edfe-42c1-8483-b0ed6757aa85" returned: 0 in 1.040s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:57:22 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-6bb60c15-7307-46ec-a30e-8bb05fe04196 tempest-VolumesGetTest-474292535 None] Lock "cinder-quobyte-60838e6d-edfe-42c1-8483-b0ed6757aa85" released by "delete_volume" :: held 2.115s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:57:22 devstack sudo[97150]: pam_unix(sudo:session): session closed for user root Jul 10 15:57:22 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-b351de7e-e250-469a-878b-0c8f3d2a2caa tempest-SnapshotMetadataTestJSON-658352555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 1.227s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:57:22 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-b351de7e-e250-469a-878b-0c8f3d2a2caa tempest-SnapshotMetadataTestJSON-658352555 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 15:57:22 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-b351de7e-e250-469a-878b-0c8f3d2a2caa tempest-SnapshotMetadataTestJSON-658352555 None] Deleted volume successfully. Jul 10 15:57:22 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-b351de7e-e250-469a-878b-0c8f3d2a2caa tempest-SnapshotMetadataTestJSON-658352555 None] Lock "cinder-d1628609-3369-45cb-9a79-9504df81c0f6-delete_volume" released by "delete_volume" :: held 3.508s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:57:22 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-6bb60c15-7307-46ec-a30e-8bb05fe04196 tempest-VolumesGetTest-474292535 None] Created reservations ['68e8b6f6-bc5f-4819-80cc-fa642608f0c7', '1a8192cd-76c5-4f33-b295-6b48e6d47a85', '03a82116-8b41-4f88-8880-310b054a3d17', '16f3c70b-3c46-475b-a336-efe789ae9895'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 15:57:22 devstack sudo[97152]: pam_unix(sudo:session): session closed for user root Jul 10 15:57:22 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-dc2101a1-7189-4dba-996f-767a7c78f191 tempest-SnapshotsActionsTest-1918108303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 1.416s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:57:22 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-dc2101a1-7189-4dba-996f-767a7c78f191 tempest-SnapshotsActionsTest-1918108303 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 15:57:22 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-dc2101a1-7189-4dba-996f-767a7c78f191 tempest-SnapshotsActionsTest-1918108303 None] Deleted volume successfully. Jul 10 15:57:22 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-dc2101a1-7189-4dba-996f-767a7c78f191 tempest-SnapshotsActionsTest-1918108303 None] Lock "cinder-f2922929-98bb-4fec-bdd5-aad2d7870937-delete_volume" released by "delete_volume" :: held 3.702s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:57:22 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-6bb60c15-7307-46ec-a30e-8bb05fe04196 tempest-VolumesGetTest-474292535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:57:22 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-6bb60c15-7307-46ec-a30e-8bb05fe04196 tempest-VolumesGetTest-474292535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:57:22 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-6bb60c15-7307-46ec-a30e-8bb05fe04196 tempest-VolumesGetTest-474292535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:57:22 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-6bb60c15-7307-46ec-a30e-8bb05fe04196 tempest-VolumesGetTest-474292535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:57:22 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-6bb60c15-7307-46ec-a30e-8bb05fe04196 tempest-VolumesGetTest-474292535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:57:22 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6bb60c15-7307-46ec-a30e-8bb05fe04196 tempest-VolumesGetTest-474292535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:57:22 devstack sudo[97160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 15:57:22 devstack sudo[97160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:57:23 devstack sudo[97160]: pam_unix(sudo:session): session closed for user root Jul 10 15:57:23 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6bb60c15-7307-46ec-a30e-8bb05fe04196 tempest-VolumesGetTest-474292535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.850s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:57:23 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-6bb60c15-7307-46ec-a30e-8bb05fe04196 tempest-VolumesGetTest-474292535 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 15:57:23 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-6bb60c15-7307-46ec-a30e-8bb05fe04196 tempest-VolumesGetTest-474292535 None] Deleted volume successfully. Jul 10 15:57:23 devstack cinder-volume[87420]: DEBUG dbcounter [-] [87420] Writing DB stats cinder:UPDATE=185,cinder:SELECT=142,cinder:INSERT=51,cinder:DELETE=16 {{(pid=87420) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 15:57:23 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-6bb60c15-7307-46ec-a30e-8bb05fe04196 tempest-VolumesGetTest-474292535 None] Lock "cinder-60838e6d-edfe-42c1-8483-b0ed6757aa85-delete_volume" released by "delete_volume" :: held 3.536s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:57:23 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-c0120a6f-fcf4-408c-b063-4e0432efcca6 tempest-VolumesGetTest-474292535 None] Acquiring lock "cinder-807a4247-0ce3-4abc-a04d-45c1c9e7acb8-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:57:23 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-c0120a6f-fcf4-408c-b063-4e0432efcca6 tempest-VolumesGetTest-474292535 None] Lock "cinder-807a4247-0ce3-4abc-a04d-45c1c9e7acb8-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:57:23 devstack cinder-volume[87420]: DEBUG dbcounter [-] [87420] Writing DB stats cinder:UPDATE=188,cinder:SELECT=156,cinder:INSERT=56,cinder:DELETE=14 {{(pid=87420) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 15:57:23 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-c0120a6f-fcf4-408c-b063-4e0432efcca6 tempest-VolumesGetTest-474292535 None] Acquiring lock "cinder-quobyte-807a4247-0ce3-4abc-a04d-45c1c9e7acb8" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:57:23 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-c0120a6f-fcf4-408c-b063-4e0432efcca6 tempest-VolumesGetTest-474292535 None] Lock "cinder-quobyte-807a4247-0ce3-4abc-a04d-45c1c9e7acb8" acquired by "delete_volume" :: waited 0.023s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:57:23 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff84c2aa-af0c-42d1-8bb5-addafc00b243]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:57:23 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c0120a6f-fcf4-408c-b063-4e0432efcca6 tempest-VolumesGetTest-474292535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-807a4247-0ce3-4abc-a04d-45c1c9e7acb8 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:57:24 devstack sudo[97164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-807a4247-0ce3-4abc-a04d-45c1c9e7acb8 Jul 10 15:57:24 devstack sudo[97164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:57:24 devstack sudo[97164]: pam_unix(sudo:session): session closed for user root Jul 10 15:57:24 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c0120a6f-fcf4-408c-b063-4e0432efcca6 tempest-VolumesGetTest-474292535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-807a4247-0ce3-4abc-a04d-45c1c9e7acb8" returned: 0 in 0.974s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:57:24 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c0120a6f-fcf4-408c-b063-4e0432efcca6 tempest-VolumesGetTest-474292535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-807a4247-0ce3-4abc-a04d-45c1c9e7acb8 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:57:24 devstack sudo[97171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-807a4247-0ce3-4abc-a04d-45c1c9e7acb8 Jul 10 15:57:24 devstack sudo[97171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:57:25 devstack sudo[97171]: pam_unix(sudo:session): session closed for user root Jul 10 15:57:25 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c0120a6f-fcf4-408c-b063-4e0432efcca6 tempest-VolumesGetTest-474292535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-807a4247-0ce3-4abc-a04d-45c1c9e7acb8" returned: 0 in 0.875s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:57:25 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-c0120a6f-fcf4-408c-b063-4e0432efcca6 tempest-VolumesGetTest-474292535 None] Lock "cinder-quobyte-807a4247-0ce3-4abc-a04d-45c1c9e7acb8" released by "delete_volume" :: held 1.956s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:57:25 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-c0120a6f-fcf4-408c-b063-4e0432efcca6 tempest-VolumesGetTest-474292535 None] Created reservations ['6172360f-fe79-48c8-8236-420bf94c8c5d', 'f81ba4f8-5fd4-465d-9143-f28c5f938e6b', 'f0fee6e1-1db4-4874-bef4-68c847ea4507', 'c5ff42c3-a149-4584-a6d6-1889ca0f4fe2'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 15:57:26 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-c0120a6f-fcf4-408c-b063-4e0432efcca6 tempest-VolumesGetTest-474292535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:57:26 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-c0120a6f-fcf4-408c-b063-4e0432efcca6 tempest-VolumesGetTest-474292535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:57:26 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-c0120a6f-fcf4-408c-b063-4e0432efcca6 tempest-VolumesGetTest-474292535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:57:26 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-c0120a6f-fcf4-408c-b063-4e0432efcca6 tempest-VolumesGetTest-474292535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:57:26 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-c0120a6f-fcf4-408c-b063-4e0432efcca6 tempest-VolumesGetTest-474292535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:57:26 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c0120a6f-fcf4-408c-b063-4e0432efcca6 tempest-VolumesGetTest-474292535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:57:26 devstack sudo[97174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 15:57:26 devstack sudo[97174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:57:26 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d1ce37c-0a44-4483-be66-a60e3d35545c tempest-VolumesGetTest-474292535 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 15:57:26 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6d1ce37c-0a44-4483-be66-a60e3d35545c tempest-VolumesGetTest-474292535 None] Flow 'volume_create_manager' (8cbcd9ee-f4d5-44ef-9bbc-d56075d508ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:57:26 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6d1ce37c-0a44-4483-be66-a60e3d35545c tempest-VolumesGetTest-474292535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5d353ab-a8e0-401c-9fb3-5aaf39e5186c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:57:27 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6d1ce37c-0a44-4483-be66-a60e3d35545c tempest-VolumesGetTest-474292535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5d353ab-a8e0-401c-9fb3-5aaf39e5186c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:57:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-117384375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a29793d6-41bd-4fa1-86d4-09dcac617856,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e1e4affd8f342e2a93b8606ed90299a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:57:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:57:27Z,use_quota=True,user_id='fd5c633b5ab34f4fa42d3bf6bcfa01a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:57:27 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6d1ce37c-0a44-4483-be66-a60e3d35545c tempest-VolumesGetTest-474292535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e55810e-7c3c-4bcf-b35a-3acf92b05550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:57:27 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6d1ce37c-0a44-4483-be66-a60e3d35545c tempest-VolumesGetTest-474292535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e55810e-7c3c-4bcf-b35a-3acf92b05550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:57:27 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6d1ce37c-0a44-4483-be66-a60e3d35545c tempest-VolumesGetTest-474292535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4f8d62a-f5f6-4d80-b2db-839dcf6e92e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:57:27 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6d1ce37c-0a44-4483-be66-a60e3d35545c tempest-VolumesGetTest-474292535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4f8d62a-f5f6-4d80-b2db-839dcf6e92e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a29793d6-41bd-4fa1-86d4-09dcac617856', 'volume_name': 'volume-a29793d6-41bd-4fa1-86d4-09dcac617856', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:57:27 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6d1ce37c-0a44-4483-be66-a60e3d35545c tempest-VolumesGetTest-474292535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (275d8074-56bc-45b2-9fee-be1ea35d2fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:57:27 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6d1ce37c-0a44-4483-be66-a60e3d35545c tempest-VolumesGetTest-474292535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (275d8074-56bc-45b2-9fee-be1ea35d2fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:57:27 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6d1ce37c-0a44-4483-be66-a60e3d35545c tempest-VolumesGetTest-474292535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1aa83586-5ade-4e54-bd84-b24c64b399dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:57:27 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-6d1ce37c-0a44-4483-be66-a60e3d35545c tempest-VolumesGetTest-474292535 None] Volume a29793d6-41bd-4fa1-86d4-09dcac617856: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a29793d6-41bd-4fa1-86d4-09dcac617856', 'volume_size': 1} Jul 10 15:57:27 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-6d1ce37c-0a44-4483-be66-a60e3d35545c tempest-VolumesGetTest-474292535 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:57:27 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-6d1ce37c-0a44-4483-be66-a60e3d35545c tempest-VolumesGetTest-474292535 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:57:27 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-6d1ce37c-0a44-4483-be66-a60e3d35545c tempest-VolumesGetTest-474292535 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:57:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-117384375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a29793d6-41bd-4fa1-86d4-09dcac617856,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e1e4affd8f342e2a93b8606ed90299a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:57:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:57:27Z,use_quota=True,user_id='fd5c633b5ab34f4fa42d3bf6bcfa01a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 15:57:27 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-6d1ce37c-0a44-4483-be66-a60e3d35545c tempest-VolumesGetTest-474292535 None] Creating volume a29793d6-41bd-4fa1-86d4-09dcac617856 {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 15:57:27 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-6d1ce37c-0a44-4483-be66-a60e3d35545c tempest-VolumesGetTest-474292535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:57:27 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-6d1ce37c-0a44-4483-be66-a60e3d35545c tempest-VolumesGetTest-474292535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:57:27 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-6d1ce37c-0a44-4483-be66-a60e3d35545c tempest-VolumesGetTest-474292535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:57:27 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-6d1ce37c-0a44-4483-be66-a60e3d35545c tempest-VolumesGetTest-474292535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:57:27 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-6d1ce37c-0a44-4483-be66-a60e3d35545c tempest-VolumesGetTest-474292535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:57:27 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-6d1ce37c-0a44-4483-be66-a60e3d35545c tempest-VolumesGetTest-474292535 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 15:57:27 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-6d1ce37c-0a44-4483-be66-a60e3d35545c tempest-VolumesGetTest-474292535 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 15:57:27 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6d1ce37c-0a44-4483-be66-a60e3d35545c tempest-VolumesGetTest-474292535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a29793d6-41bd-4fa1-86d4-09dcac617856 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:57:27 devstack sudo[97174]: pam_unix(sudo:session): session closed for user root Jul 10 15:57:27 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c0120a6f-fcf4-408c-b063-4e0432efcca6 tempest-VolumesGetTest-474292535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 1.071s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:57:27 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-c0120a6f-fcf4-408c-b063-4e0432efcca6 tempest-VolumesGetTest-474292535 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 15:57:27 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-c0120a6f-fcf4-408c-b063-4e0432efcca6 tempest-VolumesGetTest-474292535 None] Deleted volume successfully. Jul 10 15:57:27 devstack sudo[97177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a29793d6-41bd-4fa1-86d4-09dcac617856 1073741824 Jul 10 15:57:27 devstack sudo[97177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:57:27 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-c0120a6f-fcf4-408c-b063-4e0432efcca6 tempest-VolumesGetTest-474292535 None] Lock "cinder-807a4247-0ce3-4abc-a04d-45c1c9e7acb8-delete_volume" released by "delete_volume" :: held 3.343s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:57:28 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-dea59bfa-57b1-4dd6-966c-d407d7b7bc07 tempest-AbsoluteLimitsTests-1778864652 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 15:57:28 devstack sudo[97177]: pam_unix(sudo:session): session closed for user root Jul 10 15:57:28 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-dea59bfa-57b1-4dd6-966c-d407d7b7bc07 tempest-AbsoluteLimitsTests-1778864652 None] Flow 'volume_create_manager' (8a4a03a6-a1db-4070-a870-19d698a8b82f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:57:28 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-dea59bfa-57b1-4dd6-966c-d407d7b7bc07 tempest-AbsoluteLimitsTests-1778864652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b86b9f32-3960-4fe4-8441-8022681652df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:57:28 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6d1ce37c-0a44-4483-be66-a60e3d35545c tempest-VolumesGetTest-474292535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a29793d6-41bd-4fa1-86d4-09dcac617856 1073741824" returned: 0 in 1.170s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:57:28 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-dea59bfa-57b1-4dd6-966c-d407d7b7bc07 tempest-AbsoluteLimitsTests-1778864652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b86b9f32-3960-4fe4-8441-8022681652df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:57:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-663077728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a96dd13-546f-4883-bad6-132ca07e4b74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e473e05f6cf4e08ab08c985965a874d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:57:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:57:28Z,use_quota=True,user_id='ef5bd27901394d32b66f9f364622a862',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:57:28 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-dea59bfa-57b1-4dd6-966c-d407d7b7bc07 tempest-AbsoluteLimitsTests-1778864652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a1f2c80-99bd-4d18-9d97-97b5fb206ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:57:28 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-dea59bfa-57b1-4dd6-966c-d407d7b7bc07 tempest-AbsoluteLimitsTests-1778864652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a1f2c80-99bd-4d18-9d97-97b5fb206ba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:57:28 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-dea59bfa-57b1-4dd6-966c-d407d7b7bc07 tempest-AbsoluteLimitsTests-1778864652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5786f6f6-f9cd-4cb6-9048-290eec50a464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:57:28 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-dea59bfa-57b1-4dd6-966c-d407d7b7bc07 tempest-AbsoluteLimitsTests-1778864652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5786f6f6-f9cd-4cb6-9048-290eec50a464) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a96dd13-546f-4883-bad6-132ca07e4b74', 'volume_name': 'volume-2a96dd13-546f-4883-bad6-132ca07e4b74', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:57:28 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-dea59bfa-57b1-4dd6-966c-d407d7b7bc07 tempest-AbsoluteLimitsTests-1778864652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (987aaea1-dd76-41ac-9941-2d0440133138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:57:28 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-dea59bfa-57b1-4dd6-966c-d407d7b7bc07 tempest-AbsoluteLimitsTests-1778864652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (987aaea1-dd76-41ac-9941-2d0440133138) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:57:28 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-dea59bfa-57b1-4dd6-966c-d407d7b7bc07 tempest-AbsoluteLimitsTests-1778864652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a19d097-be59-4203-a00a-33cbaf4f78cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:57:28 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-dea59bfa-57b1-4dd6-966c-d407d7b7bc07 tempest-AbsoluteLimitsTests-1778864652 None] Volume 2a96dd13-546f-4883-bad6-132ca07e4b74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a96dd13-546f-4883-bad6-132ca07e4b74', 'volume_size': 1} Jul 10 15:57:28 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-dea59bfa-57b1-4dd6-966c-d407d7b7bc07 tempest-AbsoluteLimitsTests-1778864652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:57:28 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6d1ce37c-0a44-4483-be66-a60e3d35545c tempest-VolumesGetTest-474292535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a29793d6-41bd-4fa1-86d4-09dcac617856 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:57:28 devstack sudo[97183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a29793d6-41bd-4fa1-86d4-09dcac617856 Jul 10 15:57:28 devstack sudo[97183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:57:29 devstack sudo[97183]: pam_unix(sudo:session): session closed for user root Jul 10 15:57:29 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6d1ce37c-0a44-4483-be66-a60e3d35545c tempest-VolumesGetTest-474292535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a29793d6-41bd-4fa1-86d4-09dcac617856" returned: 0 in 0.684s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:57:29 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-6d1ce37c-0a44-4483-be66-a60e3d35545c tempest-VolumesGetTest-474292535 None] <== create_volume: return (1960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 15:57:29 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-6d1ce37c-0a44-4483-be66-a60e3d35545c tempest-VolumesGetTest-474292535 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.964s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:57:29 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-dea59bfa-57b1-4dd6-966c-d407d7b7bc07 tempest-AbsoluteLimitsTests-1778864652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.727s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:57:29 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-dea59bfa-57b1-4dd6-966c-d407d7b7bc07 tempest-AbsoluteLimitsTests-1778864652 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:57:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-663077728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a96dd13-546f-4883-bad6-132ca07e4b74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e473e05f6cf4e08ab08c985965a874d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:57:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:57:28Z,use_quota=True,user_id='ef5bd27901394d32b66f9f364622a862',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 15:57:29 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-dea59bfa-57b1-4dd6-966c-d407d7b7bc07 tempest-AbsoluteLimitsTests-1778864652 None] Creating volume 2a96dd13-546f-4883-bad6-132ca07e4b74 {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 15:57:29 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-dea59bfa-57b1-4dd6-966c-d407d7b7bc07 tempest-AbsoluteLimitsTests-1778864652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:57:29 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-dea59bfa-57b1-4dd6-966c-d407d7b7bc07 tempest-AbsoluteLimitsTests-1778864652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:57:29 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-dea59bfa-57b1-4dd6-966c-d407d7b7bc07 tempest-AbsoluteLimitsTests-1778864652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:57:29 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-dea59bfa-57b1-4dd6-966c-d407d7b7bc07 tempest-AbsoluteLimitsTests-1778864652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:57:29 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-dea59bfa-57b1-4dd6-966c-d407d7b7bc07 tempest-AbsoluteLimitsTests-1778864652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:57:29 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-dea59bfa-57b1-4dd6-966c-d407d7b7bc07 tempest-AbsoluteLimitsTests-1778864652 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 15:57:29 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-dea59bfa-57b1-4dd6-966c-d407d7b7bc07 tempest-AbsoluteLimitsTests-1778864652 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 15:57:29 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-dea59bfa-57b1-4dd6-966c-d407d7b7bc07 tempest-AbsoluteLimitsTests-1778864652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-2a96dd13-546f-4883-bad6-132ca07e4b74 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:57:29 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6d1ce37c-0a44-4483-be66-a60e3d35545c tempest-VolumesGetTest-474292535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1aa83586-5ade-4e54-bd84-b24c64b399dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a29793d6-41bd-4fa1-86d4-09dcac617856', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:57:29 devstack sudo[97186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-2a96dd13-546f-4883-bad6-132ca07e4b74 1073741824 Jul 10 15:57:29 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6d1ce37c-0a44-4483-be66-a60e3d35545c tempest-VolumesGetTest-474292535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ee95a2c-468b-4bcc-8b85-2d017c923bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:57:29 devstack sudo[97186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:57:29 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-6d1ce37c-0a44-4483-be66-a60e3d35545c tempest-VolumesGetTest-474292535 None] Volume volume-a29793d6-41bd-4fa1-86d4-09dcac617856 (a29793d6-41bd-4fa1-86d4-09dcac617856): created successfully Jul 10 15:57:29 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6d1ce37c-0a44-4483-be66-a60e3d35545c tempest-VolumesGetTest-474292535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ee95a2c-468b-4bcc-8b85-2d017c923bb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:57:29 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6d1ce37c-0a44-4483-be66-a60e3d35545c tempest-VolumesGetTest-474292535 None] Flow 'volume_create_manager' (8cbcd9ee-f4d5-44ef-9bbc-d56075d508ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:57:29 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-6d1ce37c-0a44-4483-be66-a60e3d35545c tempest-VolumesGetTest-474292535 None] Created volume successfully. Jul 10 15:57:30 devstack sudo[97186]: pam_unix(sudo:session): session closed for user root Jul 10 15:57:30 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-dea59bfa-57b1-4dd6-966c-d407d7b7bc07 tempest-AbsoluteLimitsTests-1778864652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-2a96dd13-546f-4883-bad6-132ca07e4b74 1073741824" returned: 0 in 1.043s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:57:30 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-dea59bfa-57b1-4dd6-966c-d407d7b7bc07 tempest-AbsoluteLimitsTests-1778864652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-2a96dd13-546f-4883-bad6-132ca07e4b74 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:57:30 devstack sudo[97225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-2a96dd13-546f-4883-bad6-132ca07e4b74 Jul 10 15:57:30 devstack sudo[97225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:57:31 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2b2f1e0-67d1-4002-90a8-02a14a955f9a tempest-VolumesGetTest-474292535 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 15:57:31 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-a2b2f1e0-67d1-4002-90a8-02a14a955f9a tempest-VolumesGetTest-474292535 None] Flow 'volume_create_manager' (781ed8d4-7682-49c8-b587-5fb6c72bab51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:57:31 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-a2b2f1e0-67d1-4002-90a8-02a14a955f9a tempest-VolumesGetTest-474292535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f77020e9-16fa-499c-b485-981c43bd583b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:57:31 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-a2b2f1e0-67d1-4002-90a8-02a14a955f9a tempest-VolumesGetTest-474292535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f77020e9-16fa-499c-b485-981c43bd583b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:57:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-281886547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b22eb98f-531c-4737-bd33-8e6021a0345d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='7e1e4affd8f342e2a93b8606ed90299a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:57:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=a29793d6-41bd-4fa1-86d4-09dcac617856,status='creating',terminated_at=None,updated_at=2026-07-10T13:57:31Z,use_quota=True,user_id='fd5c633b5ab34f4fa42d3bf6bcfa01a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:57:31 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-a2b2f1e0-67d1-4002-90a8-02a14a955f9a tempest-VolumesGetTest-474292535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d752c4b-c629-4b51-ba90-53ca4de56b78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:57:31 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-a2b2f1e0-67d1-4002-90a8-02a14a955f9a tempest-VolumesGetTest-474292535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d752c4b-c629-4b51-ba90-53ca4de56b78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:57:31 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-a2b2f1e0-67d1-4002-90a8-02a14a955f9a tempest-VolumesGetTest-474292535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11a2d292-c34c-4233-987d-0f3c3ea60165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:57:31 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-a2b2f1e0-67d1-4002-90a8-02a14a955f9a tempest-VolumesGetTest-474292535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11a2d292-c34c-4233-987d-0f3c3ea60165) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'b22eb98f-531c-4737-bd33-8e6021a0345d', 'volume_name': 'volume-b22eb98f-531c-4737-bd33-8e6021a0345d', 'volume_size': 1, 'source_volid': 'a29793d6-41bd-4fa1-86d4-09dcac617856', 'source_volstatus': 'available'}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:57:31 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-a2b2f1e0-67d1-4002-90a8-02a14a955f9a tempest-VolumesGetTest-474292535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e95dcb3-27c6-4909-bbc1-84d9811534ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:57:31 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-a2b2f1e0-67d1-4002-90a8-02a14a955f9a tempest-VolumesGetTest-474292535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e95dcb3-27c6-4909-bbc1-84d9811534ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:57:31 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-a2b2f1e0-67d1-4002-90a8-02a14a955f9a tempest-VolumesGetTest-474292535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7849f31a-22bf-4f41-be20-7f1d838e1ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:57:31 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-a2b2f1e0-67d1-4002-90a8-02a14a955f9a tempest-VolumesGetTest-474292535 None] Volume b22eb98f-531c-4737-bd33-8e6021a0345d: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-b22eb98f-531c-4737-bd33-8e6021a0345d', 'volume_size': 1, 'source_volid': 'a29793d6-41bd-4fa1-86d4-09dcac617856', 'source_volstatus': 'available'} Jul 10 15:57:31 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-a2b2f1e0-67d1-4002-90a8-02a14a955f9a tempest-VolumesGetTest-474292535 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:57:31 devstack sudo[97225]: pam_unix(sudo:session): session closed for user root Jul 10 15:57:31 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-dea59bfa-57b1-4dd6-966c-d407d7b7bc07 tempest-AbsoluteLimitsTests-1778864652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-2a96dd13-546f-4883-bad6-132ca07e4b74" returned: 0 in 1.094s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:57:31 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-dea59bfa-57b1-4dd6-966c-d407d7b7bc07 tempest-AbsoluteLimitsTests-1778864652 None] <== create_volume: return (2196ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 15:57:31 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-dea59bfa-57b1-4dd6-966c-d407d7b7bc07 tempest-AbsoluteLimitsTests-1778864652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.199s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:57:31 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-a2b2f1e0-67d1-4002-90a8-02a14a955f9a tempest-VolumesGetTest-474292535 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.054s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:57:31 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-a2b2f1e0-67d1-4002-90a8-02a14a955f9a tempest-VolumesGetTest-474292535 None] Cloning volume a29793d6-41bd-4fa1-86d4-09dcac617856 to volume b22eb98f-531c-4737-bd33-8e6021a0345d Jul 10 15:57:31 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-dea59bfa-57b1-4dd6-966c-d407d7b7bc07 tempest-AbsoluteLimitsTests-1778864652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a19d097-be59-4203-a00a-33cbaf4f78cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a96dd13-546f-4883-bad6-132ca07e4b74', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:57:31 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-dea59bfa-57b1-4dd6-966c-d407d7b7bc07 tempest-AbsoluteLimitsTests-1778864652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8afa1ed-b4e8-4159-8026-b590603a4788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:57:31 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-dea59bfa-57b1-4dd6-966c-d407d7b7bc07 tempest-AbsoluteLimitsTests-1778864652 None] Volume volume-2a96dd13-546f-4883-bad6-132ca07e4b74 (2a96dd13-546f-4883-bad6-132ca07e4b74): created successfully Jul 10 15:57:31 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-dea59bfa-57b1-4dd6-966c-d407d7b7bc07 tempest-AbsoluteLimitsTests-1778864652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8afa1ed-b4e8-4159-8026-b590603a4788) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:57:31 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-dea59bfa-57b1-4dd6-966c-d407d7b7bc07 tempest-AbsoluteLimitsTests-1778864652 None] Flow 'volume_create_manager' (8a4a03a6-a1db-4070-a870-19d698a8b82f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:57:31 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-a2b2f1e0-67d1-4002-90a8-02a14a955f9a tempest-VolumesGetTest-474292535 None] Creating offline snapshot a096ef76-3f21-4007-b49c-cb7936cd0a1f of volume a29793d6-41bd-4fa1-86d4-09dcac617856 {{(pid=87420) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 15:57:31 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-dea59bfa-57b1-4dd6-966c-d407d7b7bc07 tempest-AbsoluteLimitsTests-1778864652 None] Created volume successfully. Jul 10 15:57:31 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[720590b2-d82a-4d14-a7ff-b47d31091fd0]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:57:31 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a2b2f1e0-67d1-4002-90a8-02a14a955f9a tempest-VolumesGetTest-474292535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a29793d6-41bd-4fa1-86d4-09dcac617856 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:57:31 devstack sudo[97230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a29793d6-41bd-4fa1-86d4-09dcac617856 Jul 10 15:57:31 devstack sudo[97230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:57:32 devstack sudo[97230]: pam_unix(sudo:session): session closed for user root Jul 10 15:57:32 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a2b2f1e0-67d1-4002-90a8-02a14a955f9a tempest-VolumesGetTest-474292535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a29793d6-41bd-4fa1-86d4-09dcac617856" returned: 0 in 0.842s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:57:32 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a2b2f1e0-67d1-4002-90a8-02a14a955f9a tempest-VolumesGetTest-474292535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a29793d6-41bd-4fa1-86d4-09dcac617856,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a29793d6-41bd-4fa1-86d4-09dcac617856.a096ef76-3f21-4007-b49c-cb7936cd0a1f 1G {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:57:32 devstack sudo[97235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a29793d6-41bd-4fa1-86d4-09dcac617856,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a29793d6-41bd-4fa1-86d4-09dcac617856.a096ef76-3f21-4007-b49c-cb7936cd0a1f 1G Jul 10 15:57:32 devstack sudo[97235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:57:32 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-39790c00-a7e0-4a2d-8953-997b0d3894db tempest-AbsoluteLimitsTests-1778864652 None] Acquiring lock "cinder-2a96dd13-546f-4883-bad6-132ca07e4b74-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:57:32 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-39790c00-a7e0-4a2d-8953-997b0d3894db tempest-AbsoluteLimitsTests-1778864652 None] Lock "cinder-2a96dd13-546f-4883-bad6-132ca07e4b74-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:57:32 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-39790c00-a7e0-4a2d-8953-997b0d3894db tempest-AbsoluteLimitsTests-1778864652 None] Acquiring lock "cinder-quobyte-2a96dd13-546f-4883-bad6-132ca07e4b74" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:57:32 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-39790c00-a7e0-4a2d-8953-997b0d3894db tempest-AbsoluteLimitsTests-1778864652 None] Lock "cinder-quobyte-2a96dd13-546f-4883-bad6-132ca07e4b74" acquired by "delete_volume" :: waited 0.020s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:57:32 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[63edf89a-53f0-4c37-98ac-fbd4e9fe4e33]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:57:32 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-39790c00-a7e0-4a2d-8953-997b0d3894db tempest-AbsoluteLimitsTests-1778864652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-2a96dd13-546f-4883-bad6-132ca07e4b74 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:57:32 devstack sudo[97237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-2a96dd13-546f-4883-bad6-132ca07e4b74 Jul 10 15:57:32 devstack sudo[97237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:57:33 devstack sudo[97235]: pam_unix(sudo:session): session closed for user root Jul 10 15:57:33 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a2b2f1e0-67d1-4002-90a8-02a14a955f9a tempest-VolumesGetTest-474292535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a29793d6-41bd-4fa1-86d4-09dcac617856,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a29793d6-41bd-4fa1-86d4-09dcac617856.a096ef76-3f21-4007-b49c-cb7936cd0a1f 1G" returned: 0 in 1.312s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:57:33 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a2b2f1e0-67d1-4002-90a8-02a14a955f9a tempest-VolumesGetTest-474292535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a29793d6-41bd-4fa1-86d4-09dcac617856 -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a29793d6-41bd-4fa1-86d4-09dcac617856.a096ef76-3f21-4007-b49c-cb7936cd0a1f {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:57:33 devstack sudo[97244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a29793d6-41bd-4fa1-86d4-09dcac617856 -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a29793d6-41bd-4fa1-86d4-09dcac617856.a096ef76-3f21-4007-b49c-cb7936cd0a1f Jul 10 15:57:33 devstack sudo[97244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:57:33 devstack sudo[97237]: pam_unix(sudo:session): session closed for user root Jul 10 15:57:33 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-39790c00-a7e0-4a2d-8953-997b0d3894db tempest-AbsoluteLimitsTests-1778864652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-2a96dd13-546f-4883-bad6-132ca07e4b74" returned: 0 in 1.140s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:57:33 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-39790c00-a7e0-4a2d-8953-997b0d3894db tempest-AbsoluteLimitsTests-1778864652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-2a96dd13-546f-4883-bad6-132ca07e4b74 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:57:34 devstack sudo[97249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-2a96dd13-546f-4883-bad6-132ca07e4b74 Jul 10 15:57:34 devstack sudo[97249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:57:34 devstack sudo[97244]: pam_unix(sudo:session): session closed for user root Jul 10 15:57:34 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a2b2f1e0-67d1-4002-90a8-02a14a955f9a tempest-VolumesGetTest-474292535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a29793d6-41bd-4fa1-86d4-09dcac617856 -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a29793d6-41bd-4fa1-86d4-09dcac617856.a096ef76-3f21-4007-b49c-cb7936cd0a1f" returned: 0 in 0.948s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:57:34 devstack cinder-volume[87420]: WARNING cinder.volume.drivers.remotefs [None req-a2b2f1e0-67d1-4002-90a8-02a14a955f9a tempest-VolumesGetTest-474292535 None] /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a29793d6-41bd-4fa1-86d4-09dcac617856.a096ef76-3f21-4007-b49c-cb7936cd0a1f is being set with open permissions: ugo+rw Jul 10 15:57:34 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a2b2f1e0-67d1-4002-90a8-02a14a955f9a tempest-VolumesGetTest-474292535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a29793d6-41bd-4fa1-86d4-09dcac617856.a096ef76-3f21-4007-b49c-cb7936cd0a1f {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:57:34 devstack sudo[97254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a29793d6-41bd-4fa1-86d4-09dcac617856.a096ef76-3f21-4007-b49c-cb7936cd0a1f Jul 10 15:57:34 devstack sudo[97254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:57:34 devstack sudo[97249]: pam_unix(sudo:session): session closed for user root Jul 10 15:57:34 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-39790c00-a7e0-4a2d-8953-997b0d3894db tempest-AbsoluteLimitsTests-1778864652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-2a96dd13-546f-4883-bad6-132ca07e4b74" returned: 0 in 1.020s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:57:35 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-39790c00-a7e0-4a2d-8953-997b0d3894db tempest-AbsoluteLimitsTests-1778864652 None] Lock "cinder-quobyte-2a96dd13-546f-4883-bad6-132ca07e4b74" released by "delete_volume" :: held 2.236s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:57:35 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-39790c00-a7e0-4a2d-8953-997b0d3894db tempest-AbsoluteLimitsTests-1778864652 None] Created reservations ['832d1bbd-9835-4f93-945f-0de68f361670', 'ee704c39-9dac-4772-ad05-1ef5a0aeb173', '58db0312-cc4e-4ae2-9aa7-84f03f7058dd', '04a9be2b-e77a-4ab5-ab91-152406beea2d'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 15:57:35 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-39790c00-a7e0-4a2d-8953-997b0d3894db tempest-AbsoluteLimitsTests-1778864652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:57:35 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-39790c00-a7e0-4a2d-8953-997b0d3894db tempest-AbsoluteLimitsTests-1778864652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:57:35 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-39790c00-a7e0-4a2d-8953-997b0d3894db tempest-AbsoluteLimitsTests-1778864652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:57:35 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-39790c00-a7e0-4a2d-8953-997b0d3894db tempest-AbsoluteLimitsTests-1778864652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:57:35 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-39790c00-a7e0-4a2d-8953-997b0d3894db tempest-AbsoluteLimitsTests-1778864652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:57:35 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-39790c00-a7e0-4a2d-8953-997b0d3894db tempest-AbsoluteLimitsTests-1778864652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:57:35 devstack sudo[97258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 15:57:35 devstack sudo[97258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:57:35 devstack sudo[97254]: pam_unix(sudo:session): session closed for user root Jul 10 15:57:35 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a2b2f1e0-67d1-4002-90a8-02a14a955f9a tempest-VolumesGetTest-474292535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a29793d6-41bd-4fa1-86d4-09dcac617856.a096ef76-3f21-4007-b49c-cb7936cd0a1f" returned: 0 in 0.894s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:57:35 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a2b2f1e0-67d1-4002-90a8-02a14a955f9a tempest-VolumesGetTest-474292535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a29793d6-41bd-4fa1-86d4-09dcac617856.info {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:57:35 devstack sudo[97260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a29793d6-41bd-4fa1-86d4-09dcac617856.info Jul 10 15:57:35 devstack sudo[97260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:57:36 devstack sudo[97258]: pam_unix(sudo:session): session closed for user root Jul 10 15:57:36 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-39790c00-a7e0-4a2d-8953-997b0d3894db tempest-AbsoluteLimitsTests-1778864652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 1.118s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:57:36 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-39790c00-a7e0-4a2d-8953-997b0d3894db tempest-AbsoluteLimitsTests-1778864652 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 15:57:36 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-39790c00-a7e0-4a2d-8953-997b0d3894db tempest-AbsoluteLimitsTests-1778864652 None] Deleted volume successfully. Jul 10 15:57:36 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-39790c00-a7e0-4a2d-8953-997b0d3894db tempest-AbsoluteLimitsTests-1778864652 None] Lock "cinder-2a96dd13-546f-4883-bad6-132ca07e4b74-delete_volume" released by "delete_volume" :: held 3.729s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:57:36 devstack sudo[97260]: pam_unix(sudo:session): session closed for user root Jul 10 15:57:36 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a2b2f1e0-67d1-4002-90a8-02a14a955f9a tempest-VolumesGetTest-474292535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a29793d6-41bd-4fa1-86d4-09dcac617856.info" returned: 0 in 1.082s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:57:36 devstack cinder-volume[87420]: WARNING cinder.volume.drivers.remotefs [None req-a2b2f1e0-67d1-4002-90a8-02a14a955f9a tempest-VolumesGetTest-474292535 None] /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a29793d6-41bd-4fa1-86d4-09dcac617856.info is being set with open permissions: ugo+rw Jul 10 15:57:36 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a2b2f1e0-67d1-4002-90a8-02a14a955f9a tempest-VolumesGetTest-474292535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a29793d6-41bd-4fa1-86d4-09dcac617856.info {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:57:36 devstack sudo[97265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a29793d6-41bd-4fa1-86d4-09dcac617856.info Jul 10 15:57:36 devstack sudo[97265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:57:37 devstack sudo[97265]: pam_unix(sudo:session): session closed for user root Jul 10 15:57:37 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a2b2f1e0-67d1-4002-90a8-02a14a955f9a tempest-VolumesGetTest-474292535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a29793d6-41bd-4fa1-86d4-09dcac617856.info" returned: 0 in 0.733s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:57:37 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-a2b2f1e0-67d1-4002-90a8-02a14a955f9a tempest-VolumesGetTest-474292535 None] Acquiring lock "cinder-quobyte-b22eb98f-531c-4737-bd33-8e6021a0345d" by "_copy_volume_from_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:57:37 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-a2b2f1e0-67d1-4002-90a8-02a14a955f9a tempest-VolumesGetTest-474292535 None] Lock "cinder-quobyte-b22eb98f-531c-4737-bd33-8e6021a0345d" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:57:37 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-a2b2f1e0-67d1-4002-90a8-02a14a955f9a tempest-VolumesGetTest-474292535 None] snapshot: a096ef76-3f21-4007-b49c-cb7936cd0a1f, volume: b22eb98f-531c-4737-bd33-8e6021a0345d, {{(pid=87420) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 15:57:37 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-a2b2f1e0-67d1-4002-90a8-02a14a955f9a tempest-VolumesGetTest-474292535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:57:37 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-a2b2f1e0-67d1-4002-90a8-02a14a955f9a tempest-VolumesGetTest-474292535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:57:37 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-a2b2f1e0-67d1-4002-90a8-02a14a955f9a tempest-VolumesGetTest-474292535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:57:37 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-a2b2f1e0-67d1-4002-90a8-02a14a955f9a tempest-VolumesGetTest-474292535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:57:37 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-a2b2f1e0-67d1-4002-90a8-02a14a955f9a tempest-VolumesGetTest-474292535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:57:37 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[a127d6a5-eb83-44ac-a10b-53f1a25650af]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:57:37 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a2b2f1e0-67d1-4002-90a8-02a14a955f9a tempest-VolumesGetTest-474292535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a29793d6-41bd-4fa1-86d4-09dcac617856.a096ef76-3f21-4007-b49c-cb7936cd0a1f {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:57:37 devstack sudo[97268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a29793d6-41bd-4fa1-86d4-09dcac617856.a096ef76-3f21-4007-b49c-cb7936cd0a1f Jul 10 15:57:37 devstack sudo[97268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:57:38 devstack sudo[97268]: pam_unix(sudo:session): session closed for user root Jul 10 15:57:38 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a2b2f1e0-67d1-4002-90a8-02a14a955f9a tempest-VolumesGetTest-474292535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a29793d6-41bd-4fa1-86d4-09dcac617856.a096ef76-3f21-4007-b49c-cb7936cd0a1f" returned: 0 in 1.031s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:57:38 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-a2b2f1e0-67d1-4002-90a8-02a14a955f9a tempest-VolumesGetTest-474292535 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a29793d6-41bd-4fa1-86d4-09dcac617856(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87420) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 15:57:38 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-a2b2f1e0-67d1-4002-90a8-02a14a955f9a tempest-VolumesGetTest-474292535 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a29793d6-41bd-4fa1-86d4-09dcac617856 {{(pid=87420) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 15:57:38 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-a2b2f1e0-67d1-4002-90a8-02a14a955f9a tempest-VolumesGetTest-474292535 None] Creating direct copy from snapshot {{(pid=87420) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 15:57:38 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed96bfd4-a76f-4055-82be-8f7f0c9df577]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:57:38 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a2b2f1e0-67d1-4002-90a8-02a14a955f9a tempest-VolumesGetTest-474292535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a29793d6-41bd-4fa1-86d4-09dcac617856 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:57:38 devstack sudo[97273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a29793d6-41bd-4fa1-86d4-09dcac617856 Jul 10 15:57:38 devstack sudo[97273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:57:39 devstack sudo[97273]: pam_unix(sudo:session): session closed for user root Jul 10 15:57:39 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a2b2f1e0-67d1-4002-90a8-02a14a955f9a tempest-VolumesGetTest-474292535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a29793d6-41bd-4fa1-86d4-09dcac617856" returned: 0 in 1.022s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:57:39 devstack cinder-volume[87420]: DEBUG cinder.utils [None req-a2b2f1e0-67d1-4002-90a8-02a14a955f9a tempest-VolumesGetTest-474292535 None] Path /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b22eb98f-531c-4737-bd33-8e6021a0345d not found in is_blk_device check {{(pid=87420) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 15:57:39 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a2b2f1e0-67d1-4002-90a8-02a14a955f9a tempest-VolumesGetTest-474292535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a29793d6-41bd-4fa1-86d4-09dcac617856 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b22eb98f-531c-4737-bd33-8e6021a0345d {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:57:39 devstack sudo[97279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a29793d6-41bd-4fa1-86d4-09dcac617856 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b22eb98f-531c-4737-bd33-8e6021a0345d Jul 10 15:57:39 devstack sudo[97279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:57:40 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a90d550-c2d7-4c0a-9f88-5ad5a9d4e40d tempest-TestStampPattern-1127543775 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 15:57:40 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-3a90d550-c2d7-4c0a-9f88-5ad5a9d4e40d tempest-TestStampPattern-1127543775 None] Flow 'volume_create_manager' (7e7afb79-49c9-445d-83de-bbc2a3970546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:57:40 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-3a90d550-c2d7-4c0a-9f88-5ad5a9d4e40d tempest-TestStampPattern-1127543775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (903f071c-ea39-48c3-a089-be2811bec514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:57:40 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-3a90d550-c2d7-4c0a-9f88-5ad5a9d4e40d tempest-TestStampPattern-1127543775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (903f071c-ea39-48c3-a089-be2811bec514) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:57:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-2035377310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ff68687-c9f5-4d47-a2bb-8312436fc4b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79fd7a10e9f64c09b86479308e5b43db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:57:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:57:40Z,use_quota=True,user_id='6776f875785d4191bc9300d8de644c9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:57:40 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-3a90d550-c2d7-4c0a-9f88-5ad5a9d4e40d tempest-TestStampPattern-1127543775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03102d05-a933-4308-b3ec-ac861b4c0207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:57:40 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-3a90d550-c2d7-4c0a-9f88-5ad5a9d4e40d tempest-TestStampPattern-1127543775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03102d05-a933-4308-b3ec-ac861b4c0207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:57:40 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-3a90d550-c2d7-4c0a-9f88-5ad5a9d4e40d tempest-TestStampPattern-1127543775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27d0a137-f5c9-4493-b2ed-a772be067a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:57:40 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-3a90d550-c2d7-4c0a-9f88-5ad5a9d4e40d tempest-TestStampPattern-1127543775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27d0a137-f5c9-4493-b2ed-a772be067a17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ff68687-c9f5-4d47-a2bb-8312436fc4b7', 'volume_name': 'volume-4ff68687-c9f5-4d47-a2bb-8312436fc4b7', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:57:40 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-3a90d550-c2d7-4c0a-9f88-5ad5a9d4e40d tempest-TestStampPattern-1127543775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b65d35e-b995-40ef-b004-7d2eb496f4e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:57:40 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-3a90d550-c2d7-4c0a-9f88-5ad5a9d4e40d tempest-TestStampPattern-1127543775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b65d35e-b995-40ef-b004-7d2eb496f4e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:57:40 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-3a90d550-c2d7-4c0a-9f88-5ad5a9d4e40d tempest-TestStampPattern-1127543775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2be3d1c8-f507-479a-afc8-ab2d3ac1f2fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:57:40 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-3a90d550-c2d7-4c0a-9f88-5ad5a9d4e40d tempest-TestStampPattern-1127543775 None] Volume 4ff68687-c9f5-4d47-a2bb-8312436fc4b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ff68687-c9f5-4d47-a2bb-8312436fc4b7', 'volume_size': 1} Jul 10 15:57:40 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-3a90d550-c2d7-4c0a-9f88-5ad5a9d4e40d tempest-TestStampPattern-1127543775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:57:44 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-c13865f3-b315-4750-84a1-ae288468bb94 tempest-VolumesDeleteCascade-134824525 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 15:57:44 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c13865f3-b315-4750-84a1-ae288468bb94 tempest-VolumesDeleteCascade-134824525 None] Flow 'volume_create_manager' (4c8986e5-057b-41f5-9d64-a608596dba1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:57:44 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c13865f3-b315-4750-84a1-ae288468bb94 tempest-VolumesDeleteCascade-134824525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (485aa1b4-5b16-4a7a-9a27-b5b0f614a391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:57:44 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c13865f3-b315-4750-84a1-ae288468bb94 tempest-VolumesDeleteCascade-134824525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (485aa1b4-5b16-4a7a-9a27-b5b0f614a391) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:57:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1816867388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efd54d1e-4fce-4679-ae10-7b11ef7c0073,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29986c0842554f22bdd95ba498ecf9ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:57:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:57:45Z,use_quota=True,user_id='df41e4e5b745419bad59c111b6510027',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:57:45 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c13865f3-b315-4750-84a1-ae288468bb94 tempest-VolumesDeleteCascade-134824525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dce23eb-940f-4a53-930e-768f41bf2b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:57:45 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c13865f3-b315-4750-84a1-ae288468bb94 tempest-VolumesDeleteCascade-134824525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dce23eb-940f-4a53-930e-768f41bf2b3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:57:45 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c13865f3-b315-4750-84a1-ae288468bb94 tempest-VolumesDeleteCascade-134824525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b13670e3-7c72-4b07-ac15-33f9c14fcc4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:57:45 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c13865f3-b315-4750-84a1-ae288468bb94 tempest-VolumesDeleteCascade-134824525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b13670e3-7c72-4b07-ac15-33f9c14fcc4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efd54d1e-4fce-4679-ae10-7b11ef7c0073', 'volume_name': 'volume-efd54d1e-4fce-4679-ae10-7b11ef7c0073', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:57:45 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c13865f3-b315-4750-84a1-ae288468bb94 tempest-VolumesDeleteCascade-134824525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71167df3-f0f0-4792-a8ab-bb1ac8a6ca70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:57:45 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c13865f3-b315-4750-84a1-ae288468bb94 tempest-VolumesDeleteCascade-134824525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71167df3-f0f0-4792-a8ab-bb1ac8a6ca70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:57:45 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c13865f3-b315-4750-84a1-ae288468bb94 tempest-VolumesDeleteCascade-134824525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34cae410-1d5e-4315-9ee0-0e424cb22f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:57:45 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-c13865f3-b315-4750-84a1-ae288468bb94 tempest-VolumesDeleteCascade-134824525 None] Volume efd54d1e-4fce-4679-ae10-7b11ef7c0073: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efd54d1e-4fce-4679-ae10-7b11ef7c0073', 'volume_size': 1} Jul 10 15:57:45 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-c13865f3-b315-4750-84a1-ae288468bb94 tempest-VolumesDeleteCascade-134824525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:57:45 devstack sudo[97279]: pam_unix(sudo:session): session closed for user root Jul 10 15:57:45 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a2b2f1e0-67d1-4002-90a8-02a14a955f9a tempest-VolumesGetTest-474292535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a29793d6-41bd-4fa1-86d4-09dcac617856 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b22eb98f-531c-4737-bd33-8e6021a0345d" returned: 0 in 6.439s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:57:45 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[6082dc3f-f040-4782-bb36-4a06e855f87a]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:57:45 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a2b2f1e0-67d1-4002-90a8-02a14a955f9a tempest-VolumesGetTest-474292535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a29793d6-41bd-4fa1-86d4-09dcac617856 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:57:46 devstack sudo[97302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a29793d6-41bd-4fa1-86d4-09dcac617856 Jul 10 15:57:46 devstack sudo[97302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:57:46 devstack sudo[97302]: pam_unix(sudo:session): session closed for user root Jul 10 15:57:46 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a2b2f1e0-67d1-4002-90a8-02a14a955f9a tempest-VolumesGetTest-474292535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a29793d6-41bd-4fa1-86d4-09dcac617856" returned: 0 in 0.988s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:57:46 devstack cinder-volume[87420]: DEBUG cinder.image.image_utils [None req-a2b2f1e0-67d1-4002-90a8-02a14a955f9a tempest-VolumesGetTest-474292535 None] Image conversion details: src /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a29793d6-41bd-4fa1-86d4-09dcac617856, size 1024.00 MB, duration 6.44 sec, destination /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b22eb98f-531c-4737-bd33-8e6021a0345d {{(pid=87420) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 15:57:46 devstack cinder-volume[87420]: INFO cinder.image.image_utils [None req-a2b2f1e0-67d1-4002-90a8-02a14a955f9a tempest-VolumesGetTest-474292535 None] Converted 1024.00 MB image at 158.96 MB/s Jul 10 15:57:46 devstack cinder-volume[87420]: WARNING cinder.volume.drivers.remotefs [None req-a2b2f1e0-67d1-4002-90a8-02a14a955f9a tempest-VolumesGetTest-474292535 None] /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b22eb98f-531c-4737-bd33-8e6021a0345d is being set with open permissions: ugo+rw Jul 10 15:57:46 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a2b2f1e0-67d1-4002-90a8-02a14a955f9a tempest-VolumesGetTest-474292535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b22eb98f-531c-4737-bd33-8e6021a0345d {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:57:46 devstack sudo[97307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b22eb98f-531c-4737-bd33-8e6021a0345d Jul 10 15:57:46 devstack sudo[97307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:57:47 devstack sudo[97307]: pam_unix(sudo:session): session closed for user root Jul 10 15:57:47 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a2b2f1e0-67d1-4002-90a8-02a14a955f9a tempest-VolumesGetTest-474292535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b22eb98f-531c-4737-bd33-8e6021a0345d" returned: 0 in 0.670s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:57:47 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-a2b2f1e0-67d1-4002-90a8-02a14a955f9a tempest-VolumesGetTest-474292535 None] Lock "cinder-quobyte-b22eb98f-531c-4737-bd33-8e6021a0345d" released by "_copy_volume_from_snapshot" :: held 10.288s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:57:47 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-a2b2f1e0-67d1-4002-90a8-02a14a955f9a tempest-VolumesGetTest-474292535 None] Acquiring lock "cinder-quobyte-a096ef76-3f21-4007-b49c-cb7936cd0a1f" by "_delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:57:47 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-a2b2f1e0-67d1-4002-90a8-02a14a955f9a tempest-VolumesGetTest-474292535 None] Lock "cinder-quobyte-a096ef76-3f21-4007-b49c-cb7936cd0a1f" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:57:47 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-a2b2f1e0-67d1-4002-90a8-02a14a955f9a tempest-VolumesGetTest-474292535 None] Deleting offline snapshot a096ef76-3f21-4007-b49c-cb7936cd0a1f of volume a29793d6-41bd-4fa1-86d4-09dcac617856 {{(pid=87420) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 15:57:47 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-a2b2f1e0-67d1-4002-90a8-02a14a955f9a tempest-VolumesGetTest-474292535 None] snapshot_file for this snap is: volume-a29793d6-41bd-4fa1-86d4-09dcac617856.a096ef76-3f21-4007-b49c-cb7936cd0a1f {{(pid=87420) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 15:57:47 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[be4e1457-e090-4424-820e-9958e49e57b4]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:57:47 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a2b2f1e0-67d1-4002-90a8-02a14a955f9a tempest-VolumesGetTest-474292535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a29793d6-41bd-4fa1-86d4-09dcac617856.a096ef76-3f21-4007-b49c-cb7936cd0a1f {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:57:47 devstack sudo[97310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a29793d6-41bd-4fa1-86d4-09dcac617856.a096ef76-3f21-4007-b49c-cb7936cd0a1f Jul 10 15:57:47 devstack sudo[97310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:57:48 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-36d167e0-f61b-4ea5-913b-130ff03a795e tempest-VolumeSnapshotQuotasNegativeTestJSON-2106898324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 15:57:48 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-36d167e0-f61b-4ea5-913b-130ff03a795e tempest-VolumeSnapshotQuotasNegativeTestJSON-2106898324 None] Flow 'volume_create_manager' (e1453419-9904-438a-84f0-59b17390971a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:57:48 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-36d167e0-f61b-4ea5-913b-130ff03a795e tempest-VolumeSnapshotQuotasNegativeTestJSON-2106898324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d49d3695-44cd-4735-b29f-6d690bce239e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:57:48 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-36d167e0-f61b-4ea5-913b-130ff03a795e tempest-VolumeSnapshotQuotasNegativeTestJSON-2106898324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d49d3695-44cd-4735-b29f-6d690bce239e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:57:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1104441373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64b61d22-7d1e-40b7-b500-7f1b26741d5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04fd5f770d6544ccb781c3540e6a717d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:57:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:57:48Z,use_quota=True,user_id='648fdbe52fca42c6a98fac87aa80f47a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:57:48 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-36d167e0-f61b-4ea5-913b-130ff03a795e tempest-VolumeSnapshotQuotasNegativeTestJSON-2106898324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d26a77e6-8c75-4fde-ad93-7e1cd765f9f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:57:48 devstack sudo[97310]: pam_unix(sudo:session): session closed for user root Jul 10 15:57:48 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-36d167e0-f61b-4ea5-913b-130ff03a795e tempest-VolumeSnapshotQuotasNegativeTestJSON-2106898324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d26a77e6-8c75-4fde-ad93-7e1cd765f9f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:57:48 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-36d167e0-f61b-4ea5-913b-130ff03a795e tempest-VolumeSnapshotQuotasNegativeTestJSON-2106898324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d82e938a-83f1-4c66-b5a8-9b015d15b2be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:57:48 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-36d167e0-f61b-4ea5-913b-130ff03a795e tempest-VolumeSnapshotQuotasNegativeTestJSON-2106898324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d82e938a-83f1-4c66-b5a8-9b015d15b2be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64b61d22-7d1e-40b7-b500-7f1b26741d5b', 'volume_name': 'volume-64b61d22-7d1e-40b7-b500-7f1b26741d5b', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:57:48 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-36d167e0-f61b-4ea5-913b-130ff03a795e tempest-VolumeSnapshotQuotasNegativeTestJSON-2106898324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (988e3789-9d1d-464c-9c12-71c00409cef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:57:48 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-36d167e0-f61b-4ea5-913b-130ff03a795e tempest-VolumeSnapshotQuotasNegativeTestJSON-2106898324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (988e3789-9d1d-464c-9c12-71c00409cef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:57:48 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-36d167e0-f61b-4ea5-913b-130ff03a795e tempest-VolumeSnapshotQuotasNegativeTestJSON-2106898324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abca6b63-01ff-4c8f-95f4-5bdbe5c017b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:57:48 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-36d167e0-f61b-4ea5-913b-130ff03a795e tempest-VolumeSnapshotQuotasNegativeTestJSON-2106898324 None] Volume 64b61d22-7d1e-40b7-b500-7f1b26741d5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64b61d22-7d1e-40b7-b500-7f1b26741d5b', 'volume_size': 1} Jul 10 15:57:48 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-36d167e0-f61b-4ea5-913b-130ff03a795e tempest-VolumeSnapshotQuotasNegativeTestJSON-2106898324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:57:48 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a2b2f1e0-67d1-4002-90a8-02a14a955f9a tempest-VolumesGetTest-474292535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a29793d6-41bd-4fa1-86d4-09dcac617856.a096ef76-3f21-4007-b49c-cb7936cd0a1f" returned: 0 in 0.827s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:57:48 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-a2b2f1e0-67d1-4002-90a8-02a14a955f9a tempest-VolumesGetTest-474292535 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a29793d6-41bd-4fa1-86d4-09dcac617856(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87420) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 15:57:48 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[6784e549-2048-4911-9f95-46ec80038e5d]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:57:48 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a2b2f1e0-67d1-4002-90a8-02a14a955f9a tempest-VolumesGetTest-474292535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a29793d6-41bd-4fa1-86d4-09dcac617856 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:57:48 devstack sudo[97315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a29793d6-41bd-4fa1-86d4-09dcac617856 Jul 10 15:57:48 devstack sudo[97315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:57:49 devstack sudo[97315]: pam_unix(sudo:session): session closed for user root Jul 10 15:57:49 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a2b2f1e0-67d1-4002-90a8-02a14a955f9a tempest-VolumesGetTest-474292535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a29793d6-41bd-4fa1-86d4-09dcac617856" returned: 0 in 0.781s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:57:49 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a2b2f1e0-67d1-4002-90a8-02a14a955f9a tempest-VolumesGetTest-474292535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a29793d6-41bd-4fa1-86d4-09dcac617856.a096ef76-3f21-4007-b49c-cb7936cd0a1f {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:57:49 devstack sudo[97321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a29793d6-41bd-4fa1-86d4-09dcac617856.a096ef76-3f21-4007-b49c-cb7936cd0a1f Jul 10 15:57:49 devstack sudo[97321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:57:50 devstack sudo[97321]: pam_unix(sudo:session): session closed for user root Jul 10 15:57:50 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a2b2f1e0-67d1-4002-90a8-02a14a955f9a tempest-VolumesGetTest-474292535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a29793d6-41bd-4fa1-86d4-09dcac617856.a096ef76-3f21-4007-b49c-cb7936cd0a1f" returned: 0 in 0.749s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:57:50 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a2b2f1e0-67d1-4002-90a8-02a14a955f9a tempest-VolumesGetTest-474292535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a29793d6-41bd-4fa1-86d4-09dcac617856.a096ef76-3f21-4007-b49c-cb7936cd0a1f {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:57:50 devstack sudo[97326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a29793d6-41bd-4fa1-86d4-09dcac617856.a096ef76-3f21-4007-b49c-cb7936cd0a1f Jul 10 15:57:50 devstack sudo[97326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:57:50 devstack sudo[97326]: pam_unix(sudo:session): session closed for user root Jul 10 15:57:50 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a2b2f1e0-67d1-4002-90a8-02a14a955f9a tempest-VolumesGetTest-474292535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a29793d6-41bd-4fa1-86d4-09dcac617856.a096ef76-3f21-4007-b49c-cb7936cd0a1f" returned: 0 in 0.666s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:57:50 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-a2b2f1e0-67d1-4002-90a8-02a14a955f9a tempest-VolumesGetTest-474292535 None] Lock "cinder-quobyte-a096ef76-3f21-4007-b49c-cb7936cd0a1f" released by "_delete_snapshot" :: held 3.119s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:57:50 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-a2b2f1e0-67d1-4002-90a8-02a14a955f9a tempest-VolumesGetTest-474292535 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 19.571s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:57:50 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-3a90d550-c2d7-4c0a-9f88-5ad5a9d4e40d tempest-TestStampPattern-1127543775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.375s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:57:50 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-3a90d550-c2d7-4c0a-9f88-5ad5a9d4e40d tempest-TestStampPattern-1127543775 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:57:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-2035377310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ff68687-c9f5-4d47-a2bb-8312436fc4b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79fd7a10e9f64c09b86479308e5b43db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:57:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:57:40Z,use_quota=True,user_id='6776f875785d4191bc9300d8de644c9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 15:57:50 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-3a90d550-c2d7-4c0a-9f88-5ad5a9d4e40d tempest-TestStampPattern-1127543775 None] Creating volume 4ff68687-c9f5-4d47-a2bb-8312436fc4b7 {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 15:57:50 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-3a90d550-c2d7-4c0a-9f88-5ad5a9d4e40d tempest-TestStampPattern-1127543775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:57:50 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-3a90d550-c2d7-4c0a-9f88-5ad5a9d4e40d tempest-TestStampPattern-1127543775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:57:50 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-3a90d550-c2d7-4c0a-9f88-5ad5a9d4e40d tempest-TestStampPattern-1127543775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:57:50 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-3a90d550-c2d7-4c0a-9f88-5ad5a9d4e40d tempest-TestStampPattern-1127543775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:57:50 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-3a90d550-c2d7-4c0a-9f88-5ad5a9d4e40d tempest-TestStampPattern-1127543775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:57:50 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-3a90d550-c2d7-4c0a-9f88-5ad5a9d4e40d tempest-TestStampPattern-1127543775 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 15:57:50 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-3a90d550-c2d7-4c0a-9f88-5ad5a9d4e40d tempest-TestStampPattern-1127543775 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 15:57:50 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-3a90d550-c2d7-4c0a-9f88-5ad5a9d4e40d tempest-TestStampPattern-1127543775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4ff68687-c9f5-4d47-a2bb-8312436fc4b7 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:57:50 devstack sudo[97329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4ff68687-c9f5-4d47-a2bb-8312436fc4b7 1073741824 Jul 10 15:57:50 devstack sudo[97329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:57:50 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-a2b2f1e0-67d1-4002-90a8-02a14a955f9a tempest-VolumesGetTest-474292535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7849f31a-22bf-4f41-be20-7f1d838e1ef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b22eb98f-531c-4737-bd33-8e6021a0345d', 'volume_size': 1, 'source_volid': 'a29793d6-41bd-4fa1-86d4-09dcac617856', 'source_volstatus': 'available'}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:57:50 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-a2b2f1e0-67d1-4002-90a8-02a14a955f9a tempest-VolumesGetTest-474292535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa810433-729a-4af0-ac77-bcc34d972a49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:57:50 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-a2b2f1e0-67d1-4002-90a8-02a14a955f9a tempest-VolumesGetTest-474292535 None] Volume volume-b22eb98f-531c-4737-bd33-8e6021a0345d (b22eb98f-531c-4737-bd33-8e6021a0345d): created successfully Jul 10 15:57:50 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-a2b2f1e0-67d1-4002-90a8-02a14a955f9a tempest-VolumesGetTest-474292535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa810433-729a-4af0-ac77-bcc34d972a49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:57:50 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-a2b2f1e0-67d1-4002-90a8-02a14a955f9a tempest-VolumesGetTest-474292535 None] Flow 'volume_create_manager' (781ed8d4-7682-49c8-b587-5fb6c72bab51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:57:50 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-a2b2f1e0-67d1-4002-90a8-02a14a955f9a tempest-VolumesGetTest-474292535 None] Created volume successfully. Jul 10 15:57:52 devstack sudo[97329]: pam_unix(sudo:session): session closed for user root Jul 10 15:57:52 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-3a90d550-c2d7-4c0a-9f88-5ad5a9d4e40d tempest-TestStampPattern-1127543775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4ff68687-c9f5-4d47-a2bb-8312436fc4b7 1073741824" returned: 0 in 1.196s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:57:52 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-3a90d550-c2d7-4c0a-9f88-5ad5a9d4e40d tempest-TestStampPattern-1127543775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4ff68687-c9f5-4d47-a2bb-8312436fc4b7 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:57:52 devstack sudo[97335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4ff68687-c9f5-4d47-a2bb-8312436fc4b7 Jul 10 15:57:52 devstack sudo[97335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:57:52 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-9606d5e1-1a20-4a20-871d-662f7e6ae4a2 tempest-VolumesGetTest-474292535 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 15:57:52 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-9606d5e1-1a20-4a20-871d-662f7e6ae4a2 tempest-VolumesGetTest-474292535 None] Flow 'volume_create_manager' (613ad912-7764-4329-bda0-6d6aac4d1504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:57:52 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-9606d5e1-1a20-4a20-871d-662f7e6ae4a2 tempest-VolumesGetTest-474292535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab31c364-85e9-4130-b870-db70484bc897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:57:52 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-9606d5e1-1a20-4a20-871d-662f7e6ae4a2 tempest-VolumesGetTest-474292535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab31c364-85e9-4130-b870-db70484bc897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:57:52Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1833901063',display_name='tempest-VolumesGetTest-Volume-1918819072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0dd37892-3709-4abd-81e8-dc99921f4af3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e1e4affd8f342e2a93b8606ed90299a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:57:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:57:52Z,use_quota=True,user_id='fd5c633b5ab34f4fa42d3bf6bcfa01a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:57:52 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-9606d5e1-1a20-4a20-871d-662f7e6ae4a2 tempest-VolumesGetTest-474292535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32a431ac-9966-42bb-8db7-c76b11add7c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:57:52 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-9606d5e1-1a20-4a20-871d-662f7e6ae4a2 tempest-VolumesGetTest-474292535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32a431ac-9966-42bb-8db7-c76b11add7c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:57:52 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-9606d5e1-1a20-4a20-871d-662f7e6ae4a2 tempest-VolumesGetTest-474292535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82ddb7bd-d40a-4004-8885-f91ed9993738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:57:52 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-9606d5e1-1a20-4a20-871d-662f7e6ae4a2 tempest-VolumesGetTest-474292535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82ddb7bd-d40a-4004-8885-f91ed9993738) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0dd37892-3709-4abd-81e8-dc99921f4af3', 'volume_name': 'volume-0dd37892-3709-4abd-81e8-dc99921f4af3', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:57:52 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-9606d5e1-1a20-4a20-871d-662f7e6ae4a2 tempest-VolumesGetTest-474292535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d9cadb5-acf4-45e3-89da-06fcb419c866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:57:52 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-9606d5e1-1a20-4a20-871d-662f7e6ae4a2 tempest-VolumesGetTest-474292535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d9cadb5-acf4-45e3-89da-06fcb419c866) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:57:52 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-9606d5e1-1a20-4a20-871d-662f7e6ae4a2 tempest-VolumesGetTest-474292535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8304e0e2-3b78-41ee-9b48-52fc5035404e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:57:52 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-9606d5e1-1a20-4a20-871d-662f7e6ae4a2 tempest-VolumesGetTest-474292535 None] Volume 0dd37892-3709-4abd-81e8-dc99921f4af3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0dd37892-3709-4abd-81e8-dc99921f4af3', 'volume_size': 1} Jul 10 15:57:52 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-9606d5e1-1a20-4a20-871d-662f7e6ae4a2 tempest-VolumesGetTest-474292535 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:57:52 devstack sudo[97335]: pam_unix(sudo:session): session closed for user root Jul 10 15:57:52 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-3a90d550-c2d7-4c0a-9f88-5ad5a9d4e40d tempest-TestStampPattern-1127543775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4ff68687-c9f5-4d47-a2bb-8312436fc4b7" returned: 0 in 0.703s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:57:52 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-3a90d550-c2d7-4c0a-9f88-5ad5a9d4e40d tempest-TestStampPattern-1127543775 None] <== create_volume: return (1949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 15:57:52 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-3a90d550-c2d7-4c0a-9f88-5ad5a9d4e40d tempest-TestStampPattern-1127543775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.953s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:57:52 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-c13865f3-b315-4750-84a1-ae288468bb94 tempest-VolumesDeleteCascade-134824525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.673s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:57:52 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-c13865f3-b315-4750-84a1-ae288468bb94 tempest-VolumesDeleteCascade-134824525 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:57:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1816867388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efd54d1e-4fce-4679-ae10-7b11ef7c0073,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29986c0842554f22bdd95ba498ecf9ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:57:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:57:45Z,use_quota=True,user_id='df41e4e5b745419bad59c111b6510027',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 15:57:52 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-c13865f3-b315-4750-84a1-ae288468bb94 tempest-VolumesDeleteCascade-134824525 None] Creating volume efd54d1e-4fce-4679-ae10-7b11ef7c0073 {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 15:57:52 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-c13865f3-b315-4750-84a1-ae288468bb94 tempest-VolumesDeleteCascade-134824525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:57:52 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-c13865f3-b315-4750-84a1-ae288468bb94 tempest-VolumesDeleteCascade-134824525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:57:52 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-c13865f3-b315-4750-84a1-ae288468bb94 tempest-VolumesDeleteCascade-134824525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:57:52 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-c13865f3-b315-4750-84a1-ae288468bb94 tempest-VolumesDeleteCascade-134824525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:57:52 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-c13865f3-b315-4750-84a1-ae288468bb94 tempest-VolumesDeleteCascade-134824525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:57:52 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-c13865f3-b315-4750-84a1-ae288468bb94 tempest-VolumesDeleteCascade-134824525 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 15:57:52 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-c13865f3-b315-4750-84a1-ae288468bb94 tempest-VolumesDeleteCascade-134824525 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 15:57:52 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c13865f3-b315-4750-84a1-ae288468bb94 tempest-VolumesDeleteCascade-134824525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-efd54d1e-4fce-4679-ae10-7b11ef7c0073 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:57:52 devstack sudo[97349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-efd54d1e-4fce-4679-ae10-7b11ef7c0073 1073741824 Jul 10 15:57:52 devstack sudo[97349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:57:52 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-3a90d550-c2d7-4c0a-9f88-5ad5a9d4e40d tempest-TestStampPattern-1127543775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2be3d1c8-f507-479a-afc8-ab2d3ac1f2fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ff68687-c9f5-4d47-a2bb-8312436fc4b7', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:57:52 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-3a90d550-c2d7-4c0a-9f88-5ad5a9d4e40d tempest-TestStampPattern-1127543775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (662bc020-1799-4036-82e8-dca0f2b721c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:57:52 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-3a90d550-c2d7-4c0a-9f88-5ad5a9d4e40d tempest-TestStampPattern-1127543775 None] Volume volume-4ff68687-c9f5-4d47-a2bb-8312436fc4b7 (4ff68687-c9f5-4d47-a2bb-8312436fc4b7): created successfully Jul 10 15:57:52 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-3a90d550-c2d7-4c0a-9f88-5ad5a9d4e40d tempest-TestStampPattern-1127543775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (662bc020-1799-4036-82e8-dca0f2b721c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:57:52 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-3a90d550-c2d7-4c0a-9f88-5ad5a9d4e40d tempest-TestStampPattern-1127543775 None] Flow 'volume_create_manager' (7e7afb79-49c9-445d-83de-bbc2a3970546) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:57:52 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-3a90d550-c2d7-4c0a-9f88-5ad5a9d4e40d tempest-TestStampPattern-1127543775 None] Created volume successfully. Jul 10 15:57:53 devstack sudo[97349]: pam_unix(sudo:session): session closed for user root Jul 10 15:57:53 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c13865f3-b315-4750-84a1-ae288468bb94 tempest-VolumesDeleteCascade-134824525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-efd54d1e-4fce-4679-ae10-7b11ef7c0073 1073741824" returned: 0 in 0.948s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:57:53 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c13865f3-b315-4750-84a1-ae288468bb94 tempest-VolumesDeleteCascade-134824525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-efd54d1e-4fce-4679-ae10-7b11ef7c0073 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:57:53 devstack sudo[97362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-efd54d1e-4fce-4679-ae10-7b11ef7c0073 Jul 10 15:57:53 devstack sudo[97362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:57:54 devstack sudo[97362]: pam_unix(sudo:session): session closed for user root Jul 10 15:57:54 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c13865f3-b315-4750-84a1-ae288468bb94 tempest-VolumesDeleteCascade-134824525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-efd54d1e-4fce-4679-ae10-7b11ef7c0073" returned: 0 in 0.645s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:57:54 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-c13865f3-b315-4750-84a1-ae288468bb94 tempest-VolumesDeleteCascade-134824525 None] <== create_volume: return (1633ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 15:57:54 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-c13865f3-b315-4750-84a1-ae288468bb94 tempest-VolumesDeleteCascade-134824525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.640s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:57:54 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-36d167e0-f61b-4ea5-913b-130ff03a795e tempest-VolumeSnapshotQuotasNegativeTestJSON-2106898324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.905s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:57:54 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-36d167e0-f61b-4ea5-913b-130ff03a795e tempest-VolumeSnapshotQuotasNegativeTestJSON-2106898324 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:57:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1104441373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64b61d22-7d1e-40b7-b500-7f1b26741d5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04fd5f770d6544ccb781c3540e6a717d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:57:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:57:48Z,use_quota=True,user_id='648fdbe52fca42c6a98fac87aa80f47a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 15:57:54 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-36d167e0-f61b-4ea5-913b-130ff03a795e tempest-VolumeSnapshotQuotasNegativeTestJSON-2106898324 None] Creating volume 64b61d22-7d1e-40b7-b500-7f1b26741d5b {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 15:57:54 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-36d167e0-f61b-4ea5-913b-130ff03a795e tempest-VolumeSnapshotQuotasNegativeTestJSON-2106898324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:57:54 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-36d167e0-f61b-4ea5-913b-130ff03a795e tempest-VolumeSnapshotQuotasNegativeTestJSON-2106898324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:57:54 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-36d167e0-f61b-4ea5-913b-130ff03a795e tempest-VolumeSnapshotQuotasNegativeTestJSON-2106898324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:57:54 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-36d167e0-f61b-4ea5-913b-130ff03a795e tempest-VolumeSnapshotQuotasNegativeTestJSON-2106898324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:57:54 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-36d167e0-f61b-4ea5-913b-130ff03a795e tempest-VolumeSnapshotQuotasNegativeTestJSON-2106898324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:57:54 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-36d167e0-f61b-4ea5-913b-130ff03a795e tempest-VolumeSnapshotQuotasNegativeTestJSON-2106898324 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 15:57:54 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-36d167e0-f61b-4ea5-913b-130ff03a795e tempest-VolumeSnapshotQuotasNegativeTestJSON-2106898324 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 15:57:54 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-36d167e0-f61b-4ea5-913b-130ff03a795e tempest-VolumeSnapshotQuotasNegativeTestJSON-2106898324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-64b61d22-7d1e-40b7-b500-7f1b26741d5b 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:57:54 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c13865f3-b315-4750-84a1-ae288468bb94 tempest-VolumesDeleteCascade-134824525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34cae410-1d5e-4315-9ee0-0e424cb22f53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efd54d1e-4fce-4679-ae10-7b11ef7c0073', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:57:54 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c13865f3-b315-4750-84a1-ae288468bb94 tempest-VolumesDeleteCascade-134824525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3f7a0d2-8cfb-47d0-8155-79202a0dd21b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:57:54 devstack sudo[97365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-64b61d22-7d1e-40b7-b500-7f1b26741d5b 1073741824 Jul 10 15:57:54 devstack sudo[97365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:57:54 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-c13865f3-b315-4750-84a1-ae288468bb94 tempest-VolumesDeleteCascade-134824525 None] Volume volume-efd54d1e-4fce-4679-ae10-7b11ef7c0073 (efd54d1e-4fce-4679-ae10-7b11ef7c0073): created successfully Jul 10 15:57:54 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c13865f3-b315-4750-84a1-ae288468bb94 tempest-VolumesDeleteCascade-134824525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3f7a0d2-8cfb-47d0-8155-79202a0dd21b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:57:54 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c13865f3-b315-4750-84a1-ae288468bb94 tempest-VolumesDeleteCascade-134824525 None] Flow 'volume_create_manager' (4c8986e5-057b-41f5-9d64-a608596dba1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:57:54 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-c13865f3-b315-4750-84a1-ae288468bb94 tempest-VolumesDeleteCascade-134824525 None] Created volume successfully. Jul 10 15:57:55 devstack sudo[97365]: pam_unix(sudo:session): session closed for user root Jul 10 15:57:55 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-36d167e0-f61b-4ea5-913b-130ff03a795e tempest-VolumeSnapshotQuotasNegativeTestJSON-2106898324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-64b61d22-7d1e-40b7-b500-7f1b26741d5b 1073741824" returned: 0 in 0.830s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:57:55 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-36d167e0-f61b-4ea5-913b-130ff03a795e tempest-VolumeSnapshotQuotasNegativeTestJSON-2106898324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-64b61d22-7d1e-40b7-b500-7f1b26741d5b {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:57:55 devstack sudo[97371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-64b61d22-7d1e-40b7-b500-7f1b26741d5b Jul 10 15:57:55 devstack sudo[97371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:57:55 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-6eabf3db-89f5-4bb9-b9c5-35b8363d31d4 tempest-VolumesDeleteCascade-134824525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:57:55 devstack sudo[97371]: pam_unix(sudo:session): session closed for user root Jul 10 15:57:55 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-36d167e0-f61b-4ea5-913b-130ff03a795e tempest-VolumeSnapshotQuotasNegativeTestJSON-2106898324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-64b61d22-7d1e-40b7-b500-7f1b26741d5b" returned: 0 in 0.664s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:57:55 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-36d167e0-f61b-4ea5-913b-130ff03a795e tempest-VolumeSnapshotQuotasNegativeTestJSON-2106898324 None] <== create_volume: return (1537ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 15:57:55 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-36d167e0-f61b-4ea5-913b-130ff03a795e tempest-VolumeSnapshotQuotasNegativeTestJSON-2106898324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.540s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:57:55 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-9606d5e1-1a20-4a20-871d-662f7e6ae4a2 tempest-VolumesGetTest-474292535 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.728s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:57:55 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-9606d5e1-1a20-4a20-871d-662f7e6ae4a2 tempest-VolumesGetTest-474292535 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:57:52Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1833901063',display_name='tempest-VolumesGetTest-Volume-1918819072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0dd37892-3709-4abd-81e8-dc99921f4af3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e1e4affd8f342e2a93b8606ed90299a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:57:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:57:52Z,use_quota=True,user_id='fd5c633b5ab34f4fa42d3bf6bcfa01a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 15:57:55 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-9606d5e1-1a20-4a20-871d-662f7e6ae4a2 tempest-VolumesGetTest-474292535 None] Creating volume 0dd37892-3709-4abd-81e8-dc99921f4af3 {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 15:57:55 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-9606d5e1-1a20-4a20-871d-662f7e6ae4a2 tempest-VolumesGetTest-474292535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:57:55 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-9606d5e1-1a20-4a20-871d-662f7e6ae4a2 tempest-VolumesGetTest-474292535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:57:55 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-9606d5e1-1a20-4a20-871d-662f7e6ae4a2 tempest-VolumesGetTest-474292535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:57:55 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-9606d5e1-1a20-4a20-871d-662f7e6ae4a2 tempest-VolumesGetTest-474292535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:57:55 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-9606d5e1-1a20-4a20-871d-662f7e6ae4a2 tempest-VolumesGetTest-474292535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:57:55 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-9606d5e1-1a20-4a20-871d-662f7e6ae4a2 tempest-VolumesGetTest-474292535 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 15:57:55 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-9606d5e1-1a20-4a20-871d-662f7e6ae4a2 tempest-VolumesGetTest-474292535 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 15:57:55 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-9606d5e1-1a20-4a20-871d-662f7e6ae4a2 tempest-VolumesGetTest-474292535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-0dd37892-3709-4abd-81e8-dc99921f4af3 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:57:56 devstack sudo[97374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-0dd37892-3709-4abd-81e8-dc99921f4af3 1073741824 Jul 10 15:57:56 devstack sudo[97374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:57:56 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-36d167e0-f61b-4ea5-913b-130ff03a795e tempest-VolumeSnapshotQuotasNegativeTestJSON-2106898324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abca6b63-01ff-4c8f-95f4-5bdbe5c017b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64b61d22-7d1e-40b7-b500-7f1b26741d5b', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:57:56 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-36d167e0-f61b-4ea5-913b-130ff03a795e tempest-VolumeSnapshotQuotasNegativeTestJSON-2106898324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (def1c918-cffe-4e1e-95a4-13b924cfb0e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:57:56 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-36d167e0-f61b-4ea5-913b-130ff03a795e tempest-VolumeSnapshotQuotasNegativeTestJSON-2106898324 None] Volume volume-64b61d22-7d1e-40b7-b500-7f1b26741d5b (64b61d22-7d1e-40b7-b500-7f1b26741d5b): created successfully Jul 10 15:57:56 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-36d167e0-f61b-4ea5-913b-130ff03a795e tempest-VolumeSnapshotQuotasNegativeTestJSON-2106898324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (def1c918-cffe-4e1e-95a4-13b924cfb0e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:57:56 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-36d167e0-f61b-4ea5-913b-130ff03a795e tempest-VolumeSnapshotQuotasNegativeTestJSON-2106898324 None] Flow 'volume_create_manager' (e1453419-9904-438a-84f0-59b17390971a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:57:56 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-36d167e0-f61b-4ea5-913b-130ff03a795e tempest-VolumeSnapshotQuotasNegativeTestJSON-2106898324 None] Created volume successfully. Jul 10 15:57:57 devstack sudo[97374]: pam_unix(sudo:session): session closed for user root Jul 10 15:57:57 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-9606d5e1-1a20-4a20-871d-662f7e6ae4a2 tempest-VolumesGetTest-474292535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-0dd37892-3709-4abd-81e8-dc99921f4af3 1073741824" returned: 0 in 1.188s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:57:57 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-615ae86b-faff-4944-bd84-261d755f0ad5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2106898324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:57:57 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-9606d5e1-1a20-4a20-871d-662f7e6ae4a2 tempest-VolumesGetTest-474292535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-0dd37892-3709-4abd-81e8-dc99921f4af3 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:57:57 devstack sudo[97426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-0dd37892-3709-4abd-81e8-dc99921f4af3 Jul 10 15:57:57 devstack sudo[97426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:57:57 devstack sudo[97426]: pam_unix(sudo:session): session closed for user root Jul 10 15:57:57 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-9606d5e1-1a20-4a20-871d-662f7e6ae4a2 tempest-VolumesGetTest-474292535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-0dd37892-3709-4abd-81e8-dc99921f4af3" returned: 0 in 0.685s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:57:57 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-9606d5e1-1a20-4a20-871d-662f7e6ae4a2 tempest-VolumesGetTest-474292535 None] <== create_volume: return (1921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 15:57:57 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-9606d5e1-1a20-4a20-871d-662f7e6ae4a2 tempest-VolumesGetTest-474292535 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.924s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:57:57 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-6eabf3db-89f5-4bb9-b9c5-35b8363d31d4 tempest-VolumesDeleteCascade-134824525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.466s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:57:57 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-6eabf3db-89f5-4bb9-b9c5-35b8363d31d4 tempest-VolumesDeleteCascade-134824525 None] Creating offline snapshot 99ac9d41-bad0-4c13-b8a3-3cbee7752cd3 of volume efd54d1e-4fce-4679-ae10-7b11ef7c0073 {{(pid=87420) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 15:57:57 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-9606d5e1-1a20-4a20-871d-662f7e6ae4a2 tempest-VolumesGetTest-474292535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8304e0e2-3b78-41ee-9b48-52fc5035404e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0dd37892-3709-4abd-81e8-dc99921f4af3', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:57:57 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-9606d5e1-1a20-4a20-871d-662f7e6ae4a2 tempest-VolumesGetTest-474292535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0301661-5e7a-4282-bb3f-ae94dec01060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:57:57 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[6726b129-643c-44a5-9470-f17f2b8cf2b0]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:57:57 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6eabf3db-89f5-4bb9-b9c5-35b8363d31d4 tempest-VolumesDeleteCascade-134824525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-efd54d1e-4fce-4679-ae10-7b11ef7c0073 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:57:57 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-9606d5e1-1a20-4a20-871d-662f7e6ae4a2 tempest-VolumesGetTest-474292535 None] Volume volume-0dd37892-3709-4abd-81e8-dc99921f4af3 (0dd37892-3709-4abd-81e8-dc99921f4af3): created successfully Jul 10 15:57:57 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-9606d5e1-1a20-4a20-871d-662f7e6ae4a2 tempest-VolumesGetTest-474292535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0301661-5e7a-4282-bb3f-ae94dec01060) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:57:57 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-9606d5e1-1a20-4a20-871d-662f7e6ae4a2 tempest-VolumesGetTest-474292535 None] Flow 'volume_create_manager' (613ad912-7764-4329-bda0-6d6aac4d1504) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:57:57 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-9606d5e1-1a20-4a20-871d-662f7e6ae4a2 tempest-VolumesGetTest-474292535 None] Created volume successfully. Jul 10 15:57:58 devstack sudo[97441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-efd54d1e-4fce-4679-ae10-7b11ef7c0073 Jul 10 15:57:58 devstack sudo[97441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:57:58 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-efc4a9bd-c440-49ae-86f5-5bdb7ebb87ce tempest-VolumesGetTest-474292535 None] Acquiring lock "cinder-0dd37892-3709-4abd-81e8-dc99921f4af3-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:57:58 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-efc4a9bd-c440-49ae-86f5-5bdb7ebb87ce tempest-VolumesGetTest-474292535 None] Lock "cinder-0dd37892-3709-4abd-81e8-dc99921f4af3-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:57:58 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-efc4a9bd-c440-49ae-86f5-5bdb7ebb87ce tempest-VolumesGetTest-474292535 None] Acquiring lock "cinder-quobyte-0dd37892-3709-4abd-81e8-dc99921f4af3" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:57:58 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-efc4a9bd-c440-49ae-86f5-5bdb7ebb87ce tempest-VolumesGetTest-474292535 None] Lock "cinder-quobyte-0dd37892-3709-4abd-81e8-dc99921f4af3" acquired by "delete_volume" :: waited 0.025s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:57:58 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6d5baa6-4dad-4777-8863-f001d5e48694]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:57:58 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-efc4a9bd-c440-49ae-86f5-5bdb7ebb87ce tempest-VolumesGetTest-474292535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-0dd37892-3709-4abd-81e8-dc99921f4af3 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:57:58 devstack sudo[97441]: pam_unix(sudo:session): session closed for user root Jul 10 15:57:58 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6eabf3db-89f5-4bb9-b9c5-35b8363d31d4 tempest-VolumesDeleteCascade-134824525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-efd54d1e-4fce-4679-ae10-7b11ef7c0073" returned: 0 in 0.963s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:57:58 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6eabf3db-89f5-4bb9-b9c5-35b8363d31d4 tempest-VolumesDeleteCascade-134824525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-efd54d1e-4fce-4679-ae10-7b11ef7c0073,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-efd54d1e-4fce-4679-ae10-7b11ef7c0073.99ac9d41-bad0-4c13-b8a3-3cbee7752cd3 1G {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:57:58 devstack sudo[97453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-0dd37892-3709-4abd-81e8-dc99921f4af3 Jul 10 15:57:58 devstack sudo[97453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:57:58 devstack sudo[97457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-efd54d1e-4fce-4679-ae10-7b11ef7c0073,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-efd54d1e-4fce-4679-ae10-7b11ef7c0073.99ac9d41-bad0-4c13-b8a3-3cbee7752cd3 1G Jul 10 15:57:58 devstack sudo[97457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:57:59 devstack sudo[97453]: pam_unix(sudo:session): session closed for user root Jul 10 15:57:59 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-efc4a9bd-c440-49ae-86f5-5bdb7ebb87ce tempest-VolumesGetTest-474292535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-0dd37892-3709-4abd-81e8-dc99921f4af3" returned: 0 in 0.887s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:57:59 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-efc4a9bd-c440-49ae-86f5-5bdb7ebb87ce tempest-VolumesGetTest-474292535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-0dd37892-3709-4abd-81e8-dc99921f4af3 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:57:59 devstack sudo[97467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-0dd37892-3709-4abd-81e8-dc99921f4af3 Jul 10 15:57:59 devstack sudo[97467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:57:59 devstack sudo[97457]: pam_unix(sudo:session): session closed for user root Jul 10 15:57:59 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6eabf3db-89f5-4bb9-b9c5-35b8363d31d4 tempest-VolumesDeleteCascade-134824525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-efd54d1e-4fce-4679-ae10-7b11ef7c0073,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-efd54d1e-4fce-4679-ae10-7b11ef7c0073.99ac9d41-bad0-4c13-b8a3-3cbee7752cd3 1G" returned: 0 in 0.962s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:57:59 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6eabf3db-89f5-4bb9-b9c5-35b8363d31d4 tempest-VolumesDeleteCascade-134824525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efd54d1e-4fce-4679-ae10-7b11ef7c0073 -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-efd54d1e-4fce-4679-ae10-7b11ef7c0073.99ac9d41-bad0-4c13-b8a3-3cbee7752cd3 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:57:59 devstack sudo[97470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efd54d1e-4fce-4679-ae10-7b11ef7c0073 -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-efd54d1e-4fce-4679-ae10-7b11ef7c0073.99ac9d41-bad0-4c13-b8a3-3cbee7752cd3 Jul 10 15:57:59 devstack sudo[97470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:58:00 devstack sudo[97467]: pam_unix(sudo:session): session closed for user root Jul 10 15:58:00 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-efc4a9bd-c440-49ae-86f5-5bdb7ebb87ce tempest-VolumesGetTest-474292535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-0dd37892-3709-4abd-81e8-dc99921f4af3" returned: 0 in 0.947s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:58:00 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-efc4a9bd-c440-49ae-86f5-5bdb7ebb87ce tempest-VolumesGetTest-474292535 None] Lock "cinder-quobyte-0dd37892-3709-4abd-81e8-dc99921f4af3" released by "delete_volume" :: held 1.900s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:58:00 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-efc4a9bd-c440-49ae-86f5-5bdb7ebb87ce tempest-VolumesGetTest-474292535 None] Created reservations ['9d88adfe-501d-4091-b58f-145aa16070b3', '441720e2-1a80-476f-b7e9-70a3ab774810', '8de83cd9-64c9-4d7d-bf5a-fdc46d8fc334', '5d3880d3-b431-4fb0-adeb-1a40fcacb772'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 15:58:00 devstack sudo[97470]: pam_unix(sudo:session): session closed for user root Jul 10 15:58:00 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6eabf3db-89f5-4bb9-b9c5-35b8363d31d4 tempest-VolumesDeleteCascade-134824525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efd54d1e-4fce-4679-ae10-7b11ef7c0073 -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-efd54d1e-4fce-4679-ae10-7b11ef7c0073.99ac9d41-bad0-4c13-b8a3-3cbee7752cd3" returned: 0 in 0.888s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:58:00 devstack cinder-volume[87420]: WARNING cinder.volume.drivers.remotefs [None req-6eabf3db-89f5-4bb9-b9c5-35b8363d31d4 tempest-VolumesDeleteCascade-134824525 None] /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-efd54d1e-4fce-4679-ae10-7b11ef7c0073.99ac9d41-bad0-4c13-b8a3-3cbee7752cd3 is being set with open permissions: ugo+rw Jul 10 15:58:00 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6eabf3db-89f5-4bb9-b9c5-35b8363d31d4 tempest-VolumesDeleteCascade-134824525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-efd54d1e-4fce-4679-ae10-7b11ef7c0073.99ac9d41-bad0-4c13-b8a3-3cbee7752cd3 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:58:00 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-efc4a9bd-c440-49ae-86f5-5bdb7ebb87ce tempest-VolumesGetTest-474292535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:58:00 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-efc4a9bd-c440-49ae-86f5-5bdb7ebb87ce tempest-VolumesGetTest-474292535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:58:00 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-efc4a9bd-c440-49ae-86f5-5bdb7ebb87ce tempest-VolumesGetTest-474292535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:58:00 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-efc4a9bd-c440-49ae-86f5-5bdb7ebb87ce tempest-VolumesGetTest-474292535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:58:00 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-efc4a9bd-c440-49ae-86f5-5bdb7ebb87ce tempest-VolumesGetTest-474292535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:58:00 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-efc4a9bd-c440-49ae-86f5-5bdb7ebb87ce tempest-VolumesGetTest-474292535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:58:00 devstack sudo[97476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-efd54d1e-4fce-4679-ae10-7b11ef7c0073.99ac9d41-bad0-4c13-b8a3-3cbee7752cd3 Jul 10 15:58:00 devstack sudo[97476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:58:00 devstack sudo[97477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 15:58:00 devstack sudo[97477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:58:01 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-0ab6f42d-117c-45ff-aed4-d1cc2a529bd7 tempest-VolumesGetTest-474292535 None] Acquiring lock "cinder-b22eb98f-531c-4737-bd33-8e6021a0345d-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:58:01 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-0ab6f42d-117c-45ff-aed4-d1cc2a529bd7 tempest-VolumesGetTest-474292535 None] Lock "cinder-b22eb98f-531c-4737-bd33-8e6021a0345d-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:58:01 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-0ab6f42d-117c-45ff-aed4-d1cc2a529bd7 tempest-VolumesGetTest-474292535 None] Acquiring lock "cinder-quobyte-b22eb98f-531c-4737-bd33-8e6021a0345d" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:58:01 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-0ab6f42d-117c-45ff-aed4-d1cc2a529bd7 tempest-VolumesGetTest-474292535 None] Lock "cinder-quobyte-b22eb98f-531c-4737-bd33-8e6021a0345d" acquired by "delete_volume" :: waited 0.029s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:58:01 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[37fe302c-ff91-43a0-8d80-64731bca1e54]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:58:01 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-0ab6f42d-117c-45ff-aed4-d1cc2a529bd7 tempest-VolumesGetTest-474292535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b22eb98f-531c-4737-bd33-8e6021a0345d {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:58:01 devstack sudo[97480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b22eb98f-531c-4737-bd33-8e6021a0345d Jul 10 15:58:01 devstack sudo[97480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:58:01 devstack sudo[97476]: pam_unix(sudo:session): session closed for user root Jul 10 15:58:01 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6eabf3db-89f5-4bb9-b9c5-35b8363d31d4 tempest-VolumesDeleteCascade-134824525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-efd54d1e-4fce-4679-ae10-7b11ef7c0073.99ac9d41-bad0-4c13-b8a3-3cbee7752cd3" returned: 0 in 0.804s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:58:01 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6eabf3db-89f5-4bb9-b9c5-35b8363d31d4 tempest-VolumesDeleteCascade-134824525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-efd54d1e-4fce-4679-ae10-7b11ef7c0073.info {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:58:01 devstack sudo[97483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-efd54d1e-4fce-4679-ae10-7b11ef7c0073.info Jul 10 15:58:01 devstack sudo[97483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:58:01 devstack sudo[97477]: pam_unix(sudo:session): session closed for user root Jul 10 15:58:01 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-efc4a9bd-c440-49ae-86f5-5bdb7ebb87ce tempest-VolumesGetTest-474292535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 1.171s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:58:01 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-efc4a9bd-c440-49ae-86f5-5bdb7ebb87ce tempest-VolumesGetTest-474292535 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 15:58:01 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-efc4a9bd-c440-49ae-86f5-5bdb7ebb87ce tempest-VolumesGetTest-474292535 None] Deleted volume successfully. Jul 10 15:58:02 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-efc4a9bd-c440-49ae-86f5-5bdb7ebb87ce tempest-VolumesGetTest-474292535 None] Lock "cinder-0dd37892-3709-4abd-81e8-dc99921f4af3-delete_volume" released by "delete_volume" :: held 3.355s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:58:02 devstack sudo[97480]: pam_unix(sudo:session): session closed for user root Jul 10 15:58:02 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-0ab6f42d-117c-45ff-aed4-d1cc2a529bd7 tempest-VolumesGetTest-474292535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b22eb98f-531c-4737-bd33-8e6021a0345d" returned: 0 in 1.129s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:58:02 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-0ab6f42d-117c-45ff-aed4-d1cc2a529bd7 tempest-VolumesGetTest-474292535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b22eb98f-531c-4737-bd33-8e6021a0345d {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:58:02 devstack sudo[97490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b22eb98f-531c-4737-bd33-8e6021a0345d Jul 10 15:58:02 devstack sudo[97490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:58:02 devstack sudo[97483]: pam_unix(sudo:session): session closed for user root Jul 10 15:58:02 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6eabf3db-89f5-4bb9-b9c5-35b8363d31d4 tempest-VolumesDeleteCascade-134824525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-efd54d1e-4fce-4679-ae10-7b11ef7c0073.info" returned: 0 in 0.951s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:58:02 devstack cinder-volume[87420]: WARNING cinder.volume.drivers.remotefs [None req-6eabf3db-89f5-4bb9-b9c5-35b8363d31d4 tempest-VolumesDeleteCascade-134824525 None] /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-efd54d1e-4fce-4679-ae10-7b11ef7c0073.info is being set with open permissions: ugo+rw Jul 10 15:58:02 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6eabf3db-89f5-4bb9-b9c5-35b8363d31d4 tempest-VolumesDeleteCascade-134824525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-efd54d1e-4fce-4679-ae10-7b11ef7c0073.info {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:58:02 devstack sudo[97492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-efd54d1e-4fce-4679-ae10-7b11ef7c0073.info Jul 10 15:58:02 devstack sudo[97492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:58:03 devstack sudo[97490]: pam_unix(sudo:session): session closed for user root Jul 10 15:58:03 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-0ab6f42d-117c-45ff-aed4-d1cc2a529bd7 tempest-VolumesGetTest-474292535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b22eb98f-531c-4737-bd33-8e6021a0345d" returned: 0 in 0.814s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:58:03 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-0ab6f42d-117c-45ff-aed4-d1cc2a529bd7 tempest-VolumesGetTest-474292535 None] Lock "cinder-quobyte-b22eb98f-531c-4737-bd33-8e6021a0345d" released by "delete_volume" :: held 2.059s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:58:03 devstack sudo[97492]: pam_unix(sudo:session): session closed for user root Jul 10 15:58:03 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6eabf3db-89f5-4bb9-b9c5-35b8363d31d4 tempest-VolumesDeleteCascade-134824525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-efd54d1e-4fce-4679-ae10-7b11ef7c0073.info" returned: 0 in 0.774s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:58:03 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-6eabf3db-89f5-4bb9-b9c5-35b8363d31d4 tempest-VolumesDeleteCascade-134824525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.453s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:58:03 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-615ae86b-faff-4944-bd84-261d755f0ad5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2106898324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.161s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:58:03 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-615ae86b-faff-4944-bd84-261d755f0ad5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2106898324 None] Creating offline snapshot 3accf8e9-4fc6-4213-84ab-f1e1fbc2f59f of volume 64b61d22-7d1e-40b7-b500-7f1b26741d5b {{(pid=87420) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 15:58:03 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-6eabf3db-89f5-4bb9-b9c5-35b8363d31d4 tempest-VolumesDeleteCascade-134824525 None] Create snapshot completed successfully Jul 10 15:58:03 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f856516-91bb-42a2-8682-812bb8c6c2a3]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:58:03 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-615ae86b-faff-4944-bd84-261d755f0ad5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2106898324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-64b61d22-7d1e-40b7-b500-7f1b26741d5b {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:58:03 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-0ab6f42d-117c-45ff-aed4-d1cc2a529bd7 tempest-VolumesGetTest-474292535 None] Created reservations ['e36bdad3-d320-4ce5-9d02-6e64d70348d3', 'a1992f6b-69c6-4271-ac59-b192acf9514b', '4ae12c64-3dc9-4d63-8ee5-1a07916f1b02', 'aac1d941-41ac-4a64-994b-2c3e4a907593'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 15:58:03 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-0ab6f42d-117c-45ff-aed4-d1cc2a529bd7 tempest-VolumesGetTest-474292535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:58:03 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-0ab6f42d-117c-45ff-aed4-d1cc2a529bd7 tempest-VolumesGetTest-474292535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:58:03 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-0ab6f42d-117c-45ff-aed4-d1cc2a529bd7 tempest-VolumesGetTest-474292535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:58:03 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-0ab6f42d-117c-45ff-aed4-d1cc2a529bd7 tempest-VolumesGetTest-474292535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:58:03 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-0ab6f42d-117c-45ff-aed4-d1cc2a529bd7 tempest-VolumesGetTest-474292535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:58:03 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-0ab6f42d-117c-45ff-aed4-d1cc2a529bd7 tempest-VolumesGetTest-474292535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:58:03 devstack sudo[97497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-64b61d22-7d1e-40b7-b500-7f1b26741d5b Jul 10 15:58:03 devstack sudo[97497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:58:03 devstack sudo[97498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 15:58:03 devstack sudo[97498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:58:04 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-0155c665-1592-4d4d-8466-3be443f705c3 tempest-VolumesDeleteCascade-134824525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:58:04 devstack sudo[97498]: pam_unix(sudo:session): session closed for user root Jul 10 15:58:04 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-0ab6f42d-117c-45ff-aed4-d1cc2a529bd7 tempest-VolumesGetTest-474292535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.830s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:58:04 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-0ab6f42d-117c-45ff-aed4-d1cc2a529bd7 tempest-VolumesGetTest-474292535 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 15:58:04 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-0ab6f42d-117c-45ff-aed4-d1cc2a529bd7 tempest-VolumesGetTest-474292535 None] Deleted volume successfully. Jul 10 15:58:04 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-0ab6f42d-117c-45ff-aed4-d1cc2a529bd7 tempest-VolumesGetTest-474292535 None] Lock "cinder-b22eb98f-531c-4737-bd33-8e6021a0345d-delete_volume" released by "delete_volume" :: held 3.335s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:58:04 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-caf8c882-4904-4765-babc-c51ad5d8904f tempest-VolumesGetTest-474292535 None] Acquiring lock "cinder-a29793d6-41bd-4fa1-86d4-09dcac617856-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:58:04 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-caf8c882-4904-4765-babc-c51ad5d8904f tempest-VolumesGetTest-474292535 None] Lock "cinder-a29793d6-41bd-4fa1-86d4-09dcac617856-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:58:04 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-caf8c882-4904-4765-babc-c51ad5d8904f tempest-VolumesGetTest-474292535 None] Acquiring lock "cinder-quobyte-a29793d6-41bd-4fa1-86d4-09dcac617856" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:58:04 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-caf8c882-4904-4765-babc-c51ad5d8904f tempest-VolumesGetTest-474292535 None] Lock "cinder-quobyte-a29793d6-41bd-4fa1-86d4-09dcac617856" acquired by "delete_volume" :: waited 0.024s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:58:04 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce867e3-adb6-4fe9-84ee-a16719a24749]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:58:04 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-caf8c882-4904-4765-babc-c51ad5d8904f tempest-VolumesGetTest-474292535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a29793d6-41bd-4fa1-86d4-09dcac617856 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:58:04 devstack sudo[97497]: pam_unix(sudo:session): session closed for user root Jul 10 15:58:04 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-615ae86b-faff-4944-bd84-261d755f0ad5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2106898324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-64b61d22-7d1e-40b7-b500-7f1b26741d5b" returned: 0 in 1.466s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:58:04 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-615ae86b-faff-4944-bd84-261d755f0ad5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2106898324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-64b61d22-7d1e-40b7-b500-7f1b26741d5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-64b61d22-7d1e-40b7-b500-7f1b26741d5b.3accf8e9-4fc6-4213-84ab-f1e1fbc2f59f 1G {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:58:04 devstack sudo[97507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-64b61d22-7d1e-40b7-b500-7f1b26741d5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-64b61d22-7d1e-40b7-b500-7f1b26741d5b.3accf8e9-4fc6-4213-84ab-f1e1fbc2f59f 1G Jul 10 15:58:04 devstack sudo[97507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:58:04 devstack sudo[97506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a29793d6-41bd-4fa1-86d4-09dcac617856 Jul 10 15:58:04 devstack sudo[97506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:58:05 devstack sudo[97506]: pam_unix(sudo:session): session closed for user root Jul 10 15:58:05 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-caf8c882-4904-4765-babc-c51ad5d8904f tempest-VolumesGetTest-474292535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a29793d6-41bd-4fa1-86d4-09dcac617856" returned: 0 in 0.854s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:58:05 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-caf8c882-4904-4765-babc-c51ad5d8904f tempest-VolumesGetTest-474292535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a29793d6-41bd-4fa1-86d4-09dcac617856 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:58:05 devstack sudo[97518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a29793d6-41bd-4fa1-86d4-09dcac617856 Jul 10 15:58:05 devstack sudo[97518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:58:05 devstack sudo[97507]: pam_unix(sudo:session): session closed for user root Jul 10 15:58:05 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-615ae86b-faff-4944-bd84-261d755f0ad5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2106898324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-64b61d22-7d1e-40b7-b500-7f1b26741d5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-64b61d22-7d1e-40b7-b500-7f1b26741d5b.3accf8e9-4fc6-4213-84ab-f1e1fbc2f59f 1G" returned: 0 in 1.045s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:58:05 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-615ae86b-faff-4944-bd84-261d755f0ad5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2106898324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64b61d22-7d1e-40b7-b500-7f1b26741d5b -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-64b61d22-7d1e-40b7-b500-7f1b26741d5b.3accf8e9-4fc6-4213-84ab-f1e1fbc2f59f {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:58:05 devstack sudo[97520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64b61d22-7d1e-40b7-b500-7f1b26741d5b -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-64b61d22-7d1e-40b7-b500-7f1b26741d5b.3accf8e9-4fc6-4213-84ab-f1e1fbc2f59f Jul 10 15:58:05 devstack sudo[97520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:58:06 devstack sudo[97518]: pam_unix(sudo:session): session closed for user root Jul 10 15:58:06 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-caf8c882-4904-4765-babc-c51ad5d8904f tempest-VolumesGetTest-474292535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a29793d6-41bd-4fa1-86d4-09dcac617856" returned: 0 in 0.745s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:58:06 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-caf8c882-4904-4765-babc-c51ad5d8904f tempest-VolumesGetTest-474292535 None] Lock "cinder-quobyte-a29793d6-41bd-4fa1-86d4-09dcac617856" released by "delete_volume" :: held 1.682s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:58:06 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-caf8c882-4904-4765-babc-c51ad5d8904f tempest-VolumesGetTest-474292535 None] Created reservations ['e0b1597f-688b-468e-a941-c3f9bf28dabd', 'b87427b6-75a1-4122-a4f4-135f768944b5', '15169ac1-ca53-4787-b188-9928c7761425', '1781cd42-6ef2-4995-b349-83fd833d1a94'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 15:58:06 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-caf8c882-4904-4765-babc-c51ad5d8904f tempest-VolumesGetTest-474292535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:58:06 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-caf8c882-4904-4765-babc-c51ad5d8904f tempest-VolumesGetTest-474292535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:58:06 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-caf8c882-4904-4765-babc-c51ad5d8904f tempest-VolumesGetTest-474292535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:58:06 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-caf8c882-4904-4765-babc-c51ad5d8904f tempest-VolumesGetTest-474292535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:58:06 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-caf8c882-4904-4765-babc-c51ad5d8904f tempest-VolumesGetTest-474292535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:58:06 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-caf8c882-4904-4765-babc-c51ad5d8904f tempest-VolumesGetTest-474292535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:58:06 devstack sudo[97526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 15:58:06 devstack sudo[97526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:58:06 devstack sudo[97520]: pam_unix(sudo:session): session closed for user root Jul 10 15:58:06 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-615ae86b-faff-4944-bd84-261d755f0ad5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2106898324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64b61d22-7d1e-40b7-b500-7f1b26741d5b -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-64b61d22-7d1e-40b7-b500-7f1b26741d5b.3accf8e9-4fc6-4213-84ab-f1e1fbc2f59f" returned: 0 in 0.790s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:58:06 devstack cinder-volume[87420]: WARNING cinder.volume.drivers.remotefs [None req-615ae86b-faff-4944-bd84-261d755f0ad5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2106898324 None] /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-64b61d22-7d1e-40b7-b500-7f1b26741d5b.3accf8e9-4fc6-4213-84ab-f1e1fbc2f59f is being set with open permissions: ugo+rw Jul 10 15:58:06 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-615ae86b-faff-4944-bd84-261d755f0ad5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2106898324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-64b61d22-7d1e-40b7-b500-7f1b26741d5b.3accf8e9-4fc6-4213-84ab-f1e1fbc2f59f {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:58:06 devstack sudo[97528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-64b61d22-7d1e-40b7-b500-7f1b26741d5b.3accf8e9-4fc6-4213-84ab-f1e1fbc2f59f Jul 10 15:58:06 devstack sudo[97528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:58:07 devstack sudo[97526]: pam_unix(sudo:session): session closed for user root Jul 10 15:58:07 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-caf8c882-4904-4765-babc-c51ad5d8904f tempest-VolumesGetTest-474292535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.750s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:58:07 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-caf8c882-4904-4765-babc-c51ad5d8904f tempest-VolumesGetTest-474292535 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 15:58:07 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-caf8c882-4904-4765-babc-c51ad5d8904f tempest-VolumesGetTest-474292535 None] Deleted volume successfully. Jul 10 15:58:07 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-caf8c882-4904-4765-babc-c51ad5d8904f tempest-VolumesGetTest-474292535 None] Lock "cinder-a29793d6-41bd-4fa1-86d4-09dcac617856-delete_volume" released by "delete_volume" :: held 2.722s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:58:07 devstack sudo[97528]: pam_unix(sudo:session): session closed for user root Jul 10 15:58:07 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-615ae86b-faff-4944-bd84-261d755f0ad5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2106898324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-64b61d22-7d1e-40b7-b500-7f1b26741d5b.3accf8e9-4fc6-4213-84ab-f1e1fbc2f59f" returned: 0 in 0.766s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:58:07 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-615ae86b-faff-4944-bd84-261d755f0ad5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2106898324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-64b61d22-7d1e-40b7-b500-7f1b26741d5b.info {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:58:07 devstack sudo[97533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-64b61d22-7d1e-40b7-b500-7f1b26741d5b.info Jul 10 15:58:07 devstack sudo[97533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:58:07 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-de8dc4ff-0600-415d-aeee-e453114d0ba3 tempest-VolumesGetTest-474292535 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 15:58:07 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-de8dc4ff-0600-415d-aeee-e453114d0ba3 tempest-VolumesGetTest-474292535 None] Flow 'volume_create_manager' (a30e49c6-d10f-4293-a7a5-b9816920f187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:58:07 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-de8dc4ff-0600-415d-aeee-e453114d0ba3 tempest-VolumesGetTest-474292535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e7b2ddc-5a04-4419-9d11-9e548fc42dba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:58:08 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-de8dc4ff-0600-415d-aeee-e453114d0ba3 tempest-VolumesGetTest-474292535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e7b2ddc-5a04-4419-9d11-9e548fc42dba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:58:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1220220188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30d59b81-5f5c-4ffe-b1e0-01eaeb73e9dc,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='7e1e4affd8f342e2a93b8606ed90299a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:58:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:58:08Z,use_quota=True,user_id='fd5c633b5ab34f4fa42d3bf6bcfa01a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:58:08 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-de8dc4ff-0600-415d-aeee-e453114d0ba3 tempest-VolumesGetTest-474292535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7107bf3d-0728-460f-b5b2-753706024722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:58:08 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-de8dc4ff-0600-415d-aeee-e453114d0ba3 tempest-VolumesGetTest-474292535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7107bf3d-0728-460f-b5b2-753706024722) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:58:08 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-de8dc4ff-0600-415d-aeee-e453114d0ba3 tempest-VolumesGetTest-474292535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5765e45-887b-46f1-9208-5d28f5ace075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:58:08 devstack cinder-volume[87420]: DEBUG cinder.image.glance [None req-de8dc4ff-0600-415d-aeee-e453114d0ba3 tempest-VolumesGetTest-474292535 None] Creating Keystone auth plugin from conf {{(pid=87420) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 10 15:58:08 devstack sudo[97533]: pam_unix(sudo:session): session closed for user root Jul 10 15:58:08 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-615ae86b-faff-4944-bd84-261d755f0ad5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2106898324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-64b61d22-7d1e-40b7-b500-7f1b26741d5b.info" returned: 0 in 0.776s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:58:08 devstack cinder-volume[87420]: WARNING cinder.volume.drivers.remotefs [None req-615ae86b-faff-4944-bd84-261d755f0ad5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2106898324 None] /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-64b61d22-7d1e-40b7-b500-7f1b26741d5b.info is being set with open permissions: ugo+rw Jul 10 15:58:08 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-615ae86b-faff-4944-bd84-261d755f0ad5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2106898324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-64b61d22-7d1e-40b7-b500-7f1b26741d5b.info {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:58:08 devstack sudo[97536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-64b61d22-7d1e-40b7-b500-7f1b26741d5b.info Jul 10 15:58:08 devstack sudo[97536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:58:08 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-de8dc4ff-0600-415d-aeee-e453114d0ba3 tempest-VolumesGetTest-474292535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5765e45-887b-46f1-9208-5d28f5ace075) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '30d59b81-5f5c-4ffe-b1e0-01eaeb73e9dc', 'volume_name': 'volume-30d59b81-5f5c-4ffe-b1e0-01eaeb73e9dc', 'volume_size': 1, 'image_id': '980bf5e0-e973-48f3-bc1f-383f924c4467', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/980bf5e0-e973-48f3-bc1f-383f924c4467', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'de9cf234f3774db489ed55d5afcfc7bf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '980bf5e0-e973-48f3-bc1f-383f924c4467', 'created_at': datetime.datetime(2026, 7, 10, 13, 42, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 13, 42, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/980bf5e0-e973-48f3-bc1f-383f924c4467/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:58:08 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-de8dc4ff-0600-415d-aeee-e453114d0ba3 tempest-VolumesGetTest-474292535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8654e4ab-e82b-4583-ad08-d15dcf7e23bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:58:08 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-de8dc4ff-0600-415d-aeee-e453114d0ba3 tempest-VolumesGetTest-474292535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8654e4ab-e82b-4583-ad08-d15dcf7e23bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:58:08 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-de8dc4ff-0600-415d-aeee-e453114d0ba3 tempest-VolumesGetTest-474292535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21559dba-8164-45c2-9b82-e58e49944ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:58:08 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-de8dc4ff-0600-415d-aeee-e453114d0ba3 tempest-VolumesGetTest-474292535 None] Volume 30d59b81-5f5c-4ffe-b1e0-01eaeb73e9dc: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-30d59b81-5f5c-4ffe-b1e0-01eaeb73e9dc', 'volume_size': 1, 'image_id': '980bf5e0-e973-48f3-bc1f-383f924c4467', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/980bf5e0-e973-48f3-bc1f-383f924c4467', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'de9cf234f3774db489ed55d5afcfc7bf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '980bf5e0-e973-48f3-bc1f-383f924c4467', 'created_at': datetime.datetime(2026, 7, 10, 13, 42, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 13, 42, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/980bf5e0-e973-48f3-bc1f-383f924c4467/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 10 15:58:08 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-de8dc4ff-0600-415d-aeee-e453114d0ba3 tempest-VolumesGetTest-474292535 None] Trying to clone 30d59b81-5f5c-4ffe-b1e0-01eaeb73e9dc from image 980bf5e0-e973-48f3-bc1f-383f924c4467 at location (None, [{'url': 'file:///opt/stack/data/glance/images/980bf5e0-e973-48f3-bc1f-383f924c4467', 'metadata': {}}]). {{(pid=87420) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 10 15:58:08 devstack cinder-volume[87420]: DEBUG cinder.image.image_utils [None req-de8dc4ff-0600-415d-aeee-e453114d0ba3 tempest-VolumesGetTest-474292535 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_980bf5e0-e973-48f3-bc1f-383f924c4467_xmsii_yzdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87420) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 10 15:58:08 devstack cinder-volume[87420]: INFO cinder.image.image_utils [None req-de8dc4ff-0600-415d-aeee-e453114d0ba3 tempest-VolumesGetTest-474292535 None] Image download 20.69 MB at 20.69 MB/s Jul 10 15:58:09 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbe13987-e8a0-4e3c-ab4e-f5e6409837c8]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:58:09 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-de8dc4ff-0600-415d-aeee-e453114d0ba3 tempest-VolumesGetTest-474292535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_980bf5e0-e973-48f3-bc1f-383f924c4467_xmsii_yzdevstack@QuobyteHD {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:58:09 devstack sudo[97548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_980bf5e0-e973-48f3-bc1f-383f924c4467_xmsii_yzdevstack@QuobyteHD Jul 10 15:58:09 devstack sudo[97548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:58:09 devstack sudo[97536]: pam_unix(sudo:session): session closed for user root Jul 10 15:58:09 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-615ae86b-faff-4944-bd84-261d755f0ad5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2106898324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-64b61d22-7d1e-40b7-b500-7f1b26741d5b.info" returned: 0 in 0.861s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:58:09 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-615ae86b-faff-4944-bd84-261d755f0ad5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2106898324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.842s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:58:09 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-0155c665-1592-4d4d-8466-3be443f705c3 tempest-VolumesDeleteCascade-134824525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.952s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:58:09 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-0155c665-1592-4d4d-8466-3be443f705c3 tempest-VolumesDeleteCascade-134824525 None] Creating offline snapshot 814ffd7c-628b-440c-b26f-644604e63db4 of volume efd54d1e-4fce-4679-ae10-7b11ef7c0073 {{(pid=87420) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 15:58:09 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[292a5adb-dbdf-4253-a56b-a90b93cb9eca]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:58:09 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-0155c665-1592-4d4d-8466-3be443f705c3 tempest-VolumesDeleteCascade-134824525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-efd54d1e-4fce-4679-ae10-7b11ef7c0073.99ac9d41-bad0-4c13-b8a3-3cbee7752cd3 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:58:09 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-615ae86b-faff-4944-bd84-261d755f0ad5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2106898324 None] Create snapshot completed successfully Jul 10 15:58:09 devstack sudo[97550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-efd54d1e-4fce-4679-ae10-7b11ef7c0073.99ac9d41-bad0-4c13-b8a3-3cbee7752cd3 Jul 10 15:58:09 devstack sudo[97550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:58:09 devstack sudo[97548]: pam_unix(sudo:session): session closed for user root Jul 10 15:58:09 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-de8dc4ff-0600-415d-aeee-e453114d0ba3 tempest-VolumesGetTest-474292535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_980bf5e0-e973-48f3-bc1f-383f924c4467_xmsii_yzdevstack@QuobyteHD" returned: 0 in 0.829s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:58:09 devstack cinder-volume[87420]: DEBUG cinder.image.image_utils [None req-de8dc4ff-0600-415d-aeee-e453114d0ba3 tempest-VolumesGetTest-474292535 None] Temporary image 980bf5e0-e973-48f3-bc1f-383f924c4467 is fetched for user fd5c633b5ab34f4fa42d3bf6bcfa01a4. {{(pid=87420) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 10 15:58:09 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5216e08-502d-4f1a-93ac-2848742c08ca]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:58:09 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-de8dc4ff-0600-415d-aeee-e453114d0ba3 tempest-VolumesGetTest-474292535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_980bf5e0-e973-48f3-bc1f-383f924c4467_xmsii_yzdevstack@QuobyteHD {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:58:10 devstack sudo[97555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_980bf5e0-e973-48f3-bc1f-383f924c4467_xmsii_yzdevstack@QuobyteHD Jul 10 15:58:10 devstack sudo[97555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:58:10 devstack sudo[97550]: pam_unix(sudo:session): session closed for user root Jul 10 15:58:10 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-0155c665-1592-4d4d-8466-3be443f705c3 tempest-VolumesDeleteCascade-134824525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-efd54d1e-4fce-4679-ae10-7b11ef7c0073.99ac9d41-bad0-4c13-b8a3-3cbee7752cd3" returned: 0 in 0.906s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:58:10 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-0155c665-1592-4d4d-8466-3be443f705c3 tempest-VolumesDeleteCascade-134824525 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-efd54d1e-4fce-4679-ae10-7b11ef7c0073(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87420) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 15:58:10 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-0155c665-1592-4d4d-8466-3be443f705c3 tempest-VolumesDeleteCascade-134824525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-efd54d1e-4fce-4679-ae10-7b11ef7c0073.99ac9d41-bad0-4c13-b8a3-3cbee7752cd3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-efd54d1e-4fce-4679-ae10-7b11ef7c0073.814ffd7c-628b-440c-b26f-644604e63db4 1G {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:58:10 devstack sudo[97561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-efd54d1e-4fce-4679-ae10-7b11ef7c0073.99ac9d41-bad0-4c13-b8a3-3cbee7752cd3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-efd54d1e-4fce-4679-ae10-7b11ef7c0073.814ffd7c-628b-440c-b26f-644604e63db4 1G Jul 10 15:58:10 devstack sudo[97561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:58:10 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-ad4a1d1c-51f2-4d5a-96ca-2cb9cc591757 tempest-VolumeSnapshotQuotasNegativeTestJSON-2106898324 None] Acquiring lock "cinder-3accf8e9-4fc6-4213-84ab-f1e1fbc2f59f-delete_snapshot" by "delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:58:10 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-ad4a1d1c-51f2-4d5a-96ca-2cb9cc591757 tempest-VolumeSnapshotQuotasNegativeTestJSON-2106898324 None] Lock "cinder-3accf8e9-4fc6-4213-84ab-f1e1fbc2f59f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.051s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:58:10 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-ad4a1d1c-51f2-4d5a-96ca-2cb9cc591757 tempest-VolumeSnapshotQuotasNegativeTestJSON-2106898324 None] Acquiring lock "cinder-quobyte-64b61d22-7d1e-40b7-b500-7f1b26741d5b" by "delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:58:10 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-ad4a1d1c-51f2-4d5a-96ca-2cb9cc591757 tempest-VolumeSnapshotQuotasNegativeTestJSON-2106898324 None] Lock "cinder-quobyte-64b61d22-7d1e-40b7-b500-7f1b26741d5b" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:58:10 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-ad4a1d1c-51f2-4d5a-96ca-2cb9cc591757 tempest-VolumeSnapshotQuotasNegativeTestJSON-2106898324 None] Acquiring lock "cinder-quobyte-3accf8e9-4fc6-4213-84ab-f1e1fbc2f59f" by "_delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:58:10 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-ad4a1d1c-51f2-4d5a-96ca-2cb9cc591757 tempest-VolumeSnapshotQuotasNegativeTestJSON-2106898324 None] Lock "cinder-quobyte-3accf8e9-4fc6-4213-84ab-f1e1fbc2f59f" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:58:10 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-ad4a1d1c-51f2-4d5a-96ca-2cb9cc591757 tempest-VolumeSnapshotQuotasNegativeTestJSON-2106898324 None] Deleting offline snapshot 3accf8e9-4fc6-4213-84ab-f1e1fbc2f59f of volume 64b61d22-7d1e-40b7-b500-7f1b26741d5b {{(pid=87420) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 15:58:10 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-ad4a1d1c-51f2-4d5a-96ca-2cb9cc591757 tempest-VolumeSnapshotQuotasNegativeTestJSON-2106898324 None] snapshot_file for this snap is: volume-64b61d22-7d1e-40b7-b500-7f1b26741d5b.3accf8e9-4fc6-4213-84ab-f1e1fbc2f59f {{(pid=87420) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 15:58:10 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b9d9d11-3773-4817-b200-a21b03c932c4]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:58:10 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ad4a1d1c-51f2-4d5a-96ca-2cb9cc591757 tempest-VolumeSnapshotQuotasNegativeTestJSON-2106898324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-64b61d22-7d1e-40b7-b500-7f1b26741d5b.3accf8e9-4fc6-4213-84ab-f1e1fbc2f59f {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:58:10 devstack sudo[97563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-64b61d22-7d1e-40b7-b500-7f1b26741d5b.3accf8e9-4fc6-4213-84ab-f1e1fbc2f59f Jul 10 15:58:10 devstack sudo[97563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:58:10 devstack sudo[97555]: pam_unix(sudo:session): session closed for user root Jul 10 15:58:10 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-de8dc4ff-0600-415d-aeee-e453114d0ba3 tempest-VolumesGetTest-474292535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_980bf5e0-e973-48f3-bc1f-383f924c4467_xmsii_yzdevstack@QuobyteHD" returned: 0 in 0.976s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:58:10 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-de8dc4ff-0600-415d-aeee-e453114d0ba3 tempest-VolumesGetTest-474292535 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:58:11 devstack sudo[97561]: pam_unix(sudo:session): session closed for user root Jul 10 15:58:11 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-0155c665-1592-4d4d-8466-3be443f705c3 tempest-VolumesDeleteCascade-134824525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-efd54d1e-4fce-4679-ae10-7b11ef7c0073.99ac9d41-bad0-4c13-b8a3-3cbee7752cd3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-efd54d1e-4fce-4679-ae10-7b11ef7c0073.814ffd7c-628b-440c-b26f-644604e63db4 1G" returned: 0 in 1.092s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:58:11 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-0155c665-1592-4d4d-8466-3be443f705c3 tempest-VolumesDeleteCascade-134824525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efd54d1e-4fce-4679-ae10-7b11ef7c0073.99ac9d41-bad0-4c13-b8a3-3cbee7752cd3 -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-efd54d1e-4fce-4679-ae10-7b11ef7c0073.814ffd7c-628b-440c-b26f-644604e63db4 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:58:11 devstack sudo[97573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efd54d1e-4fce-4679-ae10-7b11ef7c0073.99ac9d41-bad0-4c13-b8a3-3cbee7752cd3 -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-efd54d1e-4fce-4679-ae10-7b11ef7c0073.814ffd7c-628b-440c-b26f-644604e63db4 Jul 10 15:58:11 devstack sudo[97573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:58:11 devstack sudo[97563]: pam_unix(sudo:session): session closed for user root Jul 10 15:58:11 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ad4a1d1c-51f2-4d5a-96ca-2cb9cc591757 tempest-VolumeSnapshotQuotasNegativeTestJSON-2106898324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-64b61d22-7d1e-40b7-b500-7f1b26741d5b.3accf8e9-4fc6-4213-84ab-f1e1fbc2f59f" returned: 0 in 0.933s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:58:11 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-ad4a1d1c-51f2-4d5a-96ca-2cb9cc591757 tempest-VolumeSnapshotQuotasNegativeTestJSON-2106898324 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-64b61d22-7d1e-40b7-b500-7f1b26741d5b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87420) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 15:58:11 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc064105-159e-4960-b387-9d025ae3da19]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:58:11 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ad4a1d1c-51f2-4d5a-96ca-2cb9cc591757 tempest-VolumeSnapshotQuotasNegativeTestJSON-2106898324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-64b61d22-7d1e-40b7-b500-7f1b26741d5b {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:58:11 devstack sudo[97597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-64b61d22-7d1e-40b7-b500-7f1b26741d5b Jul 10 15:58:11 devstack sudo[97597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:58:12 devstack sudo[97573]: pam_unix(sudo:session): session closed for user root Jul 10 15:58:12 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-0155c665-1592-4d4d-8466-3be443f705c3 tempest-VolumesDeleteCascade-134824525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efd54d1e-4fce-4679-ae10-7b11ef7c0073.99ac9d41-bad0-4c13-b8a3-3cbee7752cd3 -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-efd54d1e-4fce-4679-ae10-7b11ef7c0073.814ffd7c-628b-440c-b26f-644604e63db4" returned: 0 in 0.719s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:58:12 devstack cinder-volume[87420]: WARNING cinder.volume.drivers.remotefs [None req-0155c665-1592-4d4d-8466-3be443f705c3 tempest-VolumesDeleteCascade-134824525 None] /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-efd54d1e-4fce-4679-ae10-7b11ef7c0073.814ffd7c-628b-440c-b26f-644604e63db4 is being set with open permissions: ugo+rw Jul 10 15:58:12 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-0155c665-1592-4d4d-8466-3be443f705c3 tempest-VolumesDeleteCascade-134824525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-efd54d1e-4fce-4679-ae10-7b11ef7c0073.814ffd7c-628b-440c-b26f-644604e63db4 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:58:12 devstack sudo[97602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-efd54d1e-4fce-4679-ae10-7b11ef7c0073.814ffd7c-628b-440c-b26f-644604e63db4 Jul 10 15:58:12 devstack sudo[97602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:58:12 devstack sudo[97597]: pam_unix(sudo:session): session closed for user root Jul 10 15:58:12 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ad4a1d1c-51f2-4d5a-96ca-2cb9cc591757 tempest-VolumeSnapshotQuotasNegativeTestJSON-2106898324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-64b61d22-7d1e-40b7-b500-7f1b26741d5b" returned: 0 in 0.773s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:58:12 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ad4a1d1c-51f2-4d5a-96ca-2cb9cc591757 tempest-VolumeSnapshotQuotasNegativeTestJSON-2106898324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-64b61d22-7d1e-40b7-b500-7f1b26741d5b.3accf8e9-4fc6-4213-84ab-f1e1fbc2f59f {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:58:12 devstack sudo[97607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-64b61d22-7d1e-40b7-b500-7f1b26741d5b.3accf8e9-4fc6-4213-84ab-f1e1fbc2f59f Jul 10 15:58:12 devstack sudo[97607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:58:12 devstack sudo[97602]: pam_unix(sudo:session): session closed for user root Jul 10 15:58:12 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-0155c665-1592-4d4d-8466-3be443f705c3 tempest-VolumesDeleteCascade-134824525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-efd54d1e-4fce-4679-ae10-7b11ef7c0073.814ffd7c-628b-440c-b26f-644604e63db4" returned: 0 in 0.649s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:58:12 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-0155c665-1592-4d4d-8466-3be443f705c3 tempest-VolumesDeleteCascade-134824525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.473s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:58:12 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-de8dc4ff-0600-415d-aeee-e453114d0ba3 tempest-VolumesGetTest-474292535 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.802s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:58:12 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-de8dc4ff-0600-415d-aeee-e453114d0ba3 tempest-VolumesGetTest-474292535 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:58:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1220220188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30d59b81-5f5c-4ffe-b1e0-01eaeb73e9dc,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='7e1e4affd8f342e2a93b8606ed90299a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:58:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:58:08Z,use_quota=True,user_id='fd5c633b5ab34f4fa42d3bf6bcfa01a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 15:58:12 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-de8dc4ff-0600-415d-aeee-e453114d0ba3 tempest-VolumesGetTest-474292535 None] Creating volume 30d59b81-5f5c-4ffe-b1e0-01eaeb73e9dc {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 15:58:12 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-de8dc4ff-0600-415d-aeee-e453114d0ba3 tempest-VolumesGetTest-474292535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:58:12 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-de8dc4ff-0600-415d-aeee-e453114d0ba3 tempest-VolumesGetTest-474292535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:58:12 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-de8dc4ff-0600-415d-aeee-e453114d0ba3 tempest-VolumesGetTest-474292535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:58:12 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-de8dc4ff-0600-415d-aeee-e453114d0ba3 tempest-VolumesGetTest-474292535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:58:12 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-de8dc4ff-0600-415d-aeee-e453114d0ba3 tempest-VolumesGetTest-474292535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:58:12 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-de8dc4ff-0600-415d-aeee-e453114d0ba3 tempest-VolumesGetTest-474292535 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 15:58:12 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-de8dc4ff-0600-415d-aeee-e453114d0ba3 tempest-VolumesGetTest-474292535 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 15:58:12 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-de8dc4ff-0600-415d-aeee-e453114d0ba3 tempest-VolumesGetTest-474292535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-30d59b81-5f5c-4ffe-b1e0-01eaeb73e9dc 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:58:12 devstack sudo[97610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-30d59b81-5f5c-4ffe-b1e0-01eaeb73e9dc 1073741824 Jul 10 15:58:12 devstack sudo[97610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:58:12 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-0155c665-1592-4d4d-8466-3be443f705c3 tempest-VolumesDeleteCascade-134824525 None] Create snapshot completed successfully Jul 10 15:58:13 devstack sudo[97607]: pam_unix(sudo:session): session closed for user root Jul 10 15:58:13 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ad4a1d1c-51f2-4d5a-96ca-2cb9cc591757 tempest-VolumeSnapshotQuotasNegativeTestJSON-2106898324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-64b61d22-7d1e-40b7-b500-7f1b26741d5b.3accf8e9-4fc6-4213-84ab-f1e1fbc2f59f" returned: 0 in 0.744s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:58:13 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ad4a1d1c-51f2-4d5a-96ca-2cb9cc591757 tempest-VolumeSnapshotQuotasNegativeTestJSON-2106898324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-64b61d22-7d1e-40b7-b500-7f1b26741d5b.3accf8e9-4fc6-4213-84ab-f1e1fbc2f59f {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:58:13 devstack sudo[97616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-64b61d22-7d1e-40b7-b500-7f1b26741d5b.3accf8e9-4fc6-4213-84ab-f1e1fbc2f59f Jul 10 15:58:13 devstack sudo[97616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:58:13 devstack sudo[97610]: pam_unix(sudo:session): session closed for user root Jul 10 15:58:13 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-de8dc4ff-0600-415d-aeee-e453114d0ba3 tempest-VolumesGetTest-474292535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-30d59b81-5f5c-4ffe-b1e0-01eaeb73e9dc 1073741824" returned: 0 in 0.831s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:58:13 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-de8dc4ff-0600-415d-aeee-e453114d0ba3 tempest-VolumesGetTest-474292535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-30d59b81-5f5c-4ffe-b1e0-01eaeb73e9dc {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:58:13 devstack sudo[97621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-30d59b81-5f5c-4ffe-b1e0-01eaeb73e9dc Jul 10 15:58:13 devstack sudo[97621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:58:13 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-578093c7-6672-44b1-9b60-d40cb1d19377 tempest-VolumesDeleteCascade-134824525 None] Acquiring lock "cinder-efd54d1e-4fce-4679-ae10-7b11ef7c0073-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:58:13 devstack sudo[97616]: pam_unix(sudo:session): session closed for user root Jul 10 15:58:13 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ad4a1d1c-51f2-4d5a-96ca-2cb9cc591757 tempest-VolumeSnapshotQuotasNegativeTestJSON-2106898324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-64b61d22-7d1e-40b7-b500-7f1b26741d5b.3accf8e9-4fc6-4213-84ab-f1e1fbc2f59f" returned: 0 in 0.679s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:58:13 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-578093c7-6672-44b1-9b60-d40cb1d19377 tempest-VolumesDeleteCascade-134824525 None] Lock "cinder-efd54d1e-4fce-4679-ae10-7b11ef7c0073-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:58:13 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-ad4a1d1c-51f2-4d5a-96ca-2cb9cc591757 tempest-VolumeSnapshotQuotasNegativeTestJSON-2106898324 None] Lock "cinder-quobyte-3accf8e9-4fc6-4213-84ab-f1e1fbc2f59f" released by "_delete_snapshot" :: held 3.270s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:58:13 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-ad4a1d1c-51f2-4d5a-96ca-2cb9cc591757 tempest-VolumeSnapshotQuotasNegativeTestJSON-2106898324 None] Lock "cinder-quobyte-64b61d22-7d1e-40b7-b500-7f1b26741d5b" released by "delete_snapshot" :: held 3.300s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:58:13 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-578093c7-6672-44b1-9b60-d40cb1d19377 tempest-VolumesDeleteCascade-134824525 None] Performing cascade delete. {{(pid=87420) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 10 15:58:13 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-578093c7-6672-44b1-9b60-d40cb1d19377 tempest-VolumesDeleteCascade-134824525 None] Acquiring lock "cinder-814ffd7c-628b-440c-b26f-644604e63db4-delete_snapshot" by "delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:58:13 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-578093c7-6672-44b1-9b60-d40cb1d19377 tempest-VolumesDeleteCascade-134824525 None] Lock "cinder-814ffd7c-628b-440c-b26f-644604e63db4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:58:13 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-578093c7-6672-44b1-9b60-d40cb1d19377 tempest-VolumesDeleteCascade-134824525 None] Acquiring lock "cinder-quobyte-efd54d1e-4fce-4679-ae10-7b11ef7c0073" by "delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:58:14 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-578093c7-6672-44b1-9b60-d40cb1d19377 tempest-VolumesDeleteCascade-134824525 None] Lock "cinder-quobyte-efd54d1e-4fce-4679-ae10-7b11ef7c0073" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:58:14 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-578093c7-6672-44b1-9b60-d40cb1d19377 tempest-VolumesDeleteCascade-134824525 None] Acquiring lock "cinder-quobyte-814ffd7c-628b-440c-b26f-644604e63db4" by "_delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:58:14 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-ad4a1d1c-51f2-4d5a-96ca-2cb9cc591757 tempest-VolumeSnapshotQuotasNegativeTestJSON-2106898324 None] Created reservations ['45305a68-4410-4713-be12-9c0fbb941984', 'f7915dc1-8d19-4dd0-89f0-944489d1faf9', 'cf9e005f-efd9-427a-8e31-b3911e51b5b1', '9e93318b-de88-4950-acae-0bc676a40284'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 15:58:14 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-578093c7-6672-44b1-9b60-d40cb1d19377 tempest-VolumesDeleteCascade-134824525 None] Lock "cinder-quobyte-814ffd7c-628b-440c-b26f-644604e63db4" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:58:14 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-578093c7-6672-44b1-9b60-d40cb1d19377 tempest-VolumesDeleteCascade-134824525 None] Deleting offline snapshot 814ffd7c-628b-440c-b26f-644604e63db4 of volume efd54d1e-4fce-4679-ae10-7b11ef7c0073 {{(pid=87420) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 15:58:14 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-578093c7-6672-44b1-9b60-d40cb1d19377 tempest-VolumesDeleteCascade-134824525 None] snapshot_file for this snap is: volume-efd54d1e-4fce-4679-ae10-7b11ef7c0073.814ffd7c-628b-440c-b26f-644604e63db4 {{(pid=87420) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 15:58:14 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0bf042a-4d41-4af3-9cf4-b72972afb7d1]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:58:14 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-578093c7-6672-44b1-9b60-d40cb1d19377 tempest-VolumesDeleteCascade-134824525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-efd54d1e-4fce-4679-ae10-7b11ef7c0073.814ffd7c-628b-440c-b26f-644604e63db4 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:58:14 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-ad4a1d1c-51f2-4d5a-96ca-2cb9cc591757 tempest-VolumeSnapshotQuotasNegativeTestJSON-2106898324 None] Delete snapshot completed successfully. Jul 10 15:58:14 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-ad4a1d1c-51f2-4d5a-96ca-2cb9cc591757 tempest-VolumeSnapshotQuotasNegativeTestJSON-2106898324 None] Lock "cinder-3accf8e9-4fc6-4213-84ab-f1e1fbc2f59f-delete_snapshot" released by "delete_snapshot" :: held 3.544s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:58:14 devstack sudo[97624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-efd54d1e-4fce-4679-ae10-7b11ef7c0073.814ffd7c-628b-440c-b26f-644604e63db4 Jul 10 15:58:14 devstack sudo[97624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:58:14 devstack sudo[97621]: pam_unix(sudo:session): session closed for user root Jul 10 15:58:14 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-de8dc4ff-0600-415d-aeee-e453114d0ba3 tempest-VolumesGetTest-474292535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-30d59b81-5f5c-4ffe-b1e0-01eaeb73e9dc" returned: 0 in 0.714s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:58:14 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-de8dc4ff-0600-415d-aeee-e453114d0ba3 tempest-VolumesGetTest-474292535 None] <== create_volume: return (1585ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 15:58:14 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-de8dc4ff-0600-415d-aeee-e453114d0ba3 tempest-VolumesGetTest-474292535 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.589s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:58:14 devstack cinder-volume[87420]: DEBUG cinder.volume.volume_utils [None req-de8dc4ff-0600-415d-aeee-e453114d0ba3 tempest-VolumesGetTest-474292535 None] Attempting download of 980bf5e0-e973-48f3-bc1f-383f924c4467 ((None, [{'url': 'file:///opt/stack/data/glance/images/980bf5e0-e973-48f3-bc1f-383f924c4467', 'metadata': {}}])) to volume 30d59b81-5f5c-4ffe-b1e0-01eaeb73e9dc. {{(pid=87420) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 10 15:58:14 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca33b574-eeb8-46e3-864b-6c0b33c852ab]: (4, 'raw') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:58:14 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-de8dc4ff-0600-415d-aeee-e453114d0ba3 tempest-VolumesGetTest-474292535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_980bf5e0-e973-48f3-bc1f-383f924c4467_6nu3xiie {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:58:14 devstack sudo[97628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_980bf5e0-e973-48f3-bc1f-383f924c4467_6nu3xiie Jul 10 15:58:14 devstack sudo[97628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:58:14 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-4be991e8-31a7-4070-9d75-dee0549fe8e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2106898324 None] Acquiring lock "cinder-64b61d22-7d1e-40b7-b500-7f1b26741d5b-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:58:14 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-4be991e8-31a7-4070-9d75-dee0549fe8e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2106898324 None] Lock "cinder-64b61d22-7d1e-40b7-b500-7f1b26741d5b-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:58:14 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-4be991e8-31a7-4070-9d75-dee0549fe8e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2106898324 None] Acquiring lock "cinder-quobyte-64b61d22-7d1e-40b7-b500-7f1b26741d5b" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:58:14 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-4be991e8-31a7-4070-9d75-dee0549fe8e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2106898324 None] Lock "cinder-quobyte-64b61d22-7d1e-40b7-b500-7f1b26741d5b" acquired by "delete_volume" :: waited 0.018s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:58:14 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[61991e71-1b19-4abb-bee9-f8e660dc7cd3]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:58:14 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4be991e8-31a7-4070-9d75-dee0549fe8e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2106898324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-64b61d22-7d1e-40b7-b500-7f1b26741d5b {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:58:14 devstack sudo[97624]: pam_unix(sudo:session): session closed for user root Jul 10 15:58:14 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-578093c7-6672-44b1-9b60-d40cb1d19377 tempest-VolumesDeleteCascade-134824525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-efd54d1e-4fce-4679-ae10-7b11ef7c0073.814ffd7c-628b-440c-b26f-644604e63db4" returned: 0 in 0.916s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:58:14 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-578093c7-6672-44b1-9b60-d40cb1d19377 tempest-VolumesDeleteCascade-134824525 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-efd54d1e-4fce-4679-ae10-7b11ef7c0073(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87420) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 15:58:15 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b8234a-54bb-4f9a-824a-e0d818ff7125]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:58:15 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-578093c7-6672-44b1-9b60-d40cb1d19377 tempest-VolumesDeleteCascade-134824525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-efd54d1e-4fce-4679-ae10-7b11ef7c0073.99ac9d41-bad0-4c13-b8a3-3cbee7752cd3 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:58:15 devstack sudo[97633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-64b61d22-7d1e-40b7-b500-7f1b26741d5b Jul 10 15:58:15 devstack sudo[97633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:58:15 devstack sudo[97634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-efd54d1e-4fce-4679-ae10-7b11ef7c0073.99ac9d41-bad0-4c13-b8a3-3cbee7752cd3 Jul 10 15:58:15 devstack sudo[97634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:58:15 devstack sudo[97628]: pam_unix(sudo:session): session closed for user root Jul 10 15:58:15 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-de8dc4ff-0600-415d-aeee-e453114d0ba3 tempest-VolumesGetTest-474292535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_980bf5e0-e973-48f3-bc1f-383f924c4467_6nu3xiie" returned: 0 in 0.756s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:58:15 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-de8dc4ff-0600-415d-aeee-e453114d0ba3 tempest-VolumesGetTest-474292535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_980bf5e0-e973-48f3-bc1f-383f924c4467_6nu3xiie {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:58:15 devstack sudo[97639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_980bf5e0-e973-48f3-bc1f-383f924c4467_6nu3xiie Jul 10 15:58:15 devstack sudo[97639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:58:15 devstack sudo[97633]: pam_unix(sudo:session): session closed for user root Jul 10 15:58:15 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4be991e8-31a7-4070-9d75-dee0549fe8e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2106898324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-64b61d22-7d1e-40b7-b500-7f1b26741d5b" returned: 0 in 0.768s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:58:15 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4be991e8-31a7-4070-9d75-dee0549fe8e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2106898324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-64b61d22-7d1e-40b7-b500-7f1b26741d5b {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:58:15 devstack sudo[97646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-64b61d22-7d1e-40b7-b500-7f1b26741d5b Jul 10 15:58:15 devstack sudo[97646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:58:15 devstack sudo[97634]: pam_unix(sudo:session): session closed for user root Jul 10 15:58:15 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-578093c7-6672-44b1-9b60-d40cb1d19377 tempest-VolumesDeleteCascade-134824525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-efd54d1e-4fce-4679-ae10-7b11ef7c0073.99ac9d41-bad0-4c13-b8a3-3cbee7752cd3" returned: 0 in 0.839s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:58:15 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-578093c7-6672-44b1-9b60-d40cb1d19377 tempest-VolumesDeleteCascade-134824525 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-efd54d1e-4fce-4679-ae10-7b11ef7c0073(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87420) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 15:58:15 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-578093c7-6672-44b1-9b60-d40cb1d19377 tempest-VolumesDeleteCascade-134824525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-efd54d1e-4fce-4679-ae10-7b11ef7c0073.814ffd7c-628b-440c-b26f-644604e63db4 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:58:15 devstack sudo[97651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-efd54d1e-4fce-4679-ae10-7b11ef7c0073.814ffd7c-628b-440c-b26f-644604e63db4 Jul 10 15:58:15 devstack sudo[97651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:58:16 devstack sudo[97639]: pam_unix(sudo:session): session closed for user root Jul 10 15:58:16 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-de8dc4ff-0600-415d-aeee-e453114d0ba3 tempest-VolumesGetTest-474292535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_980bf5e0-e973-48f3-bc1f-383f924c4467_6nu3xiie" returned: 1 in 0.842s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:58:16 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-de8dc4ff-0600-415d-aeee-e453114d0ba3 tempest-VolumesGetTest-474292535 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_980bf5e0-e973-48f3-bc1f-383f924c4467_6nu3xiie' failed. Not Retrying. {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 15:58:16 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6998e34-c85d-48f8-8565-22b3ce2ece3e]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:58:16 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-de8dc4ff-0600-415d-aeee-e453114d0ba3 tempest-VolumesGetTest-474292535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_980bf5e0-e973-48f3-bc1f-383f924c4467_xmsii_yzdevstack@QuobyteHD {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:58:16 devstack sudo[97653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_980bf5e0-e973-48f3-bc1f-383f924c4467_xmsii_yzdevstack@QuobyteHD Jul 10 15:58:16 devstack sudo[97653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:58:16 devstack sudo[97646]: pam_unix(sudo:session): session closed for user root Jul 10 15:58:16 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4be991e8-31a7-4070-9d75-dee0549fe8e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2106898324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-64b61d22-7d1e-40b7-b500-7f1b26741d5b" returned: 0 in 0.653s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:58:16 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-4be991e8-31a7-4070-9d75-dee0549fe8e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2106898324 None] Lock "cinder-quobyte-64b61d22-7d1e-40b7-b500-7f1b26741d5b" released by "delete_volume" :: held 1.507s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:58:16 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-4be991e8-31a7-4070-9d75-dee0549fe8e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2106898324 None] Created reservations ['839d01a4-6f6e-4352-b790-a883f4098711', 'ae8816d5-9b8e-4396-952c-f691bd0f600c', '850692e4-9bd6-424c-89b4-d21976674ab8', 'd0f798f5-28a2-49d6-b37a-0f7ed99989cc'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 15:58:16 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-4be991e8-31a7-4070-9d75-dee0549fe8e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2106898324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:58:16 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-4be991e8-31a7-4070-9d75-dee0549fe8e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2106898324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:58:16 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-4be991e8-31a7-4070-9d75-dee0549fe8e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2106898324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:58:16 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-4be991e8-31a7-4070-9d75-dee0549fe8e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2106898324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:58:16 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-4be991e8-31a7-4070-9d75-dee0549fe8e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2106898324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:58:16 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4be991e8-31a7-4070-9d75-dee0549fe8e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2106898324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:58:16 devstack sudo[97659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 15:58:16 devstack sudo[97659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:58:16 devstack sudo[97651]: pam_unix(sudo:session): session closed for user root Jul 10 15:58:16 devstack sudo[97653]: pam_unix(sudo:session): session closed for user root Jul 10 15:58:16 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-578093c7-6672-44b1-9b60-d40cb1d19377 tempest-VolumesDeleteCascade-134824525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-efd54d1e-4fce-4679-ae10-7b11ef7c0073.814ffd7c-628b-440c-b26f-644604e63db4" returned: 0 in 0.916s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:58:16 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-578093c7-6672-44b1-9b60-d40cb1d19377 tempest-VolumesDeleteCascade-134824525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-efd54d1e-4fce-4679-ae10-7b11ef7c0073.814ffd7c-628b-440c-b26f-644604e63db4 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:58:16 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-de8dc4ff-0600-415d-aeee-e453114d0ba3 tempest-VolumesGetTest-474292535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_980bf5e0-e973-48f3-bc1f-383f924c4467_xmsii_yzdevstack@QuobyteHD" returned: 0 in 0.757s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:58:16 devstack cinder-volume[87420]: DEBUG cinder.image.image_utils [None req-de8dc4ff-0600-415d-aeee-e453114d0ba3 tempest-VolumesGetTest-474292535 None] 980bf5e0-e973-48f3-bc1f-383f924c4467 was qcow2, converting to raw {{(pid=87420) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 10 15:58:16 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-de8dc4ff-0600-415d-aeee-e453114d0ba3 tempest-VolumesGetTest-474292535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_980bf5e0-e973-48f3-bc1f-383f924c4467_xmsii_yzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-30d59b81-5f5c-4ffe-b1e0-01eaeb73e9dc {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:58:16 devstack sudo[97664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-efd54d1e-4fce-4679-ae10-7b11ef7c0073.814ffd7c-628b-440c-b26f-644604e63db4 Jul 10 15:58:16 devstack sudo[97664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:58:16 devstack sudo[97665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_980bf5e0-e973-48f3-bc1f-383f924c4467_xmsii_yzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-30d59b81-5f5c-4ffe-b1e0-01eaeb73e9dc Jul 10 15:58:16 devstack sudo[97665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:58:17 devstack sudo[97659]: pam_unix(sudo:session): session closed for user root Jul 10 15:58:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4be991e8-31a7-4070-9d75-dee0549fe8e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2106898324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.672s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:58:17 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-4be991e8-31a7-4070-9d75-dee0549fe8e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2106898324 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 15:58:17 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-4be991e8-31a7-4070-9d75-dee0549fe8e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2106898324 None] Deleted volume successfully. Jul 10 15:58:17 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-4be991e8-31a7-4070-9d75-dee0549fe8e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2106898324 None] Lock "cinder-64b61d22-7d1e-40b7-b500-7f1b26741d5b-delete_volume" released by "delete_volume" :: held 2.445s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:58:17 devstack cinder-volume[87420]: DEBUG oslo_service.periodic_task [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87420) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 15:58:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:58:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:58:17 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:58:17 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:58:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:58:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:58:17 devstack sudo[97670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 15:58:17 devstack sudo[97670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:58:17 devstack sudo[97664]: pam_unix(sudo:session): session closed for user root Jul 10 15:58:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-578093c7-6672-44b1-9b60-d40cb1d19377 tempest-VolumesDeleteCascade-134824525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-efd54d1e-4fce-4679-ae10-7b11ef7c0073.814ffd7c-628b-440c-b26f-644604e63db4" returned: 0 in 0.782s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:58:17 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-578093c7-6672-44b1-9b60-d40cb1d19377 tempest-VolumesDeleteCascade-134824525 None] Lock "cinder-quobyte-814ffd7c-628b-440c-b26f-644604e63db4" released by "_delete_snapshot" :: held 3.568s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:58:17 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-578093c7-6672-44b1-9b60-d40cb1d19377 tempest-VolumesDeleteCascade-134824525 None] Lock "cinder-quobyte-efd54d1e-4fce-4679-ae10-7b11ef7c0073" released by "delete_snapshot" :: held 3.596s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:58:17 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-578093c7-6672-44b1-9b60-d40cb1d19377 tempest-VolumesDeleteCascade-134824525 None] Created reservations ['3f0c40a2-5ab3-4738-b18b-ac49d47be9c7', '22b8b8ad-f79b-4dcc-9a2c-6960c1a76d0d', '39a7b5ec-fa81-4e8c-85e8-f177badedfbf', 'd575f7b9-4d17-4fd2-acfa-f3870ae61958'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 15:58:17 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-578093c7-6672-44b1-9b60-d40cb1d19377 tempest-VolumesDeleteCascade-134824525 None] Delete snapshot completed successfully. Jul 10 15:58:17 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-578093c7-6672-44b1-9b60-d40cb1d19377 tempest-VolumesDeleteCascade-134824525 None] Lock "cinder-814ffd7c-628b-440c-b26f-644604e63db4-delete_snapshot" released by "delete_snapshot" :: held 3.793s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:58:17 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-578093c7-6672-44b1-9b60-d40cb1d19377 tempest-VolumesDeleteCascade-134824525 None] Acquiring lock "cinder-99ac9d41-bad0-4c13-b8a3-3cbee7752cd3-delete_snapshot" by "delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:58:17 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-578093c7-6672-44b1-9b60-d40cb1d19377 tempest-VolumesDeleteCascade-134824525 None] Lock "cinder-99ac9d41-bad0-4c13-b8a3-3cbee7752cd3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:58:17 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-578093c7-6672-44b1-9b60-d40cb1d19377 tempest-VolumesDeleteCascade-134824525 None] Acquiring lock "cinder-quobyte-efd54d1e-4fce-4679-ae10-7b11ef7c0073" by "delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:58:17 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-578093c7-6672-44b1-9b60-d40cb1d19377 tempest-VolumesDeleteCascade-134824525 None] Lock "cinder-quobyte-efd54d1e-4fce-4679-ae10-7b11ef7c0073" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:58:17 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-578093c7-6672-44b1-9b60-d40cb1d19377 tempest-VolumesDeleteCascade-134824525 None] Acquiring lock "cinder-quobyte-99ac9d41-bad0-4c13-b8a3-3cbee7752cd3" by "_delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:58:17 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-578093c7-6672-44b1-9b60-d40cb1d19377 tempest-VolumesDeleteCascade-134824525 None] Lock "cinder-quobyte-99ac9d41-bad0-4c13-b8a3-3cbee7752cd3" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:58:17 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-578093c7-6672-44b1-9b60-d40cb1d19377 tempest-VolumesDeleteCascade-134824525 None] Deleting offline snapshot 99ac9d41-bad0-4c13-b8a3-3cbee7752cd3 of volume efd54d1e-4fce-4679-ae10-7b11ef7c0073 {{(pid=87420) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 15:58:17 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-578093c7-6672-44b1-9b60-d40cb1d19377 tempest-VolumesDeleteCascade-134824525 None] snapshot_file for this snap is: volume-efd54d1e-4fce-4679-ae10-7b11ef7c0073.99ac9d41-bad0-4c13-b8a3-3cbee7752cd3 {{(pid=87420) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 15:58:17 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[91b3031f-d364-4e2e-9be4-2faacdb7b660]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:58:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-578093c7-6672-44b1-9b60-d40cb1d19377 tempest-VolumesDeleteCascade-134824525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-efd54d1e-4fce-4679-ae10-7b11ef7c0073.99ac9d41-bad0-4c13-b8a3-3cbee7752cd3 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:58:18 devstack sudo[97685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-efd54d1e-4fce-4679-ae10-7b11ef7c0073.99ac9d41-bad0-4c13-b8a3-3cbee7752cd3 Jul 10 15:58:18 devstack sudo[97685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:58:18 devstack sudo[97670]: pam_unix(sudo:session): session closed for user root Jul 10 15:58:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.949s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:58:18 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 15:58:18 devstack cinder-volume[87420]: DEBUG oslo_service.periodic_task [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Running periodic task VolumeManager._thread_info {{(pid=87420) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 15:58:18 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] thread count: 28 {{(pid=87420) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 15:58:18 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] thread info: [<_MainThread(MainThread, started 133639250378880)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87420) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 15:58:19 devstack sudo[97685]: pam_unix(sudo:session): session closed for user root Jul 10 15:58:19 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-578093c7-6672-44b1-9b60-d40cb1d19377 tempest-VolumesDeleteCascade-134824525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-efd54d1e-4fce-4679-ae10-7b11ef7c0073.99ac9d41-bad0-4c13-b8a3-3cbee7752cd3" returned: 0 in 1.185s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:58:19 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-578093c7-6672-44b1-9b60-d40cb1d19377 tempest-VolumesDeleteCascade-134824525 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-efd54d1e-4fce-4679-ae10-7b11ef7c0073(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87420) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 15:58:19 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[aab7b45c-8a2d-433a-8bb0-75a2704b1d47]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:58:19 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-578093c7-6672-44b1-9b60-d40cb1d19377 tempest-VolumesDeleteCascade-134824525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-efd54d1e-4fce-4679-ae10-7b11ef7c0073 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:58:19 devstack sudo[97665]: pam_unix(sudo:session): session closed for user root Jul 10 15:58:19 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-de8dc4ff-0600-415d-aeee-e453114d0ba3 tempest-VolumesGetTest-474292535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_980bf5e0-e973-48f3-bc1f-383f924c4467_xmsii_yzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-30d59b81-5f5c-4ffe-b1e0-01eaeb73e9dc" returned: 0 in 2.541s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:58:19 devstack cinder-volume[87420]: DEBUG cinder.image.image_utils [None req-de8dc4ff-0600-415d-aeee-e453114d0ba3 tempest-VolumesGetTest-474292535 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_980bf5e0-e973-48f3-bc1f-383f924c4467_xmsii_yzdevstack@QuobyteHD, size 112.00 MB, duration 2.54 sec, destination /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-30d59b81-5f5c-4ffe-b1e0-01eaeb73e9dc {{(pid=87420) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 15:58:19 devstack cinder-volume[87420]: INFO cinder.image.image_utils [None req-de8dc4ff-0600-415d-aeee-e453114d0ba3 tempest-VolumesGetTest-474292535 None] Converted 112.00 MB image at 44.03 MB/s Jul 10 15:58:19 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-de8dc4ff-0600-415d-aeee-e453114d0ba3 tempest-VolumesGetTest-474292535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-30d59b81-5f5c-4ffe-b1e0-01eaeb73e9dc 1G {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:58:19 devstack sudo[97691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-efd54d1e-4fce-4679-ae10-7b11ef7c0073 Jul 10 15:58:19 devstack sudo[97691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:58:19 devstack sudo[97692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-30d59b81-5f5c-4ffe-b1e0-01eaeb73e9dc 1G Jul 10 15:58:19 devstack sudo[97692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:58:20 devstack sudo[97691]: pam_unix(sudo:session): session closed for user root Jul 10 15:58:20 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-578093c7-6672-44b1-9b60-d40cb1d19377 tempest-VolumesDeleteCascade-134824525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-efd54d1e-4fce-4679-ae10-7b11ef7c0073" returned: 0 in 1.041s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:58:20 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-578093c7-6672-44b1-9b60-d40cb1d19377 tempest-VolumesDeleteCascade-134824525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-efd54d1e-4fce-4679-ae10-7b11ef7c0073.99ac9d41-bad0-4c13-b8a3-3cbee7752cd3 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:58:20 devstack sudo[97702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-efd54d1e-4fce-4679-ae10-7b11ef7c0073.99ac9d41-bad0-4c13-b8a3-3cbee7752cd3 Jul 10 15:58:20 devstack sudo[97702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:58:20 devstack sudo[97692]: pam_unix(sudo:session): session closed for user root Jul 10 15:58:20 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-de8dc4ff-0600-415d-aeee-e453114d0ba3 tempest-VolumesGetTest-474292535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-30d59b81-5f5c-4ffe-b1e0-01eaeb73e9dc 1G" returned: 0 in 0.953s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:58:20 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[90f16736-a43a-4ffa-9a01-faa2e51752b6]: (4, 'raw') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:58:20 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-de8dc4ff-0600-415d-aeee-e453114d0ba3 tempest-VolumesGetTest-474292535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-30d59b81-5f5c-4ffe-b1e0-01eaeb73e9dc {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:58:20 devstack sudo[97704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-30d59b81-5f5c-4ffe-b1e0-01eaeb73e9dc Jul 10 15:58:20 devstack sudo[97704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:58:21 devstack sudo[97702]: pam_unix(sudo:session): session closed for user root Jul 10 15:58:21 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-578093c7-6672-44b1-9b60-d40cb1d19377 tempest-VolumesDeleteCascade-134824525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-efd54d1e-4fce-4679-ae10-7b11ef7c0073.99ac9d41-bad0-4c13-b8a3-3cbee7752cd3" returned: 0 in 0.809s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:58:21 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-578093c7-6672-44b1-9b60-d40cb1d19377 tempest-VolumesDeleteCascade-134824525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-efd54d1e-4fce-4679-ae10-7b11ef7c0073.99ac9d41-bad0-4c13-b8a3-3cbee7752cd3 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:58:21 devstack sudo[97710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-efd54d1e-4fce-4679-ae10-7b11ef7c0073.99ac9d41-bad0-4c13-b8a3-3cbee7752cd3 Jul 10 15:58:21 devstack sudo[97710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:58:21 devstack sudo[97704]: pam_unix(sudo:session): session closed for user root Jul 10 15:58:21 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-de8dc4ff-0600-415d-aeee-e453114d0ba3 tempest-VolumesGetTest-474292535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-30d59b81-5f5c-4ffe-b1e0-01eaeb73e9dc" returned: 0 in 0.943s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:58:21 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-de8dc4ff-0600-415d-aeee-e453114d0ba3 tempest-VolumesGetTest-474292535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-30d59b81-5f5c-4ffe-b1e0-01eaeb73e9dc {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:58:21 devstack sudo[97714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-30d59b81-5f5c-4ffe-b1e0-01eaeb73e9dc Jul 10 15:58:21 devstack sudo[97714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:58:21 devstack sudo[97710]: pam_unix(sudo:session): session closed for user root Jul 10 15:58:21 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-578093c7-6672-44b1-9b60-d40cb1d19377 tempest-VolumesDeleteCascade-134824525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-efd54d1e-4fce-4679-ae10-7b11ef7c0073.99ac9d41-bad0-4c13-b8a3-3cbee7752cd3" returned: 0 in 0.692s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:58:21 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-578093c7-6672-44b1-9b60-d40cb1d19377 tempest-VolumesDeleteCascade-134824525 None] Lock "cinder-quobyte-99ac9d41-bad0-4c13-b8a3-3cbee7752cd3" released by "_delete_snapshot" :: held 3.895s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:58:21 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-578093c7-6672-44b1-9b60-d40cb1d19377 tempest-VolumesDeleteCascade-134824525 None] Lock "cinder-quobyte-efd54d1e-4fce-4679-ae10-7b11ef7c0073" released by "delete_snapshot" :: held 3.928s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:58:21 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-578093c7-6672-44b1-9b60-d40cb1d19377 tempest-VolumesDeleteCascade-134824525 None] Created reservations ['a83cd79d-1a56-4e57-8103-89904ce685bc', '76d741f0-c1d2-42d1-ae52-37f72f0447e1', 'ae41db77-7fd0-4d88-be9b-bebd57fba75e', 'b0525c55-9096-4c73-9f78-5e4585da90f1'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 15:58:21 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-578093c7-6672-44b1-9b60-d40cb1d19377 tempest-VolumesDeleteCascade-134824525 None] Delete snapshot completed successfully. Jul 10 15:58:21 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-578093c7-6672-44b1-9b60-d40cb1d19377 tempest-VolumesDeleteCascade-134824525 None] Lock "cinder-99ac9d41-bad0-4c13-b8a3-3cbee7752cd3-delete_snapshot" released by "delete_snapshot" :: held 4.121s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:58:21 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-578093c7-6672-44b1-9b60-d40cb1d19377 tempest-VolumesDeleteCascade-134824525 None] Snapshots deleted, issuing volume delete {{(pid=87420) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 10 15:58:21 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-578093c7-6672-44b1-9b60-d40cb1d19377 tempest-VolumesDeleteCascade-134824525 None] Acquiring lock "cinder-quobyte-efd54d1e-4fce-4679-ae10-7b11ef7c0073" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:58:21 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-578093c7-6672-44b1-9b60-d40cb1d19377 tempest-VolumesDeleteCascade-134824525 None] Lock "cinder-quobyte-efd54d1e-4fce-4679-ae10-7b11ef7c0073" acquired by "delete_volume" :: waited 0.016s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:58:21 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[017bf292-94f5-4897-a587-9a32eba9cde5]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:58:21 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-578093c7-6672-44b1-9b60-d40cb1d19377 tempest-VolumesDeleteCascade-134824525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-efd54d1e-4fce-4679-ae10-7b11ef7c0073 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:58:22 devstack sudo[97714]: pam_unix(sudo:session): session closed for user root Jul 10 15:58:22 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-de8dc4ff-0600-415d-aeee-e453114d0ba3 tempest-VolumesGetTest-474292535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-30d59b81-5f5c-4ffe-b1e0-01eaeb73e9dc" returned: 1 in 0.792s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:58:22 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-de8dc4ff-0600-415d-aeee-e453114d0ba3 tempest-VolumesGetTest-474292535 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-30d59b81-5f5c-4ffe-b1e0-01eaeb73e9dc' failed. Not Retrying. {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 15:58:22 devstack cinder-volume[87420]: DEBUG cinder.volume.volume_utils [None req-de8dc4ff-0600-415d-aeee-e453114d0ba3 tempest-VolumesGetTest-474292535 None] Downloaded image 980bf5e0-e973-48f3-bc1f-383f924c4467 ((None, [{'url': 'file:///opt/stack/data/glance/images/980bf5e0-e973-48f3-bc1f-383f924c4467', 'metadata': {}}])) to volume 30d59b81-5f5c-4ffe-b1e0-01eaeb73e9dc successfully. {{(pid=87420) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 10 15:58:22 devstack cinder-volume[87420]: DEBUG cinder.image.image_utils [None req-de8dc4ff-0600-415d-aeee-e453114d0ba3 tempest-VolumesGetTest-474292535 None] Temporary image 980bf5e0-e973-48f3-bc1f-383f924c4467 for user fd5c633b5ab34f4fa42d3bf6bcfa01a4 is deleted. {{(pid=87420) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 10 15:58:22 devstack cinder-volume[87420]: DEBUG cinder.volume.volume_utils [None req-de8dc4ff-0600-415d-aeee-e453114d0ba3 tempest-VolumesGetTest-474292535 None] Marking volume 30d59b81-5f5c-4ffe-b1e0-01eaeb73e9dc as bootable. {{(pid=87420) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 10 15:58:22 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-de8dc4ff-0600-415d-aeee-e453114d0ba3 tempest-VolumesGetTest-474292535 None] Copying metadata from image 980bf5e0-e973-48f3-bc1f-383f924c4467 to 30d59b81-5f5c-4ffe-b1e0-01eaeb73e9dc. {{(pid=87420) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 10 15:58:22 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-de8dc4ff-0600-415d-aeee-e453114d0ba3 tempest-VolumesGetTest-474292535 None] Creating volume glance metadata for volume 30d59b81-5f5c-4ffe-b1e0-01eaeb73e9dc backed by image 980bf5e0-e973-48f3-bc1f-383f924c4467 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '980bf5e0-e973-48f3-bc1f-383f924c4467', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87420) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 10 15:58:22 devstack sudo[97721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-efd54d1e-4fce-4679-ae10-7b11ef7c0073 Jul 10 15:58:22 devstack sudo[97721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:58:22 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-de8dc4ff-0600-415d-aeee-e453114d0ba3 tempest-VolumesGetTest-474292535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21559dba-8164-45c2-9b82-e58e49944ed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30d59b81-5f5c-4ffe-b1e0-01eaeb73e9dc', 'volume_size': 1, 'image_id': '980bf5e0-e973-48f3-bc1f-383f924c4467', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/980bf5e0-e973-48f3-bc1f-383f924c4467', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'de9cf234f3774db489ed55d5afcfc7bf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '980bf5e0-e973-48f3-bc1f-383f924c4467', 'created_at': datetime.datetime(2026, 7, 10, 13, 42, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 13, 42, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/980bf5e0-e973-48f3-bc1f-383f924c4467/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:58:22 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-de8dc4ff-0600-415d-aeee-e453114d0ba3 tempest-VolumesGetTest-474292535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4ccd1ff-49dc-414a-8e10-9c8869e59ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:58:22 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-de8dc4ff-0600-415d-aeee-e453114d0ba3 tempest-VolumesGetTest-474292535 None] Volume volume-30d59b81-5f5c-4ffe-b1e0-01eaeb73e9dc (30d59b81-5f5c-4ffe-b1e0-01eaeb73e9dc): created successfully Jul 10 15:58:22 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-de8dc4ff-0600-415d-aeee-e453114d0ba3 tempest-VolumesGetTest-474292535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4ccd1ff-49dc-414a-8e10-9c8869e59ae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:58:22 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-de8dc4ff-0600-415d-aeee-e453114d0ba3 tempest-VolumesGetTest-474292535 None] Flow 'volume_create_manager' (a30e49c6-d10f-4293-a7a5-b9816920f187) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:58:22 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-de8dc4ff-0600-415d-aeee-e453114d0ba3 tempest-VolumesGetTest-474292535 None] Created volume successfully. Jul 10 15:58:22 devstack sudo[97721]: pam_unix(sudo:session): session closed for user root Jul 10 15:58:22 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-578093c7-6672-44b1-9b60-d40cb1d19377 tempest-VolumesDeleteCascade-134824525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-efd54d1e-4fce-4679-ae10-7b11ef7c0073" returned: 0 in 0.798s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:58:22 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-578093c7-6672-44b1-9b60-d40cb1d19377 tempest-VolumesDeleteCascade-134824525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-efd54d1e-4fce-4679-ae10-7b11ef7c0073 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:58:22 devstack sudo[97726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-efd54d1e-4fce-4679-ae10-7b11ef7c0073 Jul 10 15:58:22 devstack sudo[97726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:58:23 devstack sudo[97726]: pam_unix(sudo:session): session closed for user root Jul 10 15:58:23 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-578093c7-6672-44b1-9b60-d40cb1d19377 tempest-VolumesDeleteCascade-134824525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-efd54d1e-4fce-4679-ae10-7b11ef7c0073" returned: 0 in 0.673s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:58:23 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-578093c7-6672-44b1-9b60-d40cb1d19377 tempest-VolumesDeleteCascade-134824525 None] Lock "cinder-quobyte-efd54d1e-4fce-4679-ae10-7b11ef7c0073" released by "delete_volume" :: held 1.551s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:58:23 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-578093c7-6672-44b1-9b60-d40cb1d19377 tempest-VolumesDeleteCascade-134824525 None] Created reservations ['e34ac0d1-8b9c-4fa4-89f1-d731cbc94c50', '11f88af7-154b-4d2b-977a-657dcc1904b9', '11f2dbac-113b-4992-83bb-419c84566ad7', 'c8074525-6528-4c20-aacd-c5acb67e9c5f'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 15:58:23 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-578093c7-6672-44b1-9b60-d40cb1d19377 tempest-VolumesDeleteCascade-134824525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:58:23 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-578093c7-6672-44b1-9b60-d40cb1d19377 tempest-VolumesDeleteCascade-134824525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:58:23 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-578093c7-6672-44b1-9b60-d40cb1d19377 tempest-VolumesDeleteCascade-134824525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:58:23 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-578093c7-6672-44b1-9b60-d40cb1d19377 tempest-VolumesDeleteCascade-134824525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:58:23 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-578093c7-6672-44b1-9b60-d40cb1d19377 tempest-VolumesDeleteCascade-134824525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:58:23 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-578093c7-6672-44b1-9b60-d40cb1d19377 tempest-VolumesDeleteCascade-134824525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:58:23 devstack sudo[97730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 15:58:23 devstack sudo[97730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:58:23 devstack cinder-volume[87420]: DEBUG dbcounter [-] [87420] Writing DB stats cinder:UPDATE=102,cinder:SELECT=90,cinder:INSERT=33,cinder:DELETE=8 {{(pid=87420) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 15:58:23 devstack cinder-volume[87420]: DEBUG dbcounter [-] [87420] Writing DB stats cinder:SELECT=84,cinder:INSERT=32,cinder:UPDATE=106,cinder:DELETE=9 {{(pid=87420) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 15:58:23 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf8ed64d-87ea-4b36-8a5b-8de9eff74dc8 tempest-VolumesGetTest-474292535 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 15:58:23 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-bf8ed64d-87ea-4b36-8a5b-8de9eff74dc8 tempest-VolumesGetTest-474292535 None] Flow 'volume_create_manager' (d4e36c51-de7a-4b95-8a6e-71d05c418d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:58:23 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-bf8ed64d-87ea-4b36-8a5b-8de9eff74dc8 tempest-VolumesGetTest-474292535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3d45969-140f-4e75-a534-a6a9126cf844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:58:23 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-bf8ed64d-87ea-4b36-8a5b-8de9eff74dc8 tempest-VolumesGetTest-474292535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3d45969-140f-4e75-a534-a6a9126cf844) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:58:24Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1588345789',display_name='tempest-VolumesGetTest-Volume-2082121838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1c114f5-9b6e-4786-9762-de4f32299f53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e1e4affd8f342e2a93b8606ed90299a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:58:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:58:24Z,use_quota=True,user_id='fd5c633b5ab34f4fa42d3bf6bcfa01a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:58:23 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-bf8ed64d-87ea-4b36-8a5b-8de9eff74dc8 tempest-VolumesGetTest-474292535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f4ee163-ff37-4b71-b3d8-bcd43a59dfa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:58:23 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-bf8ed64d-87ea-4b36-8a5b-8de9eff74dc8 tempest-VolumesGetTest-474292535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f4ee163-ff37-4b71-b3d8-bcd43a59dfa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:58:23 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-bf8ed64d-87ea-4b36-8a5b-8de9eff74dc8 tempest-VolumesGetTest-474292535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f99dbde-1de4-4bf4-b9eb-fcf53beae6c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:58:23 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-bf8ed64d-87ea-4b36-8a5b-8de9eff74dc8 tempest-VolumesGetTest-474292535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f99dbde-1de4-4bf4-b9eb-fcf53beae6c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1c114f5-9b6e-4786-9762-de4f32299f53', 'volume_name': 'volume-b1c114f5-9b6e-4786-9762-de4f32299f53', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:58:23 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-bf8ed64d-87ea-4b36-8a5b-8de9eff74dc8 tempest-VolumesGetTest-474292535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9446b29-8224-4457-b896-ab3cf1322dcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:58:23 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-bf8ed64d-87ea-4b36-8a5b-8de9eff74dc8 tempest-VolumesGetTest-474292535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9446b29-8224-4457-b896-ab3cf1322dcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:58:24 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-bf8ed64d-87ea-4b36-8a5b-8de9eff74dc8 tempest-VolumesGetTest-474292535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (375893d0-a606-4e96-b08a-e3330d98a274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:58:24 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-bf8ed64d-87ea-4b36-8a5b-8de9eff74dc8 tempest-VolumesGetTest-474292535 None] Volume b1c114f5-9b6e-4786-9762-de4f32299f53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1c114f5-9b6e-4786-9762-de4f32299f53', 'volume_size': 1} Jul 10 15:58:24 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-bf8ed64d-87ea-4b36-8a5b-8de9eff74dc8 tempest-VolumesGetTest-474292535 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:58:24 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-bf8ed64d-87ea-4b36-8a5b-8de9eff74dc8 tempest-VolumesGetTest-474292535 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:58:24 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-bf8ed64d-87ea-4b36-8a5b-8de9eff74dc8 tempest-VolumesGetTest-474292535 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:58:24Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1588345789',display_name='tempest-VolumesGetTest-Volume-2082121838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1c114f5-9b6e-4786-9762-de4f32299f53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e1e4affd8f342e2a93b8606ed90299a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:58:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:58:24Z,use_quota=True,user_id='fd5c633b5ab34f4fa42d3bf6bcfa01a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 15:58:24 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-bf8ed64d-87ea-4b36-8a5b-8de9eff74dc8 tempest-VolumesGetTest-474292535 None] Creating volume b1c114f5-9b6e-4786-9762-de4f32299f53 {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 15:58:24 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-bf8ed64d-87ea-4b36-8a5b-8de9eff74dc8 tempest-VolumesGetTest-474292535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:58:24 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-bf8ed64d-87ea-4b36-8a5b-8de9eff74dc8 tempest-VolumesGetTest-474292535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:58:24 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-bf8ed64d-87ea-4b36-8a5b-8de9eff74dc8 tempest-VolumesGetTest-474292535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:58:24 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-bf8ed64d-87ea-4b36-8a5b-8de9eff74dc8 tempest-VolumesGetTest-474292535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:58:24 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-bf8ed64d-87ea-4b36-8a5b-8de9eff74dc8 tempest-VolumesGetTest-474292535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:58:24 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-bf8ed64d-87ea-4b36-8a5b-8de9eff74dc8 tempest-VolumesGetTest-474292535 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 15:58:24 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-bf8ed64d-87ea-4b36-8a5b-8de9eff74dc8 tempest-VolumesGetTest-474292535 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 15:58:24 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-bf8ed64d-87ea-4b36-8a5b-8de9eff74dc8 tempest-VolumesGetTest-474292535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b1c114f5-9b6e-4786-9762-de4f32299f53 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:58:24 devstack sudo[97732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b1c114f5-9b6e-4786-9762-de4f32299f53 1073741824 Jul 10 15:58:24 devstack sudo[97732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:58:24 devstack sudo[97730]: pam_unix(sudo:session): session closed for user root Jul 10 15:58:24 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-578093c7-6672-44b1-9b60-d40cb1d19377 tempest-VolumesDeleteCascade-134824525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.898s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:58:24 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-578093c7-6672-44b1-9b60-d40cb1d19377 tempest-VolumesDeleteCascade-134824525 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 15:58:24 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-578093c7-6672-44b1-9b60-d40cb1d19377 tempest-VolumesDeleteCascade-134824525 None] Deleted volume successfully. Jul 10 15:58:24 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bda9942-b8ca-4b21-9ed0-2d04db9edd35 tempest-VolumesDeleteCascade-134824525 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 15:58:24 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-7bda9942-b8ca-4b21-9ed0-2d04db9edd35 tempest-VolumesDeleteCascade-134824525 None] Flow 'volume_create_manager' (314564c4-cf76-421d-b32f-7f037655ab24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:58:24 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-7bda9942-b8ca-4b21-9ed0-2d04db9edd35 tempest-VolumesDeleteCascade-134824525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d5b6802-8149-48d0-8d59-897c19e5c6ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:58:24 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-7bda9942-b8ca-4b21-9ed0-2d04db9edd35 tempest-VolumesDeleteCascade-134824525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d5b6802-8149-48d0-8d59-897c19e5c6ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:58:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1099352338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af6dbbc9-3b53-41b0-9f86-fababba7d826,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29986c0842554f22bdd95ba498ecf9ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:58:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:58:24Z,use_quota=True,user_id='df41e4e5b745419bad59c111b6510027',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:58:24 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-7bda9942-b8ca-4b21-9ed0-2d04db9edd35 tempest-VolumesDeleteCascade-134824525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcf7450a-5dd0-46f5-a8ef-4017ae4afb78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:58:24 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-7bda9942-b8ca-4b21-9ed0-2d04db9edd35 tempest-VolumesDeleteCascade-134824525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcf7450a-5dd0-46f5-a8ef-4017ae4afb78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:58:24 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-7bda9942-b8ca-4b21-9ed0-2d04db9edd35 tempest-VolumesDeleteCascade-134824525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afd56931-99fc-4776-b4c4-fb53c7c8e52d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:58:24 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-7bda9942-b8ca-4b21-9ed0-2d04db9edd35 tempest-VolumesDeleteCascade-134824525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afd56931-99fc-4776-b4c4-fb53c7c8e52d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af6dbbc9-3b53-41b0-9f86-fababba7d826', 'volume_name': 'volume-af6dbbc9-3b53-41b0-9f86-fababba7d826', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:58:24 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-7bda9942-b8ca-4b21-9ed0-2d04db9edd35 tempest-VolumesDeleteCascade-134824525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb1e3cc9-2769-4de0-a7cf-680642cd4985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:58:24 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-7bda9942-b8ca-4b21-9ed0-2d04db9edd35 tempest-VolumesDeleteCascade-134824525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb1e3cc9-2769-4de0-a7cf-680642cd4985) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:58:24 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-7bda9942-b8ca-4b21-9ed0-2d04db9edd35 tempest-VolumesDeleteCascade-134824525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae5b86a9-39e5-44eb-af55-d898decad796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:58:24 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-7bda9942-b8ca-4b21-9ed0-2d04db9edd35 tempest-VolumesDeleteCascade-134824525 None] Volume af6dbbc9-3b53-41b0-9f86-fababba7d826: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af6dbbc9-3b53-41b0-9f86-fababba7d826', 'volume_size': 1} Jul 10 15:58:24 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-7bda9942-b8ca-4b21-9ed0-2d04db9edd35 tempest-VolumesDeleteCascade-134824525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:58:24 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-578093c7-6672-44b1-9b60-d40cb1d19377 tempest-VolumesDeleteCascade-134824525 None] Lock "cinder-efd54d1e-4fce-4679-ae10-7b11ef7c0073-delete_volume" released by "delete_volume" :: held 10.839s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:58:24 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-57360ece-a4e5-4cfc-9868-ea306b60831e tempest-VolumeTypesAccessTest-1363105987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 15:58:24 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-57360ece-a4e5-4cfc-9868-ea306b60831e tempest-VolumeTypesAccessTest-1363105987 None] Flow 'volume_create_manager' (a74402de-f1d4-424c-8d85-5d98ac0a142e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:58:24 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-57360ece-a4e5-4cfc-9868-ea306b60831e tempest-VolumeTypesAccessTest-1363105987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d36726c9-60a3-4c64-a4e4-f2e851555724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:58:24 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-57360ece-a4e5-4cfc-9868-ea306b60831e tempest-VolumeTypesAccessTest-1363105987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d36726c9-60a3-4c64-a4e4-f2e851555724) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:58:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-975827325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=536c96ca-ce5a-414c-b8bd-e532fd396fdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61b6ce7703b84a4daf16730d1c1ea634',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:58:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:58:25Z,use_quota=True,user_id='aa28c8e14eca4142b24728c4153e28aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(872c6ebe-370c-42cf-82b7-70934a61f2e4),volume_type_id=872c6ebe-370c-42cf-82b7-70934a61f2e4)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:58:24 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-57360ece-a4e5-4cfc-9868-ea306b60831e tempest-VolumeTypesAccessTest-1363105987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cb7ac66-0834-4112-b508-9f9da22c1940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:58:24 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-57360ece-a4e5-4cfc-9868-ea306b60831e tempest-VolumeTypesAccessTest-1363105987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cb7ac66-0834-4112-b508-9f9da22c1940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:58:24 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-57360ece-a4e5-4cfc-9868-ea306b60831e tempest-VolumeTypesAccessTest-1363105987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b809c382-4272-4b73-9263-52bdec1c90d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:58:24 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-57360ece-a4e5-4cfc-9868-ea306b60831e tempest-VolumeTypesAccessTest-1363105987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b809c382-4272-4b73-9263-52bdec1c90d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '536c96ca-ce5a-414c-b8bd-e532fd396fdd', 'volume_name': 'volume-536c96ca-ce5a-414c-b8bd-e532fd396fdd', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:58:24 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-57360ece-a4e5-4cfc-9868-ea306b60831e tempest-VolumeTypesAccessTest-1363105987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a7dc6d7-f855-4a18-b0a4-1367e8375e9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:58:24 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-57360ece-a4e5-4cfc-9868-ea306b60831e tempest-VolumeTypesAccessTest-1363105987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a7dc6d7-f855-4a18-b0a4-1367e8375e9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:58:24 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-57360ece-a4e5-4cfc-9868-ea306b60831e tempest-VolumeTypesAccessTest-1363105987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30ccf84a-912a-42a7-ba8b-dfaaeecd9b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:58:24 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-57360ece-a4e5-4cfc-9868-ea306b60831e tempest-VolumeTypesAccessTest-1363105987 None] Volume 536c96ca-ce5a-414c-b8bd-e532fd396fdd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-536c96ca-ce5a-414c-b8bd-e532fd396fdd', 'volume_size': 1} Jul 10 15:58:24 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-57360ece-a4e5-4cfc-9868-ea306b60831e tempest-VolumeTypesAccessTest-1363105987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:58:25 devstack sudo[97732]: pam_unix(sudo:session): session closed for user root Jul 10 15:58:25 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-bf8ed64d-87ea-4b36-8a5b-8de9eff74dc8 tempest-VolumesGetTest-474292535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b1c114f5-9b6e-4786-9762-de4f32299f53 1073741824" returned: 0 in 1.078s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:58:25 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-bf8ed64d-87ea-4b36-8a5b-8de9eff74dc8 tempest-VolumesGetTest-474292535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b1c114f5-9b6e-4786-9762-de4f32299f53 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:58:25 devstack sudo[97749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b1c114f5-9b6e-4786-9762-de4f32299f53 Jul 10 15:58:25 devstack sudo[97749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:58:25 devstack sudo[97749]: pam_unix(sudo:session): session closed for user root Jul 10 15:58:25 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-bf8ed64d-87ea-4b36-8a5b-8de9eff74dc8 tempest-VolumesGetTest-474292535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b1c114f5-9b6e-4786-9762-de4f32299f53" returned: 0 in 0.651s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:58:25 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-bf8ed64d-87ea-4b36-8a5b-8de9eff74dc8 tempest-VolumesGetTest-474292535 None] <== create_volume: return (1769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 15:58:25 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-bf8ed64d-87ea-4b36-8a5b-8de9eff74dc8 tempest-VolumesGetTest-474292535 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.771s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:58:25 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-7bda9942-b8ca-4b21-9ed0-2d04db9edd35 tempest-VolumesDeleteCascade-134824525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.079s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:58:25 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-7bda9942-b8ca-4b21-9ed0-2d04db9edd35 tempest-VolumesDeleteCascade-134824525 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:58:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1099352338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af6dbbc9-3b53-41b0-9f86-fababba7d826,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29986c0842554f22bdd95ba498ecf9ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:58:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:58:24Z,use_quota=True,user_id='df41e4e5b745419bad59c111b6510027',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 15:58:25 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-7bda9942-b8ca-4b21-9ed0-2d04db9edd35 tempest-VolumesDeleteCascade-134824525 None] Creating volume af6dbbc9-3b53-41b0-9f86-fababba7d826 {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 15:58:25 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-7bda9942-b8ca-4b21-9ed0-2d04db9edd35 tempest-VolumesDeleteCascade-134824525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:58:25 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-7bda9942-b8ca-4b21-9ed0-2d04db9edd35 tempest-VolumesDeleteCascade-134824525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:58:25 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-7bda9942-b8ca-4b21-9ed0-2d04db9edd35 tempest-VolumesDeleteCascade-134824525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:58:25 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-7bda9942-b8ca-4b21-9ed0-2d04db9edd35 tempest-VolumesDeleteCascade-134824525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:58:25 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-7bda9942-b8ca-4b21-9ed0-2d04db9edd35 tempest-VolumesDeleteCascade-134824525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:58:25 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-7bda9942-b8ca-4b21-9ed0-2d04db9edd35 tempest-VolumesDeleteCascade-134824525 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 15:58:25 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-7bda9942-b8ca-4b21-9ed0-2d04db9edd35 tempest-VolumesDeleteCascade-134824525 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 15:58:25 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-7bda9942-b8ca-4b21-9ed0-2d04db9edd35 tempest-VolumesDeleteCascade-134824525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-af6dbbc9-3b53-41b0-9f86-fababba7d826 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:58:25 devstack sudo[97752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-af6dbbc9-3b53-41b0-9f86-fababba7d826 1073741824 Jul 10 15:58:25 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-bf8ed64d-87ea-4b36-8a5b-8de9eff74dc8 tempest-VolumesGetTest-474292535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (375893d0-a606-4e96-b08a-e3330d98a274) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1c114f5-9b6e-4786-9762-de4f32299f53', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:58:25 devstack sudo[97752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:58:25 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-bf8ed64d-87ea-4b36-8a5b-8de9eff74dc8 tempest-VolumesGetTest-474292535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55ac1ed8-2035-4ba9-b2ab-3f7ac7e3227a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:58:25 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-bf8ed64d-87ea-4b36-8a5b-8de9eff74dc8 tempest-VolumesGetTest-474292535 None] Volume volume-b1c114f5-9b6e-4786-9762-de4f32299f53 (b1c114f5-9b6e-4786-9762-de4f32299f53): created successfully Jul 10 15:58:25 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-bf8ed64d-87ea-4b36-8a5b-8de9eff74dc8 tempest-VolumesGetTest-474292535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55ac1ed8-2035-4ba9-b2ab-3f7ac7e3227a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:58:25 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-bf8ed64d-87ea-4b36-8a5b-8de9eff74dc8 tempest-VolumesGetTest-474292535 None] Flow 'volume_create_manager' (d4e36c51-de7a-4b95-8a6e-71d05c418d63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:58:25 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-bf8ed64d-87ea-4b36-8a5b-8de9eff74dc8 tempest-VolumesGetTest-474292535 None] Created volume successfully. Jul 10 15:58:26 devstack sudo[97752]: pam_unix(sudo:session): session closed for user root Jul 10 15:58:26 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-7bda9942-b8ca-4b21-9ed0-2d04db9edd35 tempest-VolumesDeleteCascade-134824525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-af6dbbc9-3b53-41b0-9f86-fababba7d826 1073741824" returned: 0 in 0.864s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:58:26 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-7bda9942-b8ca-4b21-9ed0-2d04db9edd35 tempest-VolumesDeleteCascade-134824525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-af6dbbc9-3b53-41b0-9f86-fababba7d826 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:58:26 devstack sudo[97758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-af6dbbc9-3b53-41b0-9f86-fababba7d826 Jul 10 15:58:26 devstack sudo[97758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:58:27 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-cb612feb-a0be-4832-a297-268afa7b7784 tempest-VolumesGetTest-474292535 None] Acquiring lock "cinder-b1c114f5-9b6e-4786-9762-de4f32299f53-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:58:27 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-cb612feb-a0be-4832-a297-268afa7b7784 tempest-VolumesGetTest-474292535 None] Lock "cinder-b1c114f5-9b6e-4786-9762-de4f32299f53-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:58:27 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-cb612feb-a0be-4832-a297-268afa7b7784 tempest-VolumesGetTest-474292535 None] Acquiring lock "cinder-quobyte-b1c114f5-9b6e-4786-9762-de4f32299f53" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:58:27 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-cb612feb-a0be-4832-a297-268afa7b7784 tempest-VolumesGetTest-474292535 None] Lock "cinder-quobyte-b1c114f5-9b6e-4786-9762-de4f32299f53" acquired by "delete_volume" :: waited 0.020s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:58:27 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3514aa2-0088-4541-b4a3-970c38ae3aa9]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:58:27 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-cb612feb-a0be-4832-a297-268afa7b7784 tempest-VolumesGetTest-474292535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b1c114f5-9b6e-4786-9762-de4f32299f53 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:58:27 devstack sudo[97760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b1c114f5-9b6e-4786-9762-de4f32299f53 Jul 10 15:58:27 devstack sudo[97760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:58:27 devstack sudo[97758]: pam_unix(sudo:session): session closed for user root Jul 10 15:58:27 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-7bda9942-b8ca-4b21-9ed0-2d04db9edd35 tempest-VolumesDeleteCascade-134824525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-af6dbbc9-3b53-41b0-9f86-fababba7d826" returned: 0 in 0.718s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:58:27 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-7bda9942-b8ca-4b21-9ed0-2d04db9edd35 tempest-VolumesDeleteCascade-134824525 None] <== create_volume: return (1625ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 15:58:27 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-7bda9942-b8ca-4b21-9ed0-2d04db9edd35 tempest-VolumesDeleteCascade-134824525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.627s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:58:27 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-57360ece-a4e5-4cfc-9868-ea306b60831e tempest-VolumeTypesAccessTest-1363105987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.427s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:58:27 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-57360ece-a4e5-4cfc-9868-ea306b60831e tempest-VolumeTypesAccessTest-1363105987 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:58:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-975827325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=536c96ca-ce5a-414c-b8bd-e532fd396fdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61b6ce7703b84a4daf16730d1c1ea634',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:58:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:58:25Z,use_quota=True,user_id='aa28c8e14eca4142b24728c4153e28aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(872c6ebe-370c-42cf-82b7-70934a61f2e4),volume_type_id=872c6ebe-370c-42cf-82b7-70934a61f2e4)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 15:58:27 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-57360ece-a4e5-4cfc-9868-ea306b60831e tempest-VolumeTypesAccessTest-1363105987 None] Creating volume 536c96ca-ce5a-414c-b8bd-e532fd396fdd {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 15:58:27 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-57360ece-a4e5-4cfc-9868-ea306b60831e tempest-VolumeTypesAccessTest-1363105987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:58:27 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-57360ece-a4e5-4cfc-9868-ea306b60831e tempest-VolumeTypesAccessTest-1363105987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:58:27 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-57360ece-a4e5-4cfc-9868-ea306b60831e tempest-VolumeTypesAccessTest-1363105987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:58:27 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-57360ece-a4e5-4cfc-9868-ea306b60831e tempest-VolumeTypesAccessTest-1363105987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:58:27 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-57360ece-a4e5-4cfc-9868-ea306b60831e tempest-VolumeTypesAccessTest-1363105987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:58:27 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-57360ece-a4e5-4cfc-9868-ea306b60831e tempest-VolumeTypesAccessTest-1363105987 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 15:58:27 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-57360ece-a4e5-4cfc-9868-ea306b60831e tempest-VolumeTypesAccessTest-1363105987 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 15:58:27 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-57360ece-a4e5-4cfc-9868-ea306b60831e tempest-VolumeTypesAccessTest-1363105987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-536c96ca-ce5a-414c-b8bd-e532fd396fdd 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:58:27 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-7bda9942-b8ca-4b21-9ed0-2d04db9edd35 tempest-VolumesDeleteCascade-134824525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae5b86a9-39e5-44eb-af55-d898decad796) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af6dbbc9-3b53-41b0-9f86-fababba7d826', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:58:27 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-7bda9942-b8ca-4b21-9ed0-2d04db9edd35 tempest-VolumesDeleteCascade-134824525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e2669e0-f1ba-47a0-a2d3-c5c1d7715cbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:58:27 devstack sudo[97763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-536c96ca-ce5a-414c-b8bd-e532fd396fdd 1073741824 Jul 10 15:58:27 devstack sudo[97763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:58:27 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-7bda9942-b8ca-4b21-9ed0-2d04db9edd35 tempest-VolumesDeleteCascade-134824525 None] Volume volume-af6dbbc9-3b53-41b0-9f86-fababba7d826 (af6dbbc9-3b53-41b0-9f86-fababba7d826): created successfully Jul 10 15:58:27 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-7bda9942-b8ca-4b21-9ed0-2d04db9edd35 tempest-VolumesDeleteCascade-134824525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e2669e0-f1ba-47a0-a2d3-c5c1d7715cbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:58:27 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-7bda9942-b8ca-4b21-9ed0-2d04db9edd35 tempest-VolumesDeleteCascade-134824525 None] Flow 'volume_create_manager' (314564c4-cf76-421d-b32f-7f037655ab24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:58:27 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-7bda9942-b8ca-4b21-9ed0-2d04db9edd35 tempest-VolumesDeleteCascade-134824525 None] Created volume successfully. Jul 10 15:58:27 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-8a11ca23-1af2-4cd6-a165-410b58e61a0d tempest-VolumesDeleteCascade-134824525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:58:28 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [req-16dbeb2a-35c6-4981-bda2-e56df2dbc3dc req-d8850a86-6b8c-4cfc-81f7-96f6ae55b5cd tempest-TestStampPattern-1127543775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:58:28 devstack sudo[97760]: pam_unix(sudo:session): session closed for user root Jul 10 15:58:28 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-cb612feb-a0be-4832-a297-268afa7b7784 tempest-VolumesGetTest-474292535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b1c114f5-9b6e-4786-9762-de4f32299f53" returned: 0 in 0.903s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:58:28 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-cb612feb-a0be-4832-a297-268afa7b7784 tempest-VolumesGetTest-474292535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b1c114f5-9b6e-4786-9762-de4f32299f53 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:58:28 devstack sudo[97780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b1c114f5-9b6e-4786-9762-de4f32299f53 Jul 10 15:58:28 devstack sudo[97780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:58:28 devstack sudo[97763]: pam_unix(sudo:session): session closed for user root Jul 10 15:58:28 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-57360ece-a4e5-4cfc-9868-ea306b60831e tempest-VolumeTypesAccessTest-1363105987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-536c96ca-ce5a-414c-b8bd-e532fd396fdd 1073741824" returned: 0 in 1.046s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:58:28 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-57360ece-a4e5-4cfc-9868-ea306b60831e tempest-VolumeTypesAccessTest-1363105987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-536c96ca-ce5a-414c-b8bd-e532fd396fdd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:58:28 devstack sudo[97783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-536c96ca-ce5a-414c-b8bd-e532fd396fdd Jul 10 15:58:28 devstack sudo[97783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:58:28 devstack sudo[97780]: pam_unix(sudo:session): session closed for user root Jul 10 15:58:28 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-cb612feb-a0be-4832-a297-268afa7b7784 tempest-VolumesGetTest-474292535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b1c114f5-9b6e-4786-9762-de4f32299f53" returned: 0 in 0.668s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:58:28 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-cb612feb-a0be-4832-a297-268afa7b7784 tempest-VolumesGetTest-474292535 None] Lock "cinder-quobyte-b1c114f5-9b6e-4786-9762-de4f32299f53" released by "delete_volume" :: held 1.622s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:58:28 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-cb612feb-a0be-4832-a297-268afa7b7784 tempest-VolumesGetTest-474292535 None] Created reservations ['fc896727-35e6-46c3-a53f-0f0c4f3cbd35', '75501857-d87c-4044-9760-6ae6aa0cc771', 'f561e13f-aeb1-4779-bfaa-3c3068334505', '05044b15-6c62-400f-902e-feaa28195a75'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 15:58:28 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-cb612feb-a0be-4832-a297-268afa7b7784 tempest-VolumesGetTest-474292535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:58:28 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-cb612feb-a0be-4832-a297-268afa7b7784 tempest-VolumesGetTest-474292535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:58:28 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-cb612feb-a0be-4832-a297-268afa7b7784 tempest-VolumesGetTest-474292535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:58:28 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-cb612feb-a0be-4832-a297-268afa7b7784 tempest-VolumesGetTest-474292535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:58:28 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-cb612feb-a0be-4832-a297-268afa7b7784 tempest-VolumesGetTest-474292535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:58:28 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-cb612feb-a0be-4832-a297-268afa7b7784 tempest-VolumesGetTest-474292535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:58:29 devstack sudo[97786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 15:58:29 devstack sudo[97786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:58:29 devstack sudo[97783]: pam_unix(sudo:session): session closed for user root Jul 10 15:58:29 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-57360ece-a4e5-4cfc-9868-ea306b60831e tempest-VolumeTypesAccessTest-1363105987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-536c96ca-ce5a-414c-b8bd-e532fd396fdd" returned: 0 in 0.666s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:58:29 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-57360ece-a4e5-4cfc-9868-ea306b60831e tempest-VolumeTypesAccessTest-1363105987 None] <== create_volume: return (1753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 15:58:29 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-57360ece-a4e5-4cfc-9868-ea306b60831e tempest-VolumeTypesAccessTest-1363105987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.757s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:58:29 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-8a11ca23-1af2-4cd6-a165-410b58e61a0d tempest-VolumesDeleteCascade-134824525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.195s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:58:29 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-8a11ca23-1af2-4cd6-a165-410b58e61a0d tempest-VolumesDeleteCascade-134824525 None] Creating offline snapshot 810d52ac-718e-428d-834b-4da3417f6fd6 of volume af6dbbc9-3b53-41b0-9f86-fababba7d826 {{(pid=87420) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 15:58:29 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-57360ece-a4e5-4cfc-9868-ea306b60831e tempest-VolumeTypesAccessTest-1363105987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30ccf84a-912a-42a7-ba8b-dfaaeecd9b95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-536c96ca-ce5a-414c-b8bd-e532fd396fdd', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:58:29 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-57360ece-a4e5-4cfc-9868-ea306b60831e tempest-VolumeTypesAccessTest-1363105987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b04bdc2-d96e-44c0-92d0-ab446854db3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:58:29 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[60159159-5ac4-4f4c-be2e-827fef4c5917]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:58:29 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8a11ca23-1af2-4cd6-a165-410b58e61a0d tempest-VolumesDeleteCascade-134824525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-af6dbbc9-3b53-41b0-9f86-fababba7d826 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:58:29 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-57360ece-a4e5-4cfc-9868-ea306b60831e tempest-VolumeTypesAccessTest-1363105987 None] Volume volume-536c96ca-ce5a-414c-b8bd-e532fd396fdd (536c96ca-ce5a-414c-b8bd-e532fd396fdd): created successfully Jul 10 15:58:29 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-57360ece-a4e5-4cfc-9868-ea306b60831e tempest-VolumeTypesAccessTest-1363105987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b04bdc2-d96e-44c0-92d0-ab446854db3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:58:29 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-57360ece-a4e5-4cfc-9868-ea306b60831e tempest-VolumeTypesAccessTest-1363105987 None] Flow 'volume_create_manager' (a74402de-f1d4-424c-8d85-5d98ac0a142e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:58:29 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-57360ece-a4e5-4cfc-9868-ea306b60831e tempest-VolumeTypesAccessTest-1363105987 None] Created volume successfully. Jul 10 15:58:29 devstack sudo[97789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-af6dbbc9-3b53-41b0-9f86-fababba7d826 Jul 10 15:58:29 devstack sudo[97789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:58:29 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-0676860d-c3ac-4adb-9048-504918f18e59 tempest-VolumesGetTest-474292535 None] Acquiring lock "cinder-30d59b81-5f5c-4ffe-b1e0-01eaeb73e9dc-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:58:29 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-0676860d-c3ac-4adb-9048-504918f18e59 tempest-VolumesGetTest-474292535 None] Lock "cinder-30d59b81-5f5c-4ffe-b1e0-01eaeb73e9dc-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:58:29 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-0676860d-c3ac-4adb-9048-504918f18e59 tempest-VolumesGetTest-474292535 None] Acquiring lock "cinder-quobyte-30d59b81-5f5c-4ffe-b1e0-01eaeb73e9dc" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:58:29 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-0676860d-c3ac-4adb-9048-504918f18e59 tempest-VolumesGetTest-474292535 None] Lock "cinder-quobyte-30d59b81-5f5c-4ffe-b1e0-01eaeb73e9dc" acquired by "delete_volume" :: waited 0.023s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:58:29 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[7df60c1f-4f7d-4398-aced-c4f59e35a068]: (4, 'raw') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:58:29 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-0676860d-c3ac-4adb-9048-504918f18e59 tempest-VolumesGetTest-474292535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-30d59b81-5f5c-4ffe-b1e0-01eaeb73e9dc {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:58:29 devstack sudo[97791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-30d59b81-5f5c-4ffe-b1e0-01eaeb73e9dc Jul 10 15:58:29 devstack sudo[97791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:58:29 devstack sudo[97786]: pam_unix(sudo:session): session closed for user root Jul 10 15:58:29 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-cb612feb-a0be-4832-a297-268afa7b7784 tempest-VolumesGetTest-474292535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.753s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:58:29 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-cb612feb-a0be-4832-a297-268afa7b7784 tempest-VolumesGetTest-474292535 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 15:58:29 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-cb612feb-a0be-4832-a297-268afa7b7784 tempest-VolumesGetTest-474292535 None] Deleted volume successfully. Jul 10 15:58:29 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-cb612feb-a0be-4832-a297-268afa7b7784 tempest-VolumesGetTest-474292535 None] Lock "cinder-b1c114f5-9b6e-4786-9762-de4f32299f53-delete_volume" released by "delete_volume" :: held 2.612s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:58:30 devstack sudo[97789]: pam_unix(sudo:session): session closed for user root Jul 10 15:58:30 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8a11ca23-1af2-4cd6-a165-410b58e61a0d tempest-VolumesDeleteCascade-134824525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-af6dbbc9-3b53-41b0-9f86-fababba7d826" returned: 0 in 0.833s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:58:30 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8a11ca23-1af2-4cd6-a165-410b58e61a0d tempest-VolumesDeleteCascade-134824525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-af6dbbc9-3b53-41b0-9f86-fababba7d826,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-af6dbbc9-3b53-41b0-9f86-fababba7d826.810d52ac-718e-428d-834b-4da3417f6fd6 1G {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:58:30 devstack sudo[97797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-af6dbbc9-3b53-41b0-9f86-fababba7d826,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-af6dbbc9-3b53-41b0-9f86-fababba7d826.810d52ac-718e-428d-834b-4da3417f6fd6 1G Jul 10 15:58:30 devstack sudo[97797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:58:30 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-e01c0292-3384-4082-a09d-432b65d7a4c4 tempest-VolumeTypesAccessTest-1363105987 None] Acquiring lock "cinder-536c96ca-ce5a-414c-b8bd-e532fd396fdd-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:58:30 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-e01c0292-3384-4082-a09d-432b65d7a4c4 tempest-VolumeTypesAccessTest-1363105987 None] Lock "cinder-536c96ca-ce5a-414c-b8bd-e532fd396fdd-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:58:30 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-e01c0292-3384-4082-a09d-432b65d7a4c4 tempest-VolumeTypesAccessTest-1363105987 None] Acquiring lock "cinder-quobyte-536c96ca-ce5a-414c-b8bd-e532fd396fdd" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:58:30 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-e01c0292-3384-4082-a09d-432b65d7a4c4 tempest-VolumeTypesAccessTest-1363105987 None] Lock "cinder-quobyte-536c96ca-ce5a-414c-b8bd-e532fd396fdd" acquired by "delete_volume" :: waited 0.016s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:58:30 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[3646a330-ddb1-4335-ae3f-737da16de7e8]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:58:30 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-e01c0292-3384-4082-a09d-432b65d7a4c4 tempest-VolumeTypesAccessTest-1363105987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-536c96ca-ce5a-414c-b8bd-e532fd396fdd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:58:30 devstack sudo[97791]: pam_unix(sudo:session): session closed for user root Jul 10 15:58:30 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-0676860d-c3ac-4adb-9048-504918f18e59 tempest-VolumesGetTest-474292535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-30d59b81-5f5c-4ffe-b1e0-01eaeb73e9dc" returned: 0 in 0.832s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:58:30 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-0676860d-c3ac-4adb-9048-504918f18e59 tempest-VolumesGetTest-474292535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-30d59b81-5f5c-4ffe-b1e0-01eaeb73e9dc {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:58:30 devstack sudo[97801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-536c96ca-ce5a-414c-b8bd-e532fd396fdd Jul 10 15:58:30 devstack sudo[97801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:58:30 devstack sudo[97802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-30d59b81-5f5c-4ffe-b1e0-01eaeb73e9dc Jul 10 15:58:30 devstack sudo[97802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:58:30 devstack sudo[97797]: pam_unix(sudo:session): session closed for user root Jul 10 15:58:30 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8a11ca23-1af2-4cd6-a165-410b58e61a0d tempest-VolumesDeleteCascade-134824525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-af6dbbc9-3b53-41b0-9f86-fababba7d826,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-af6dbbc9-3b53-41b0-9f86-fababba7d826.810d52ac-718e-428d-834b-4da3417f6fd6 1G" returned: 0 in 0.906s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:58:30 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8a11ca23-1af2-4cd6-a165-410b58e61a0d tempest-VolumesDeleteCascade-134824525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af6dbbc9-3b53-41b0-9f86-fababba7d826 -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-af6dbbc9-3b53-41b0-9f86-fababba7d826.810d52ac-718e-428d-834b-4da3417f6fd6 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:58:30 devstack sudo[97842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af6dbbc9-3b53-41b0-9f86-fababba7d826 -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-af6dbbc9-3b53-41b0-9f86-fababba7d826.810d52ac-718e-428d-834b-4da3417f6fd6 Jul 10 15:58:31 devstack sudo[97842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:58:31 devstack sudo[97801]: pam_unix(sudo:session): session closed for user root Jul 10 15:58:31 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-e01c0292-3384-4082-a09d-432b65d7a4c4 tempest-VolumeTypesAccessTest-1363105987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-536c96ca-ce5a-414c-b8bd-e532fd396fdd" returned: 0 in 0.862s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:58:31 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-e01c0292-3384-4082-a09d-432b65d7a4c4 tempest-VolumeTypesAccessTest-1363105987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-536c96ca-ce5a-414c-b8bd-e532fd396fdd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:58:31 devstack sudo[97852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-536c96ca-ce5a-414c-b8bd-e532fd396fdd Jul 10 15:58:31 devstack sudo[97852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:58:31 devstack sudo[97802]: pam_unix(sudo:session): session closed for user root Jul 10 15:58:31 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-0676860d-c3ac-4adb-9048-504918f18e59 tempest-VolumesGetTest-474292535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-30d59b81-5f5c-4ffe-b1e0-01eaeb73e9dc" returned: 1 in 0.848s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:58:31 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-0676860d-c3ac-4adb-9048-504918f18e59 tempest-VolumesGetTest-474292535 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-30d59b81-5f5c-4ffe-b1e0-01eaeb73e9dc' failed. Not Retrying. {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 15:58:31 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-0676860d-c3ac-4adb-9048-504918f18e59 tempest-VolumesGetTest-474292535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-30d59b81-5f5c-4ffe-b1e0-01eaeb73e9dc {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:58:31 devstack sudo[97854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-30d59b81-5f5c-4ffe-b1e0-01eaeb73e9dc Jul 10 15:58:31 devstack sudo[97854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:58:31 devstack sudo[97842]: pam_unix(sudo:session): session closed for user root Jul 10 15:58:31 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8a11ca23-1af2-4cd6-a165-410b58e61a0d tempest-VolumesDeleteCascade-134824525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af6dbbc9-3b53-41b0-9f86-fababba7d826 -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-af6dbbc9-3b53-41b0-9f86-fababba7d826.810d52ac-718e-428d-834b-4da3417f6fd6" returned: 0 in 0.753s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:58:31 devstack cinder-volume[87420]: WARNING cinder.volume.drivers.remotefs [None req-8a11ca23-1af2-4cd6-a165-410b58e61a0d tempest-VolumesDeleteCascade-134824525 None] /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-af6dbbc9-3b53-41b0-9f86-fababba7d826.810d52ac-718e-428d-834b-4da3417f6fd6 is being set with open permissions: ugo+rw Jul 10 15:58:31 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8a11ca23-1af2-4cd6-a165-410b58e61a0d tempest-VolumesDeleteCascade-134824525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-af6dbbc9-3b53-41b0-9f86-fababba7d826.810d52ac-718e-428d-834b-4da3417f6fd6 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:58:31 devstack sudo[97860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-af6dbbc9-3b53-41b0-9f86-fababba7d826.810d52ac-718e-428d-834b-4da3417f6fd6 Jul 10 15:58:31 devstack sudo[97860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:58:31 devstack sudo[97852]: pam_unix(sudo:session): session closed for user root Jul 10 15:58:31 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-e01c0292-3384-4082-a09d-432b65d7a4c4 tempest-VolumeTypesAccessTest-1363105987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-536c96ca-ce5a-414c-b8bd-e532fd396fdd" returned: 0 in 0.709s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:58:31 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-e01c0292-3384-4082-a09d-432b65d7a4c4 tempest-VolumeTypesAccessTest-1363105987 None] Lock "cinder-quobyte-536c96ca-ce5a-414c-b8bd-e532fd396fdd" released by "delete_volume" :: held 1.618s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:58:31 devstack cinder-volume[87420]: WARNING cinder.quota [None req-e01c0292-3384-4082-a09d-432b65d7a4c4 tempest-VolumeTypesAccessTest-1363105987 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-876444244 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-876444244, it is now deprecated. Please use the default quota class for default quota. Jul 10 15:58:31 devstack cinder-volume[87420]: WARNING cinder.quota [None req-e01c0292-3384-4082-a09d-432b65d7a4c4 tempest-VolumeTypesAccessTest-1363105987 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-876444244 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-876444244, it is now deprecated. Please use the default quota class for default quota. Jul 10 15:58:32 devstack sudo[97854]: pam_unix(sudo:session): session closed for user root Jul 10 15:58:32 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-0676860d-c3ac-4adb-9048-504918f18e59 tempest-VolumesGetTest-474292535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-30d59b81-5f5c-4ffe-b1e0-01eaeb73e9dc" returned: 0 in 0.734s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:58:32 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-e01c0292-3384-4082-a09d-432b65d7a4c4 tempest-VolumeTypesAccessTest-1363105987 None] Created reservations ['f500b633-efca-487e-9372-367675843502', 'ac3717ac-e95a-45c8-b411-60bf71e8b1e5', 'c73df111-6214-4e03-b914-bbf10cd466e6', 'ec09d588-640e-49bd-8f37-ed64c78801f1'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 15:58:32 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-0676860d-c3ac-4adb-9048-504918f18e59 tempest-VolumesGetTest-474292535 None] Lock "cinder-quobyte-30d59b81-5f5c-4ffe-b1e0-01eaeb73e9dc" released by "delete_volume" :: held 2.486s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:58:32 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-e01c0292-3384-4082-a09d-432b65d7a4c4 tempest-VolumeTypesAccessTest-1363105987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:58:32 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-e01c0292-3384-4082-a09d-432b65d7a4c4 tempest-VolumeTypesAccessTest-1363105987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:58:32 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-e01c0292-3384-4082-a09d-432b65d7a4c4 tempest-VolumeTypesAccessTest-1363105987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:58:32 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-e01c0292-3384-4082-a09d-432b65d7a4c4 tempest-VolumeTypesAccessTest-1363105987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:58:32 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-e01c0292-3384-4082-a09d-432b65d7a4c4 tempest-VolumeTypesAccessTest-1363105987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:58:32 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-e01c0292-3384-4082-a09d-432b65d7a4c4 tempest-VolumeTypesAccessTest-1363105987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:58:32 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-0676860d-c3ac-4adb-9048-504918f18e59 tempest-VolumesGetTest-474292535 None] Created reservations ['b7d45fd4-37dc-4b0f-b732-e1352c4f4e5b', '2b5ef6b0-fa12-4d00-8000-e154fe3f3547', '043f3d28-4b6c-43d3-8449-fbf8a0cef2ee', 'ef1d25fa-e7b0-4d07-ad33-167257f2d915'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 15:58:32 devstack sudo[97864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 15:58:32 devstack sudo[97864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:58:32 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-0676860d-c3ac-4adb-9048-504918f18e59 tempest-VolumesGetTest-474292535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:58:32 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-0676860d-c3ac-4adb-9048-504918f18e59 tempest-VolumesGetTest-474292535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:58:32 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-0676860d-c3ac-4adb-9048-504918f18e59 tempest-VolumesGetTest-474292535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:58:32 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-0676860d-c3ac-4adb-9048-504918f18e59 tempest-VolumesGetTest-474292535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:58:32 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-0676860d-c3ac-4adb-9048-504918f18e59 tempest-VolumesGetTest-474292535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:58:32 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-0676860d-c3ac-4adb-9048-504918f18e59 tempest-VolumesGetTest-474292535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:58:32 devstack sudo[97866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 15:58:32 devstack sudo[97866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:58:32 devstack sudo[97860]: pam_unix(sudo:session): session closed for user root Jul 10 15:58:32 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8a11ca23-1af2-4cd6-a165-410b58e61a0d tempest-VolumesDeleteCascade-134824525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-af6dbbc9-3b53-41b0-9f86-fababba7d826.810d52ac-718e-428d-834b-4da3417f6fd6" returned: 0 in 0.688s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:58:32 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8a11ca23-1af2-4cd6-a165-410b58e61a0d tempest-VolumesDeleteCascade-134824525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-af6dbbc9-3b53-41b0-9f86-fababba7d826.info {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:58:32 devstack sudo[97869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-af6dbbc9-3b53-41b0-9f86-fababba7d826.info Jul 10 15:58:32 devstack sudo[97869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:58:32 devstack sudo[97864]: pam_unix(sudo:session): session closed for user root Jul 10 15:58:32 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-e01c0292-3384-4082-a09d-432b65d7a4c4 tempest-VolumeTypesAccessTest-1363105987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.756s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:58:32 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-e01c0292-3384-4082-a09d-432b65d7a4c4 tempest-VolumeTypesAccessTest-1363105987 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 15:58:32 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-e01c0292-3384-4082-a09d-432b65d7a4c4 tempest-VolumeTypesAccessTest-1363105987 None] Deleted volume successfully. Jul 10 15:58:32 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-e01c0292-3384-4082-a09d-432b65d7a4c4 tempest-VolumeTypesAccessTest-1363105987 None] Lock "cinder-536c96ca-ce5a-414c-b8bd-e532fd396fdd-delete_volume" released by "delete_volume" :: held 2.633s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:58:32 devstack sudo[97866]: pam_unix(sudo:session): session closed for user root Jul 10 15:58:32 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-0676860d-c3ac-4adb-9048-504918f18e59 tempest-VolumesGetTest-474292535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.750s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:58:32 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-0676860d-c3ac-4adb-9048-504918f18e59 tempest-VolumesGetTest-474292535 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 15:58:32 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-0676860d-c3ac-4adb-9048-504918f18e59 tempest-VolumesGetTest-474292535 None] Deleted volume successfully. Jul 10 15:58:32 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-0676860d-c3ac-4adb-9048-504918f18e59 tempest-VolumesGetTest-474292535 None] Lock "cinder-30d59b81-5f5c-4ffe-b1e0-01eaeb73e9dc-delete_volume" released by "delete_volume" :: held 3.514s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:58:33 devstack sudo[97869]: pam_unix(sudo:session): session closed for user root Jul 10 15:58:33 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8a11ca23-1af2-4cd6-a165-410b58e61a0d tempest-VolumesDeleteCascade-134824525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-af6dbbc9-3b53-41b0-9f86-fababba7d826.info" returned: 0 in 0.902s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:58:33 devstack cinder-volume[87420]: WARNING cinder.volume.drivers.remotefs [None req-8a11ca23-1af2-4cd6-a165-410b58e61a0d tempest-VolumesDeleteCascade-134824525 None] /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-af6dbbc9-3b53-41b0-9f86-fababba7d826.info is being set with open permissions: ugo+rw Jul 10 15:58:33 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8a11ca23-1af2-4cd6-a165-410b58e61a0d tempest-VolumesDeleteCascade-134824525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-af6dbbc9-3b53-41b0-9f86-fababba7d826.info {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:58:33 devstack sudo[97875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-af6dbbc9-3b53-41b0-9f86-fababba7d826.info Jul 10 15:58:33 devstack sudo[97875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:58:34 devstack sudo[97875]: pam_unix(sudo:session): session closed for user root Jul 10 15:58:34 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8a11ca23-1af2-4cd6-a165-410b58e61a0d tempest-VolumesDeleteCascade-134824525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-af6dbbc9-3b53-41b0-9f86-fababba7d826.info" returned: 0 in 0.709s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:58:34 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-8a11ca23-1af2-4cd6-a165-410b58e61a0d tempest-VolumesDeleteCascade-134824525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.919s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:58:34 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [req-16dbeb2a-35c6-4981-bda2-e56df2dbc3dc req-d8850a86-6b8c-4cfc-81f7-96f6ae55b5cd tempest-TestStampPattern-1127543775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 5.953s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:58:34 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc05ea03-280d-45cf-aca8-fcd398a78e3d]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:58:34 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [req-16dbeb2a-35c6-4981-bda2-e56df2dbc3dc req-d8850a86-6b8c-4cfc-81f7-96f6ae55b5cd tempest-TestStampPattern-1127543775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4ff68687-c9f5-4d47-a2bb-8312436fc4b7 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:58:34 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-8a11ca23-1af2-4cd6-a165-410b58e61a0d tempest-VolumesDeleteCascade-134824525 None] Create snapshot completed successfully Jul 10 15:58:34 devstack sudo[97878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4ff68687-c9f5-4d47-a2bb-8312436fc4b7 Jul 10 15:58:34 devstack sudo[97878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:58:35 devstack sudo[97878]: pam_unix(sudo:session): session closed for user root Jul 10 15:58:35 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [req-16dbeb2a-35c6-4981-bda2-e56df2dbc3dc req-d8850a86-6b8c-4cfc-81f7-96f6ae55b5cd tempest-TestStampPattern-1127543775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4ff68687-c9f5-4d47-a2bb-8312436fc4b7" returned: 0 in 0.928s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:58:35 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [req-16dbeb2a-35c6-4981-bda2-e56df2dbc3dc req-d8850a86-6b8c-4cfc-81f7-96f6ae55b5cd tempest-TestStampPattern-1127543775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.975s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:58:35 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [req-16dbeb2a-35c6-4981-bda2-e56df2dbc3dc req-d8850a86-6b8c-4cfc-81f7-96f6ae55b5cd tempest-TestStampPattern-1127543775 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80', 'name': 'volume-4ff68687-c9f5-4d47-a2bb-8312436fc4b7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9e9acd22-1b3d-4deb-b694-7d097e641bdd', 'enforce_multipath': True} {{(pid=87420) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 15:58:35 devstack cinder-volume[87420]: INFO cinder.volume.manager [req-16dbeb2a-35c6-4981-bda2-e56df2dbc3dc req-d8850a86-6b8c-4cfc-81f7-96f6ae55b5cd tempest-TestStampPattern-1127543775 None] attachment_update completed successfully. Jul 10 15:58:36 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-0dfb56f5-c962-4f04-a0ec-7e9ccbaab9a9 tempest-VolumesDeleteCascade-134824525 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 15:58:36 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-0dfb56f5-c962-4f04-a0ec-7e9ccbaab9a9 tempest-VolumesDeleteCascade-134824525 None] Flow 'volume_create_manager' (3d9d3ea0-d273-4dcb-a267-85b3789db9ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:58:36 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-0dfb56f5-c962-4f04-a0ec-7e9ccbaab9a9 tempest-VolumesDeleteCascade-134824525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e0bf7fa-8c6c-4b9e-956e-9efc36e88e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:58:36 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-0dfb56f5-c962-4f04-a0ec-7e9ccbaab9a9 tempest-VolumesDeleteCascade-134824525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e0bf7fa-8c6c-4b9e-956e-9efc36e88e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:58:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1390207387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7970f75a-5544-42b3-9a23-7ad5eb968c66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29986c0842554f22bdd95ba498ecf9ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:58:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=810d52ac-718e-428d-834b-4da3417f6fd6,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:58:36Z,use_quota=True,user_id='df41e4e5b745419bad59c111b6510027',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:58:36 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-0dfb56f5-c962-4f04-a0ec-7e9ccbaab9a9 tempest-VolumesDeleteCascade-134824525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (191dd3c2-ba93-427a-b437-7cea363377e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:58:36 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-0dfb56f5-c962-4f04-a0ec-7e9ccbaab9a9 tempest-VolumesDeleteCascade-134824525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (191dd3c2-ba93-427a-b437-7cea363377e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:58:36 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-0dfb56f5-c962-4f04-a0ec-7e9ccbaab9a9 tempest-VolumesDeleteCascade-134824525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b903fc5-8be0-48a0-9fe0-c511a0a443f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:58:36 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-0dfb56f5-c962-4f04-a0ec-7e9ccbaab9a9 tempest-VolumesDeleteCascade-134824525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b903fc5-8be0-48a0-9fe0-c511a0a443f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7970f75a-5544-42b3-9a23-7ad5eb968c66', 'volume_name': 'volume-7970f75a-5544-42b3-9a23-7ad5eb968c66', 'volume_size': 1, 'snapshot_id': '810d52ac-718e-428d-834b-4da3417f6fd6'}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:58:36 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-0dfb56f5-c962-4f04-a0ec-7e9ccbaab9a9 tempest-VolumesDeleteCascade-134824525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47cf77cf-21dd-412b-b03d-74f8a5e343d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:58:36 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-0dfb56f5-c962-4f04-a0ec-7e9ccbaab9a9 tempest-VolumesDeleteCascade-134824525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47cf77cf-21dd-412b-b03d-74f8a5e343d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:58:36 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-0dfb56f5-c962-4f04-a0ec-7e9ccbaab9a9 tempest-VolumesDeleteCascade-134824525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23bc8493-ebd0-4245-94c3-d2df958fd806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:58:36 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-0dfb56f5-c962-4f04-a0ec-7e9ccbaab9a9 tempest-VolumesDeleteCascade-134824525 None] Volume 7970f75a-5544-42b3-9a23-7ad5eb968c66: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7970f75a-5544-42b3-9a23-7ad5eb968c66', 'volume_size': 1, 'snapshot_id': '810d52ac-718e-428d-834b-4da3417f6fd6'} Jul 10 15:58:36 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-0dfb56f5-c962-4f04-a0ec-7e9ccbaab9a9 tempest-VolumesDeleteCascade-134824525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:58:36 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-0dfb56f5-c962-4f04-a0ec-7e9ccbaab9a9 tempest-VolumesDeleteCascade-134824525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:58:36 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-0dfb56f5-c962-4f04-a0ec-7e9ccbaab9a9 tempest-VolumesDeleteCascade-134824525 None] Acquiring lock "cinder-quobyte-810d52ac-718e-428d-834b-4da3417f6fd6-7970f75a-5544-42b3-9a23-7ad5eb968c66" by "_create_volume_from_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:58:36 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-0dfb56f5-c962-4f04-a0ec-7e9ccbaab9a9 tempest-VolumesDeleteCascade-134824525 None] Lock "cinder-quobyte-810d52ac-718e-428d-834b-4da3417f6fd6-7970f75a-5544-42b3-9a23-7ad5eb968c66" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:58:36 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-0dfb56f5-c962-4f04-a0ec-7e9ccbaab9a9 tempest-VolumesDeleteCascade-134824525 None] Creating volume 7970f75a-5544-42b3-9a23-7ad5eb968c66 from snapshot 810d52ac-718e-428d-834b-4da3417f6fd6 {{(pid=87420) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 10 15:58:36 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-0dfb56f5-c962-4f04-a0ec-7e9ccbaab9a9 tempest-VolumesDeleteCascade-134824525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:58:36 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-0dfb56f5-c962-4f04-a0ec-7e9ccbaab9a9 tempest-VolumesDeleteCascade-134824525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:58:36 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-0dfb56f5-c962-4f04-a0ec-7e9ccbaab9a9 tempest-VolumesDeleteCascade-134824525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:58:36 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-0dfb56f5-c962-4f04-a0ec-7e9ccbaab9a9 tempest-VolumesDeleteCascade-134824525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:58:36 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-0dfb56f5-c962-4f04-a0ec-7e9ccbaab9a9 tempest-VolumesDeleteCascade-134824525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:58:36 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-0dfb56f5-c962-4f04-a0ec-7e9ccbaab9a9 tempest-VolumesDeleteCascade-134824525 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 15:58:36 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-0dfb56f5-c962-4f04-a0ec-7e9ccbaab9a9 tempest-VolumesDeleteCascade-134824525 None] Acquiring lock "cinder-quobyte-7970f75a-5544-42b3-9a23-7ad5eb968c66" by "_copy_volume_from_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:58:36 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-0dfb56f5-c962-4f04-a0ec-7e9ccbaab9a9 tempest-VolumesDeleteCascade-134824525 None] Lock "cinder-quobyte-7970f75a-5544-42b3-9a23-7ad5eb968c66" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:58:36 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-0dfb56f5-c962-4f04-a0ec-7e9ccbaab9a9 tempest-VolumesDeleteCascade-134824525 None] snapshot: 810d52ac-718e-428d-834b-4da3417f6fd6, volume: 7970f75a-5544-42b3-9a23-7ad5eb968c66, {{(pid=87420) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 15:58:36 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-0dfb56f5-c962-4f04-a0ec-7e9ccbaab9a9 tempest-VolumesDeleteCascade-134824525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:58:36 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-0dfb56f5-c962-4f04-a0ec-7e9ccbaab9a9 tempest-VolumesDeleteCascade-134824525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:58:36 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-0dfb56f5-c962-4f04-a0ec-7e9ccbaab9a9 tempest-VolumesDeleteCascade-134824525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:58:36 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-0dfb56f5-c962-4f04-a0ec-7e9ccbaab9a9 tempest-VolumesDeleteCascade-134824525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:58:36 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-0dfb56f5-c962-4f04-a0ec-7e9ccbaab9a9 tempest-VolumesDeleteCascade-134824525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:58:36 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bb17732-dcd2-48f3-a266-83e812462cb9]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:58:36 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-0dfb56f5-c962-4f04-a0ec-7e9ccbaab9a9 tempest-VolumesDeleteCascade-134824525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-af6dbbc9-3b53-41b0-9f86-fababba7d826.810d52ac-718e-428d-834b-4da3417f6fd6 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:58:36 devstack sudo[97951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-af6dbbc9-3b53-41b0-9f86-fababba7d826.810d52ac-718e-428d-834b-4da3417f6fd6 Jul 10 15:58:36 devstack sudo[97951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:58:36 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-77a4db49-2e8b-46dc-93b6-d436584cb38b tempest-VolumesSnapshotListTestJSON-1129883993 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 15:58:36 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-77a4db49-2e8b-46dc-93b6-d436584cb38b tempest-VolumesSnapshotListTestJSON-1129883993 None] Flow 'volume_create_manager' (9c0d0dcf-4135-42ce-b090-70187380b552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:58:37 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-77a4db49-2e8b-46dc-93b6-d436584cb38b tempest-VolumesSnapshotListTestJSON-1129883993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b20df0e-0680-486d-b373-f6dc65631589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:58:37 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-77a4db49-2e8b-46dc-93b6-d436584cb38b tempest-VolumesSnapshotListTestJSON-1129883993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b20df0e-0680-486d-b373-f6dc65631589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:58:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-303512371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=000deb4b-896c-4430-8609-5e2258a4f8fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebdf8548320844da8a36bcab0a2c7f30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:58:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:58:37Z,use_quota=True,user_id='1158adafce334a53b8d636ef7a315432',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:58:37 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-77a4db49-2e8b-46dc-93b6-d436584cb38b tempest-VolumesSnapshotListTestJSON-1129883993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72cde219-242c-461d-80a8-cc79ef425fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:58:37 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-77a4db49-2e8b-46dc-93b6-d436584cb38b tempest-VolumesSnapshotListTestJSON-1129883993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72cde219-242c-461d-80a8-cc79ef425fc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:58:37 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-77a4db49-2e8b-46dc-93b6-d436584cb38b tempest-VolumesSnapshotListTestJSON-1129883993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb190b57-881a-46fa-966a-f571e9d7edb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:58:37 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-77a4db49-2e8b-46dc-93b6-d436584cb38b tempest-VolumesSnapshotListTestJSON-1129883993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb190b57-881a-46fa-966a-f571e9d7edb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '000deb4b-896c-4430-8609-5e2258a4f8fa', 'volume_name': 'volume-000deb4b-896c-4430-8609-5e2258a4f8fa', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:58:37 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-77a4db49-2e8b-46dc-93b6-d436584cb38b tempest-VolumesSnapshotListTestJSON-1129883993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (193b8476-2c21-4580-9842-e232ebf4b2f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:58:37 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-77a4db49-2e8b-46dc-93b6-d436584cb38b tempest-VolumesSnapshotListTestJSON-1129883993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (193b8476-2c21-4580-9842-e232ebf4b2f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:58:37 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-77a4db49-2e8b-46dc-93b6-d436584cb38b tempest-VolumesSnapshotListTestJSON-1129883993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a36429b-bba6-4426-9a9d-dabce1c44efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:58:37 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-77a4db49-2e8b-46dc-93b6-d436584cb38b tempest-VolumesSnapshotListTestJSON-1129883993 None] Volume 000deb4b-896c-4430-8609-5e2258a4f8fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-000deb4b-896c-4430-8609-5e2258a4f8fa', 'volume_size': 1} Jul 10 15:58:37 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-77a4db49-2e8b-46dc-93b6-d436584cb38b tempest-VolumesSnapshotListTestJSON-1129883993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:58:37 devstack sudo[97951]: pam_unix(sudo:session): session closed for user root Jul 10 15:58:37 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-0dfb56f5-c962-4f04-a0ec-7e9ccbaab9a9 tempest-VolumesDeleteCascade-134824525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-af6dbbc9-3b53-41b0-9f86-fababba7d826.810d52ac-718e-428d-834b-4da3417f6fd6" returned: 0 in 1.017s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:58:37 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-0dfb56f5-c962-4f04-a0ec-7e9ccbaab9a9 tempest-VolumesDeleteCascade-134824525 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-af6dbbc9-3b53-41b0-9f86-fababba7d826(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87420) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 15:58:37 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-0dfb56f5-c962-4f04-a0ec-7e9ccbaab9a9 tempest-VolumesDeleteCascade-134824525 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-af6dbbc9-3b53-41b0-9f86-fababba7d826 {{(pid=87420) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 15:58:37 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-0dfb56f5-c962-4f04-a0ec-7e9ccbaab9a9 tempest-VolumesDeleteCascade-134824525 None] Creating direct copy from snapshot {{(pid=87420) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 15:58:37 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd02c726-541f-4dc0-b602-cea972863d12]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:58:37 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-0dfb56f5-c962-4f04-a0ec-7e9ccbaab9a9 tempest-VolumesDeleteCascade-134824525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-af6dbbc9-3b53-41b0-9f86-fababba7d826 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:58:37 devstack sudo[98272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-af6dbbc9-3b53-41b0-9f86-fababba7d826 Jul 10 15:58:37 devstack sudo[98272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:58:38 devstack sudo[98272]: pam_unix(sudo:session): session closed for user root Jul 10 15:58:38 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-0dfb56f5-c962-4f04-a0ec-7e9ccbaab9a9 tempest-VolumesDeleteCascade-134824525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-af6dbbc9-3b53-41b0-9f86-fababba7d826" returned: 0 in 0.835s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:58:38 devstack cinder-volume[87420]: DEBUG cinder.utils [None req-0dfb56f5-c962-4f04-a0ec-7e9ccbaab9a9 tempest-VolumesDeleteCascade-134824525 None] Path /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7970f75a-5544-42b3-9a23-7ad5eb968c66 not found in is_blk_device check {{(pid=87420) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 15:58:38 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-0dfb56f5-c962-4f04-a0ec-7e9ccbaab9a9 tempest-VolumesDeleteCascade-134824525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-af6dbbc9-3b53-41b0-9f86-fababba7d826 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7970f75a-5544-42b3-9a23-7ad5eb968c66 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:58:38 devstack sudo[98278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-af6dbbc9-3b53-41b0-9f86-fababba7d826 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7970f75a-5544-42b3-9a23-7ad5eb968c66 Jul 10 15:58:38 devstack sudo[98278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:58:44 devstack sudo[98278]: pam_unix(sudo:session): session closed for user root Jul 10 15:58:44 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-0dfb56f5-c962-4f04-a0ec-7e9ccbaab9a9 tempest-VolumesDeleteCascade-134824525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-af6dbbc9-3b53-41b0-9f86-fababba7d826 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7970f75a-5544-42b3-9a23-7ad5eb968c66" returned: 0 in 6.129s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:58:44 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b513e38-ede6-431d-81f1-7d5cd4c99214]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:58:44 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-0dfb56f5-c962-4f04-a0ec-7e9ccbaab9a9 tempest-VolumesDeleteCascade-134824525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-af6dbbc9-3b53-41b0-9f86-fababba7d826 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:58:44 devstack sudo[98304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-af6dbbc9-3b53-41b0-9f86-fababba7d826 Jul 10 15:58:44 devstack sudo[98304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:58:45 devstack sudo[98304]: pam_unix(sudo:session): session closed for user root Jul 10 15:58:45 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-0dfb56f5-c962-4f04-a0ec-7e9ccbaab9a9 tempest-VolumesDeleteCascade-134824525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-af6dbbc9-3b53-41b0-9f86-fababba7d826" returned: 0 in 1.045s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:58:45 devstack cinder-volume[87420]: DEBUG cinder.image.image_utils [None req-0dfb56f5-c962-4f04-a0ec-7e9ccbaab9a9 tempest-VolumesDeleteCascade-134824525 None] Image conversion details: src /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-af6dbbc9-3b53-41b0-9f86-fababba7d826, size 1024.00 MB, duration 6.13 sec, destination /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7970f75a-5544-42b3-9a23-7ad5eb968c66 {{(pid=87420) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 15:58:45 devstack cinder-volume[87420]: INFO cinder.image.image_utils [None req-0dfb56f5-c962-4f04-a0ec-7e9ccbaab9a9 tempest-VolumesDeleteCascade-134824525 None] Converted 1024.00 MB image at 167.03 MB/s Jul 10 15:58:45 devstack cinder-volume[87420]: WARNING cinder.volume.drivers.remotefs [None req-0dfb56f5-c962-4f04-a0ec-7e9ccbaab9a9 tempest-VolumesDeleteCascade-134824525 None] /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7970f75a-5544-42b3-9a23-7ad5eb968c66 is being set with open permissions: ugo+rw Jul 10 15:58:45 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-0dfb56f5-c962-4f04-a0ec-7e9ccbaab9a9 tempest-VolumesDeleteCascade-134824525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7970f75a-5544-42b3-9a23-7ad5eb968c66 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:58:45 devstack sudo[98324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7970f75a-5544-42b3-9a23-7ad5eb968c66 Jul 10 15:58:45 devstack sudo[98324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:58:46 devstack sudo[98324]: pam_unix(sudo:session): session closed for user root Jul 10 15:58:46 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-0dfb56f5-c962-4f04-a0ec-7e9ccbaab9a9 tempest-VolumesDeleteCascade-134824525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7970f75a-5544-42b3-9a23-7ad5eb968c66" returned: 0 in 0.649s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:58:46 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-0dfb56f5-c962-4f04-a0ec-7e9ccbaab9a9 tempest-VolumesDeleteCascade-134824525 None] Lock "cinder-quobyte-7970f75a-5544-42b3-9a23-7ad5eb968c66" released by "_copy_volume_from_snapshot" :: held 9.850s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:58:46 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-0dfb56f5-c962-4f04-a0ec-7e9ccbaab9a9 tempest-VolumesDeleteCascade-134824525 None] Lock "cinder-quobyte-810d52ac-718e-428d-834b-4da3417f6fd6-7970f75a-5544-42b3-9a23-7ad5eb968c66" released by "_create_volume_from_snapshot" :: held 9.890s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:58:46 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-0dfb56f5-c962-4f04-a0ec-7e9ccbaab9a9 tempest-VolumesDeleteCascade-134824525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.910s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:58:46 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-77a4db49-2e8b-46dc-93b6-d436584cb38b tempest-VolumesSnapshotListTestJSON-1129883993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.010s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:58:46 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-77a4db49-2e8b-46dc-93b6-d436584cb38b tempest-VolumesSnapshotListTestJSON-1129883993 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:58:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-303512371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=000deb4b-896c-4430-8609-5e2258a4f8fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebdf8548320844da8a36bcab0a2c7f30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:58:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:58:37Z,use_quota=True,user_id='1158adafce334a53b8d636ef7a315432',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 15:58:46 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-77a4db49-2e8b-46dc-93b6-d436584cb38b tempest-VolumesSnapshotListTestJSON-1129883993 None] Creating volume 000deb4b-896c-4430-8609-5e2258a4f8fa {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 15:58:46 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-77a4db49-2e8b-46dc-93b6-d436584cb38b tempest-VolumesSnapshotListTestJSON-1129883993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:58:46 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-77a4db49-2e8b-46dc-93b6-d436584cb38b tempest-VolumesSnapshotListTestJSON-1129883993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:58:46 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-77a4db49-2e8b-46dc-93b6-d436584cb38b tempest-VolumesSnapshotListTestJSON-1129883993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:58:46 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-77a4db49-2e8b-46dc-93b6-d436584cb38b tempest-VolumesSnapshotListTestJSON-1129883993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:58:46 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-77a4db49-2e8b-46dc-93b6-d436584cb38b tempest-VolumesSnapshotListTestJSON-1129883993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:58:46 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-77a4db49-2e8b-46dc-93b6-d436584cb38b tempest-VolumesSnapshotListTestJSON-1129883993 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 15:58:46 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-77a4db49-2e8b-46dc-93b6-d436584cb38b tempest-VolumesSnapshotListTestJSON-1129883993 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 15:58:46 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-77a4db49-2e8b-46dc-93b6-d436584cb38b tempest-VolumesSnapshotListTestJSON-1129883993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-000deb4b-896c-4430-8609-5e2258a4f8fa 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:58:46 devstack sudo[98327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-000deb4b-896c-4430-8609-5e2258a4f8fa 1073741824 Jul 10 15:58:46 devstack sudo[98327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:58:46 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-0dfb56f5-c962-4f04-a0ec-7e9ccbaab9a9 tempest-VolumesDeleteCascade-134824525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23bc8493-ebd0-4245-94c3-d2df958fd806) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7970f75a-5544-42b3-9a23-7ad5eb968c66', 'volume_size': 1, 'snapshot_id': '810d52ac-718e-428d-834b-4da3417f6fd6'}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:58:46 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-0dfb56f5-c962-4f04-a0ec-7e9ccbaab9a9 tempest-VolumesDeleteCascade-134824525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24dfb622-b70f-4295-b0a4-ede352d7ee9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:58:46 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-0dfb56f5-c962-4f04-a0ec-7e9ccbaab9a9 tempest-VolumesDeleteCascade-134824525 None] Volume volume-7970f75a-5544-42b3-9a23-7ad5eb968c66 (7970f75a-5544-42b3-9a23-7ad5eb968c66): created successfully Jul 10 15:58:46 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-0dfb56f5-c962-4f04-a0ec-7e9ccbaab9a9 tempest-VolumesDeleteCascade-134824525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24dfb622-b70f-4295-b0a4-ede352d7ee9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:58:46 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-0dfb56f5-c962-4f04-a0ec-7e9ccbaab9a9 tempest-VolumesDeleteCascade-134824525 None] Flow 'volume_create_manager' (3d9d3ea0-d273-4dcb-a267-85b3789db9ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:58:46 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-0dfb56f5-c962-4f04-a0ec-7e9ccbaab9a9 tempest-VolumesDeleteCascade-134824525 None] Created volume successfully. Jul 10 15:58:46 devstack cinder-volume[87420]: INFO cinder.volume.manager [req-43165cd0-ebb0-44ca-9877-592e2e0b0540 req-c62a7886-878c-4e54-ad00-2466678d6506 tempest-TestStampPattern-1127543775 None] Terminate volume connection completed successfully. Jul 10 15:58:46 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [req-43165cd0-ebb0-44ca-9877-592e2e0b0540 req-c62a7886-878c-4e54-ad00-2466678d6506 tempest-TestStampPattern-1127543775 None] Deleting attachment 9e9acd22-1b3d-4deb-b694-7d097e641bdd. {{(pid=87420) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 15:58:47 devstack sudo[98327]: pam_unix(sudo:session): session closed for user root Jul 10 15:58:47 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-77a4db49-2e8b-46dc-93b6-d436584cb38b tempest-VolumesSnapshotListTestJSON-1129883993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-000deb4b-896c-4430-8609-5e2258a4f8fa 1073741824" returned: 0 in 0.972s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:58:47 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-77a4db49-2e8b-46dc-93b6-d436584cb38b tempest-VolumesSnapshotListTestJSON-1129883993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-000deb4b-896c-4430-8609-5e2258a4f8fa {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:58:47 devstack sudo[98360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-000deb4b-896c-4430-8609-5e2258a4f8fa Jul 10 15:58:47 devstack sudo[98360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:58:47 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-d7520b62-5902-4aa2-95e5-4c594fa8353b tempest-VolumesDeleteCascade-134824525 None] Acquiring lock "cinder-af6dbbc9-3b53-41b0-9f86-fababba7d826-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:58:47 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-d7520b62-5902-4aa2-95e5-4c594fa8353b tempest-VolumesDeleteCascade-134824525 None] Lock "cinder-af6dbbc9-3b53-41b0-9f86-fababba7d826-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:58:47 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d7520b62-5902-4aa2-95e5-4c594fa8353b tempest-VolumesDeleteCascade-134824525 None] Performing cascade delete. {{(pid=87420) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 10 15:58:47 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-d7520b62-5902-4aa2-95e5-4c594fa8353b tempest-VolumesDeleteCascade-134824525 None] Acquiring lock "cinder-810d52ac-718e-428d-834b-4da3417f6fd6-delete_snapshot" by "delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:58:47 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-d7520b62-5902-4aa2-95e5-4c594fa8353b tempest-VolumesDeleteCascade-134824525 None] Lock "cinder-810d52ac-718e-428d-834b-4da3417f6fd6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:58:47 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-d7520b62-5902-4aa2-95e5-4c594fa8353b tempest-VolumesDeleteCascade-134824525 None] Acquiring lock "cinder-quobyte-af6dbbc9-3b53-41b0-9f86-fababba7d826" by "delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:58:47 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-d7520b62-5902-4aa2-95e5-4c594fa8353b tempest-VolumesDeleteCascade-134824525 None] Lock "cinder-quobyte-af6dbbc9-3b53-41b0-9f86-fababba7d826" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:58:47 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-d7520b62-5902-4aa2-95e5-4c594fa8353b tempest-VolumesDeleteCascade-134824525 None] Acquiring lock "cinder-quobyte-810d52ac-718e-428d-834b-4da3417f6fd6" by "_delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:58:47 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-d7520b62-5902-4aa2-95e5-4c594fa8353b tempest-VolumesDeleteCascade-134824525 None] Lock "cinder-quobyte-810d52ac-718e-428d-834b-4da3417f6fd6" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:58:47 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-d7520b62-5902-4aa2-95e5-4c594fa8353b tempest-VolumesDeleteCascade-134824525 None] Deleting offline snapshot 810d52ac-718e-428d-834b-4da3417f6fd6 of volume af6dbbc9-3b53-41b0-9f86-fababba7d826 {{(pid=87420) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 15:58:47 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-d7520b62-5902-4aa2-95e5-4c594fa8353b tempest-VolumesDeleteCascade-134824525 None] snapshot_file for this snap is: volume-af6dbbc9-3b53-41b0-9f86-fababba7d826.810d52ac-718e-428d-834b-4da3417f6fd6 {{(pid=87420) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 15:58:47 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[a48c8615-40bb-4645-b653-789de64d96c8]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:58:47 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d7520b62-5902-4aa2-95e5-4c594fa8353b tempest-VolumesDeleteCascade-134824525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-af6dbbc9-3b53-41b0-9f86-fababba7d826.810d52ac-718e-428d-834b-4da3417f6fd6 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:58:47 devstack sudo[98362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-af6dbbc9-3b53-41b0-9f86-fababba7d826.810d52ac-718e-428d-834b-4da3417f6fd6 Jul 10 15:58:47 devstack sudo[98362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:58:47 devstack sudo[98360]: pam_unix(sudo:session): session closed for user root Jul 10 15:58:47 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-77a4db49-2e8b-46dc-93b6-d436584cb38b tempest-VolumesSnapshotListTestJSON-1129883993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-000deb4b-896c-4430-8609-5e2258a4f8fa" returned: 0 in 0.772s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:58:47 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-77a4db49-2e8b-46dc-93b6-d436584cb38b tempest-VolumesSnapshotListTestJSON-1129883993 None] <== create_volume: return (1797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 15:58:47 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-77a4db49-2e8b-46dc-93b6-d436584cb38b tempest-VolumesSnapshotListTestJSON-1129883993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.800s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:58:47 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-77a4db49-2e8b-46dc-93b6-d436584cb38b tempest-VolumesSnapshotListTestJSON-1129883993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a36429b-bba6-4426-9a9d-dabce1c44efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-000deb4b-896c-4430-8609-5e2258a4f8fa', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:58:47 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-77a4db49-2e8b-46dc-93b6-d436584cb38b tempest-VolumesSnapshotListTestJSON-1129883993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60f9d295-408e-4134-be01-17e88d35214c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:58:47 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-77a4db49-2e8b-46dc-93b6-d436584cb38b tempest-VolumesSnapshotListTestJSON-1129883993 None] Volume volume-000deb4b-896c-4430-8609-5e2258a4f8fa (000deb4b-896c-4430-8609-5e2258a4f8fa): created successfully Jul 10 15:58:47 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-77a4db49-2e8b-46dc-93b6-d436584cb38b tempest-VolumesSnapshotListTestJSON-1129883993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60f9d295-408e-4134-be01-17e88d35214c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:58:47 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-77a4db49-2e8b-46dc-93b6-d436584cb38b tempest-VolumesSnapshotListTestJSON-1129883993 None] Flow 'volume_create_manager' (9c0d0dcf-4135-42ce-b090-70187380b552) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:58:47 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-77a4db49-2e8b-46dc-93b6-d436584cb38b tempest-VolumesSnapshotListTestJSON-1129883993 None] Created volume successfully. Jul 10 15:58:48 devstack sudo[98362]: pam_unix(sudo:session): session closed for user root Jul 10 15:58:48 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d7520b62-5902-4aa2-95e5-4c594fa8353b tempest-VolumesDeleteCascade-134824525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-af6dbbc9-3b53-41b0-9f86-fababba7d826.810d52ac-718e-428d-834b-4da3417f6fd6" returned: 0 in 0.932s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:58:48 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-d7520b62-5902-4aa2-95e5-4c594fa8353b tempest-VolumesDeleteCascade-134824525 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-af6dbbc9-3b53-41b0-9f86-fababba7d826(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87420) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 15:58:48 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b66b5df-53de-4887-ab60-7cd1be4435a3]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:58:48 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d7520b62-5902-4aa2-95e5-4c594fa8353b tempest-VolumesDeleteCascade-134824525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-af6dbbc9-3b53-41b0-9f86-fababba7d826 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:58:48 devstack sudo[98368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-af6dbbc9-3b53-41b0-9f86-fababba7d826 Jul 10 15:58:48 devstack sudo[98368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:58:48 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-2f6b2b77-7698-40c8-b7d3-403cccaa7471 tempest-TestStampPattern-1127543775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:58:48 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-2f6b2b77-7698-40c8-b7d3-403cccaa7471 tempest-TestStampPattern-1127543775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:58:48 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-2f6b2b77-7698-40c8-b7d3-403cccaa7471 tempest-TestStampPattern-1127543775 None] Creating offline snapshot a9699ac7-4a2e-4683-be0d-ec67ec8cdf63 of volume 4ff68687-c9f5-4d47-a2bb-8312436fc4b7 {{(pid=87420) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 15:58:49 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[824fad4d-b271-43c3-83ef-d1b680ae0710]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:58:49 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-2f6b2b77-7698-40c8-b7d3-403cccaa7471 tempest-TestStampPattern-1127543775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4ff68687-c9f5-4d47-a2bb-8312436fc4b7 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:58:49 devstack sudo[98370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4ff68687-c9f5-4d47-a2bb-8312436fc4b7 Jul 10 15:58:49 devstack sudo[98370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:58:49 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-031daa51-979c-475c-980e-a4cb3ff1f1ee tempest-VolumesSnapshotListTestJSON-1129883993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:58:49 devstack sudo[98368]: pam_unix(sudo:session): session closed for user root Jul 10 15:58:49 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d7520b62-5902-4aa2-95e5-4c594fa8353b tempest-VolumesDeleteCascade-134824525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-af6dbbc9-3b53-41b0-9f86-fababba7d826" returned: 0 in 0.993s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:58:49 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d7520b62-5902-4aa2-95e5-4c594fa8353b tempest-VolumesDeleteCascade-134824525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-af6dbbc9-3b53-41b0-9f86-fababba7d826.810d52ac-718e-428d-834b-4da3417f6fd6 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:58:49 devstack sudo[98375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-af6dbbc9-3b53-41b0-9f86-fababba7d826.810d52ac-718e-428d-834b-4da3417f6fd6 Jul 10 15:58:49 devstack sudo[98375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:58:49 devstack sudo[98370]: pam_unix(sudo:session): session closed for user root Jul 10 15:58:49 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-2f6b2b77-7698-40c8-b7d3-403cccaa7471 tempest-TestStampPattern-1127543775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4ff68687-c9f5-4d47-a2bb-8312436fc4b7" returned: 0 in 0.892s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:58:49 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-2f6b2b77-7698-40c8-b7d3-403cccaa7471 tempest-TestStampPattern-1127543775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4ff68687-c9f5-4d47-a2bb-8312436fc4b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4ff68687-c9f5-4d47-a2bb-8312436fc4b7.a9699ac7-4a2e-4683-be0d-ec67ec8cdf63 1G {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:58:49 devstack sudo[98381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4ff68687-c9f5-4d47-a2bb-8312436fc4b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4ff68687-c9f5-4d47-a2bb-8312436fc4b7.a9699ac7-4a2e-4683-be0d-ec67ec8cdf63 1G Jul 10 15:58:49 devstack sudo[98381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:58:50 devstack sudo[98375]: pam_unix(sudo:session): session closed for user root Jul 10 15:58:50 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d7520b62-5902-4aa2-95e5-4c594fa8353b tempest-VolumesDeleteCascade-134824525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-af6dbbc9-3b53-41b0-9f86-fababba7d826.810d52ac-718e-428d-834b-4da3417f6fd6" returned: 0 in 0.832s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:58:50 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d7520b62-5902-4aa2-95e5-4c594fa8353b tempest-VolumesDeleteCascade-134824525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-af6dbbc9-3b53-41b0-9f86-fababba7d826.810d52ac-718e-428d-834b-4da3417f6fd6 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:58:50 devstack sudo[98387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-af6dbbc9-3b53-41b0-9f86-fababba7d826.810d52ac-718e-428d-834b-4da3417f6fd6 Jul 10 15:58:50 devstack sudo[98387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:58:50 devstack sudo[98381]: pam_unix(sudo:session): session closed for user root Jul 10 15:58:50 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-2f6b2b77-7698-40c8-b7d3-403cccaa7471 tempest-TestStampPattern-1127543775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4ff68687-c9f5-4d47-a2bb-8312436fc4b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4ff68687-c9f5-4d47-a2bb-8312436fc4b7.a9699ac7-4a2e-4683-be0d-ec67ec8cdf63 1G" returned: 0 in 0.909s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:58:50 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-2f6b2b77-7698-40c8-b7d3-403cccaa7471 tempest-TestStampPattern-1127543775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ff68687-c9f5-4d47-a2bb-8312436fc4b7 -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4ff68687-c9f5-4d47-a2bb-8312436fc4b7.a9699ac7-4a2e-4683-be0d-ec67ec8cdf63 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:58:50 devstack sudo[98392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ff68687-c9f5-4d47-a2bb-8312436fc4b7 -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4ff68687-c9f5-4d47-a2bb-8312436fc4b7.a9699ac7-4a2e-4683-be0d-ec67ec8cdf63 Jul 10 15:58:50 devstack sudo[98392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:58:51 devstack sudo[98387]: pam_unix(sudo:session): session closed for user root Jul 10 15:58:51 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d7520b62-5902-4aa2-95e5-4c594fa8353b tempest-VolumesDeleteCascade-134824525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-af6dbbc9-3b53-41b0-9f86-fababba7d826.810d52ac-718e-428d-834b-4da3417f6fd6" returned: 0 in 0.746s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:58:51 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-d7520b62-5902-4aa2-95e5-4c594fa8353b tempest-VolumesDeleteCascade-134824525 None] Lock "cinder-quobyte-810d52ac-718e-428d-834b-4da3417f6fd6" released by "_delete_snapshot" :: held 3.640s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:58:51 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-d7520b62-5902-4aa2-95e5-4c594fa8353b tempest-VolumesDeleteCascade-134824525 None] Lock "cinder-quobyte-af6dbbc9-3b53-41b0-9f86-fababba7d826" released by "delete_snapshot" :: held 3.668s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:58:51 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-d7520b62-5902-4aa2-95e5-4c594fa8353b tempest-VolumesDeleteCascade-134824525 None] Created reservations ['1cef21c7-a994-49b3-a8b7-11cfc26c1931', 'ba7bc1d5-4c13-40fc-94ac-903c8b359aa1', '2bd86df2-c83c-4576-92c4-37658855032f', 'b7082c63-e576-429a-bc60-1407e30c680d'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 15:58:51 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-d7520b62-5902-4aa2-95e5-4c594fa8353b tempest-VolumesDeleteCascade-134824525 None] Delete snapshot completed successfully. Jul 10 15:58:51 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-d7520b62-5902-4aa2-95e5-4c594fa8353b tempest-VolumesDeleteCascade-134824525 None] Lock "cinder-810d52ac-718e-428d-834b-4da3417f6fd6-delete_snapshot" released by "delete_snapshot" :: held 3.875s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:58:51 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d7520b62-5902-4aa2-95e5-4c594fa8353b tempest-VolumesDeleteCascade-134824525 None] Snapshots deleted, issuing volume delete {{(pid=87420) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 10 15:58:51 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-d7520b62-5902-4aa2-95e5-4c594fa8353b tempest-VolumesDeleteCascade-134824525 None] Acquiring lock "cinder-quobyte-af6dbbc9-3b53-41b0-9f86-fababba7d826" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:58:51 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-d7520b62-5902-4aa2-95e5-4c594fa8353b tempest-VolumesDeleteCascade-134824525 None] Lock "cinder-quobyte-af6dbbc9-3b53-41b0-9f86-fababba7d826" acquired by "delete_volume" :: waited 0.023s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:58:51 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8ec8a79-d71a-4d7e-9ad2-e4419435f1e1]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:58:51 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d7520b62-5902-4aa2-95e5-4c594fa8353b tempest-VolumesDeleteCascade-134824525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-af6dbbc9-3b53-41b0-9f86-fababba7d826 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:58:51 devstack sudo[98396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-af6dbbc9-3b53-41b0-9f86-fababba7d826 Jul 10 15:58:51 devstack sudo[98396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:58:51 devstack sudo[98392]: pam_unix(sudo:session): session closed for user root Jul 10 15:58:51 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-2f6b2b77-7698-40c8-b7d3-403cccaa7471 tempest-TestStampPattern-1127543775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ff68687-c9f5-4d47-a2bb-8312436fc4b7 -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4ff68687-c9f5-4d47-a2bb-8312436fc4b7.a9699ac7-4a2e-4683-be0d-ec67ec8cdf63" returned: 0 in 0.770s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:58:51 devstack cinder-volume[87420]: WARNING cinder.volume.drivers.remotefs [None req-2f6b2b77-7698-40c8-b7d3-403cccaa7471 tempest-TestStampPattern-1127543775 None] /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4ff68687-c9f5-4d47-a2bb-8312436fc4b7.a9699ac7-4a2e-4683-be0d-ec67ec8cdf63 is being set with open permissions: ugo+rw Jul 10 15:58:51 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-2f6b2b77-7698-40c8-b7d3-403cccaa7471 tempest-TestStampPattern-1127543775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4ff68687-c9f5-4d47-a2bb-8312436fc4b7.a9699ac7-4a2e-4683-be0d-ec67ec8cdf63 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:58:51 devstack sudo[98401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4ff68687-c9f5-4d47-a2bb-8312436fc4b7.a9699ac7-4a2e-4683-be0d-ec67ec8cdf63 Jul 10 15:58:51 devstack sudo[98401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:58:52 devstack sudo[98396]: pam_unix(sudo:session): session closed for user root Jul 10 15:58:52 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d7520b62-5902-4aa2-95e5-4c594fa8353b tempest-VolumesDeleteCascade-134824525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-af6dbbc9-3b53-41b0-9f86-fababba7d826" returned: 0 in 0.813s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:58:52 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d7520b62-5902-4aa2-95e5-4c594fa8353b tempest-VolumesDeleteCascade-134824525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-af6dbbc9-3b53-41b0-9f86-fababba7d826 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:58:52 devstack sudo[98408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-af6dbbc9-3b53-41b0-9f86-fababba7d826 Jul 10 15:58:52 devstack sudo[98408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:58:52 devstack sudo[98401]: pam_unix(sudo:session): session closed for user root Jul 10 15:58:52 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-2f6b2b77-7698-40c8-b7d3-403cccaa7471 tempest-TestStampPattern-1127543775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4ff68687-c9f5-4d47-a2bb-8312436fc4b7.a9699ac7-4a2e-4683-be0d-ec67ec8cdf63" returned: 0 in 0.689s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:58:52 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-2f6b2b77-7698-40c8-b7d3-403cccaa7471 tempest-TestStampPattern-1127543775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4ff68687-c9f5-4d47-a2bb-8312436fc4b7.info {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:58:52 devstack sudo[98410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4ff68687-c9f5-4d47-a2bb-8312436fc4b7.info Jul 10 15:58:52 devstack sudo[98410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:58:53 devstack sudo[98408]: pam_unix(sudo:session): session closed for user root Jul 10 15:58:53 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d7520b62-5902-4aa2-95e5-4c594fa8353b tempest-VolumesDeleteCascade-134824525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-af6dbbc9-3b53-41b0-9f86-fababba7d826" returned: 0 in 0.773s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:58:53 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-d7520b62-5902-4aa2-95e5-4c594fa8353b tempest-VolumesDeleteCascade-134824525 None] Lock "cinder-quobyte-af6dbbc9-3b53-41b0-9f86-fababba7d826" released by "delete_volume" :: held 1.666s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:58:53 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-d7520b62-5902-4aa2-95e5-4c594fa8353b tempest-VolumesDeleteCascade-134824525 None] Created reservations ['95b5088e-3f06-4e65-a5cd-8e2d71c688e6', '3218bdcd-57bb-4ca2-ad70-8d5793e9f491', 'fffe5521-77c6-4791-ae9f-2c8651950976', '5b185945-2357-4a1d-848d-7ed90343588d'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 15:58:53 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-d7520b62-5902-4aa2-95e5-4c594fa8353b tempest-VolumesDeleteCascade-134824525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:58:53 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-d7520b62-5902-4aa2-95e5-4c594fa8353b tempest-VolumesDeleteCascade-134824525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:58:53 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-d7520b62-5902-4aa2-95e5-4c594fa8353b tempest-VolumesDeleteCascade-134824525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:58:53 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-d7520b62-5902-4aa2-95e5-4c594fa8353b tempest-VolumesDeleteCascade-134824525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:58:53 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-d7520b62-5902-4aa2-95e5-4c594fa8353b tempest-VolumesDeleteCascade-134824525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:58:53 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d7520b62-5902-4aa2-95e5-4c594fa8353b tempest-VolumesDeleteCascade-134824525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:58:53 devstack sudo[98410]: pam_unix(sudo:session): session closed for user root Jul 10 15:58:53 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-2f6b2b77-7698-40c8-b7d3-403cccaa7471 tempest-TestStampPattern-1127543775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4ff68687-c9f5-4d47-a2bb-8312436fc4b7.info" returned: 0 in 0.880s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:58:53 devstack cinder-volume[87420]: WARNING cinder.volume.drivers.remotefs [None req-2f6b2b77-7698-40c8-b7d3-403cccaa7471 tempest-TestStampPattern-1127543775 None] /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4ff68687-c9f5-4d47-a2bb-8312436fc4b7.info is being set with open permissions: ugo+rw Jul 10 15:58:53 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-2f6b2b77-7698-40c8-b7d3-403cccaa7471 tempest-TestStampPattern-1127543775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4ff68687-c9f5-4d47-a2bb-8312436fc4b7.info {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:58:53 devstack sudo[98415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 15:58:53 devstack sudo[98415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:58:53 devstack sudo[98417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4ff68687-c9f5-4d47-a2bb-8312436fc4b7.info Jul 10 15:58:53 devstack sudo[98417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:58:53 devstack sudo[98415]: pam_unix(sudo:session): session closed for user root Jul 10 15:58:53 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d7520b62-5902-4aa2-95e5-4c594fa8353b tempest-VolumesDeleteCascade-134824525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.721s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:58:53 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-d7520b62-5902-4aa2-95e5-4c594fa8353b tempest-VolumesDeleteCascade-134824525 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 15:58:53 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-d7520b62-5902-4aa2-95e5-4c594fa8353b tempest-VolumesDeleteCascade-134824525 None] Deleted volume successfully. Jul 10 15:58:53 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-d7520b62-5902-4aa2-95e5-4c594fa8353b tempest-VolumesDeleteCascade-134824525 None] Lock "cinder-af6dbbc9-3b53-41b0-9f86-fababba7d826-delete_volume" released by "delete_volume" :: held 6.604s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:58:54 devstack sudo[98417]: pam_unix(sudo:session): session closed for user root Jul 10 15:58:54 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-2f6b2b77-7698-40c8-b7d3-403cccaa7471 tempest-TestStampPattern-1127543775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4ff68687-c9f5-4d47-a2bb-8312436fc4b7.info" returned: 0 in 0.792s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:58:54 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-2f6b2b77-7698-40c8-b7d3-403cccaa7471 tempest-TestStampPattern-1127543775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.084s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:58:54 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-031daa51-979c-475c-980e-a4cb3ff1f1ee tempest-VolumesSnapshotListTestJSON-1129883993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.724s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:58:54 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-031daa51-979c-475c-980e-a4cb3ff1f1ee tempest-VolumesSnapshotListTestJSON-1129883993 None] Creating offline snapshot 2e197ae7-74be-43dc-8a74-dac182419e7d of volume 000deb4b-896c-4430-8609-5e2258a4f8fa {{(pid=87420) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 15:58:54 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-2f6b2b77-7698-40c8-b7d3-403cccaa7471 tempest-TestStampPattern-1127543775 None] Create snapshot completed successfully Jul 10 15:58:54 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0daecdb-121c-4991-bf51-2763d4b35b64]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:58:54 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-031daa51-979c-475c-980e-a4cb3ff1f1ee tempest-VolumesSnapshotListTestJSON-1129883993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-000deb4b-896c-4430-8609-5e2258a4f8fa {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:58:54 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-b864b61e-c7de-4cd6-898b-44b87b33e8ae tempest-VolumesDeleteCascade-134824525 None] Acquiring lock "cinder-7970f75a-5544-42b3-9a23-7ad5eb968c66-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:58:54 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-b864b61e-c7de-4cd6-898b-44b87b33e8ae tempest-VolumesDeleteCascade-134824525 None] Lock "cinder-7970f75a-5544-42b3-9a23-7ad5eb968c66-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:58:54 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-b864b61e-c7de-4cd6-898b-44b87b33e8ae tempest-VolumesDeleteCascade-134824525 None] Acquiring lock "cinder-quobyte-7970f75a-5544-42b3-9a23-7ad5eb968c66" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:58:54 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-b864b61e-c7de-4cd6-898b-44b87b33e8ae tempest-VolumesDeleteCascade-134824525 None] Lock "cinder-quobyte-7970f75a-5544-42b3-9a23-7ad5eb968c66" acquired by "delete_volume" :: waited 0.021s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:58:54 devstack sudo[98421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-000deb4b-896c-4430-8609-5e2258a4f8fa Jul 10 15:58:54 devstack sudo[98421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:58:54 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[47e34c15-a431-45ec-b429-a53877d46741]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:58:54 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-b864b61e-c7de-4cd6-898b-44b87b33e8ae tempest-VolumesDeleteCascade-134824525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7970f75a-5544-42b3-9a23-7ad5eb968c66 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:58:54 devstack sudo[98423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7970f75a-5544-42b3-9a23-7ad5eb968c66 Jul 10 15:58:54 devstack sudo[98423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:58:55 devstack sudo[98421]: pam_unix(sudo:session): session closed for user root Jul 10 15:58:55 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-031daa51-979c-475c-980e-a4cb3ff1f1ee tempest-VolumesSnapshotListTestJSON-1129883993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-000deb4b-896c-4430-8609-5e2258a4f8fa" returned: 0 in 1.031s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:58:55 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-031daa51-979c-475c-980e-a4cb3ff1f1ee tempest-VolumesSnapshotListTestJSON-1129883993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-000deb4b-896c-4430-8609-5e2258a4f8fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-000deb4b-896c-4430-8609-5e2258a4f8fa.2e197ae7-74be-43dc-8a74-dac182419e7d 1G {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:58:55 devstack sudo[98428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-000deb4b-896c-4430-8609-5e2258a4f8fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-000deb4b-896c-4430-8609-5e2258a4f8fa.2e197ae7-74be-43dc-8a74-dac182419e7d 1G Jul 10 15:58:55 devstack sudo[98428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:58:55 devstack sudo[98423]: pam_unix(sudo:session): session closed for user root Jul 10 15:58:55 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-b864b61e-c7de-4cd6-898b-44b87b33e8ae tempest-VolumesDeleteCascade-134824525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7970f75a-5544-42b3-9a23-7ad5eb968c66" returned: 0 in 1.523s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:58:55 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-b864b61e-c7de-4cd6-898b-44b87b33e8ae tempest-VolumesDeleteCascade-134824525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7970f75a-5544-42b3-9a23-7ad5eb968c66 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:58:55 devstack sudo[98433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7970f75a-5544-42b3-9a23-7ad5eb968c66 Jul 10 15:58:55 devstack sudo[98433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:58:56 devstack sudo[98428]: pam_unix(sudo:session): session closed for user root Jul 10 15:58:56 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-031daa51-979c-475c-980e-a4cb3ff1f1ee tempest-VolumesSnapshotListTestJSON-1129883993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-000deb4b-896c-4430-8609-5e2258a4f8fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-000deb4b-896c-4430-8609-5e2258a4f8fa.2e197ae7-74be-43dc-8a74-dac182419e7d 1G" returned: 0 in 1.041s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:58:56 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-031daa51-979c-475c-980e-a4cb3ff1f1ee tempest-VolumesSnapshotListTestJSON-1129883993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-000deb4b-896c-4430-8609-5e2258a4f8fa -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-000deb4b-896c-4430-8609-5e2258a4f8fa.2e197ae7-74be-43dc-8a74-dac182419e7d {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:58:56 devstack sudo[98439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-000deb4b-896c-4430-8609-5e2258a4f8fa -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-000deb4b-896c-4430-8609-5e2258a4f8fa.2e197ae7-74be-43dc-8a74-dac182419e7d Jul 10 15:58:56 devstack sudo[98439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:58:56 devstack sudo[98433]: pam_unix(sudo:session): session closed for user root Jul 10 15:58:56 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-b864b61e-c7de-4cd6-898b-44b87b33e8ae tempest-VolumesDeleteCascade-134824525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7970f75a-5544-42b3-9a23-7ad5eb968c66" returned: 0 in 0.765s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:58:56 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-b864b61e-c7de-4cd6-898b-44b87b33e8ae tempest-VolumesDeleteCascade-134824525 None] Lock "cinder-quobyte-7970f75a-5544-42b3-9a23-7ad5eb968c66" released by "delete_volume" :: held 2.369s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:58:56 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-b864b61e-c7de-4cd6-898b-44b87b33e8ae tempest-VolumesDeleteCascade-134824525 None] Created reservations ['afb79302-4a15-48d4-b579-55747e6fde92', '5b7832c5-e20b-4ec5-ade6-0804c775332e', '327672ca-8f63-4c26-965a-ea7e4d300e54', '91115a17-507a-44e3-aa91-87964d22db5c'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 15:58:56 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-b864b61e-c7de-4cd6-898b-44b87b33e8ae tempest-VolumesDeleteCascade-134824525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:58:56 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-b864b61e-c7de-4cd6-898b-44b87b33e8ae tempest-VolumesDeleteCascade-134824525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:58:56 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-b864b61e-c7de-4cd6-898b-44b87b33e8ae tempest-VolumesDeleteCascade-134824525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:58:56 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-b864b61e-c7de-4cd6-898b-44b87b33e8ae tempest-VolumesDeleteCascade-134824525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:58:56 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-b864b61e-c7de-4cd6-898b-44b87b33e8ae tempest-VolumesDeleteCascade-134824525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:58:56 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-b864b61e-c7de-4cd6-898b-44b87b33e8ae tempest-VolumesDeleteCascade-134824525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:58:56 devstack sudo[98442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 15:58:56 devstack sudo[98442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:58:57 devstack sudo[98439]: pam_unix(sudo:session): session closed for user root Jul 10 15:58:57 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-031daa51-979c-475c-980e-a4cb3ff1f1ee tempest-VolumesSnapshotListTestJSON-1129883993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-000deb4b-896c-4430-8609-5e2258a4f8fa -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-000deb4b-896c-4430-8609-5e2258a4f8fa.2e197ae7-74be-43dc-8a74-dac182419e7d" returned: 0 in 0.884s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:58:57 devstack cinder-volume[87420]: WARNING cinder.volume.drivers.remotefs [None req-031daa51-979c-475c-980e-a4cb3ff1f1ee tempest-VolumesSnapshotListTestJSON-1129883993 None] /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-000deb4b-896c-4430-8609-5e2258a4f8fa.2e197ae7-74be-43dc-8a74-dac182419e7d is being set with open permissions: ugo+rw Jul 10 15:58:57 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-031daa51-979c-475c-980e-a4cb3ff1f1ee tempest-VolumesSnapshotListTestJSON-1129883993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-000deb4b-896c-4430-8609-5e2258a4f8fa.2e197ae7-74be-43dc-8a74-dac182419e7d {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:58:57 devstack sudo[98447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-000deb4b-896c-4430-8609-5e2258a4f8fa.2e197ae7-74be-43dc-8a74-dac182419e7d Jul 10 15:58:57 devstack sudo[98447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:58:57 devstack sudo[98442]: pam_unix(sudo:session): session closed for user root Jul 10 15:58:57 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-b864b61e-c7de-4cd6-898b-44b87b33e8ae tempest-VolumesDeleteCascade-134824525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.756s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:58:57 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-b864b61e-c7de-4cd6-898b-44b87b33e8ae tempest-VolumesDeleteCascade-134824525 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 15:58:57 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-b864b61e-c7de-4cd6-898b-44b87b33e8ae tempest-VolumesDeleteCascade-134824525 None] Deleted volume successfully. Jul 10 15:58:57 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-b864b61e-c7de-4cd6-898b-44b87b33e8ae tempest-VolumesDeleteCascade-134824525 None] Lock "cinder-7970f75a-5544-42b3-9a23-7ad5eb968c66-delete_volume" released by "delete_volume" :: held 3.490s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:58:57 devstack sudo[98447]: pam_unix(sudo:session): session closed for user root Jul 10 15:58:57 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-031daa51-979c-475c-980e-a4cb3ff1f1ee tempest-VolumesSnapshotListTestJSON-1129883993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-000deb4b-896c-4430-8609-5e2258a4f8fa.2e197ae7-74be-43dc-8a74-dac182419e7d" returned: 0 in 0.732s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:58:57 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-031daa51-979c-475c-980e-a4cb3ff1f1ee tempest-VolumesSnapshotListTestJSON-1129883993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-000deb4b-896c-4430-8609-5e2258a4f8fa.info {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:58:57 devstack sudo[98451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-000deb4b-896c-4430-8609-5e2258a4f8fa.info Jul 10 15:58:57 devstack sudo[98451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:58:58 devstack sudo[98451]: pam_unix(sudo:session): session closed for user root Jul 10 15:58:58 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-031daa51-979c-475c-980e-a4cb3ff1f1ee tempest-VolumesSnapshotListTestJSON-1129883993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-000deb4b-896c-4430-8609-5e2258a4f8fa.info" returned: 0 in 0.880s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:58:58 devstack cinder-volume[87420]: WARNING cinder.volume.drivers.remotefs [None req-031daa51-979c-475c-980e-a4cb3ff1f1ee tempest-VolumesSnapshotListTestJSON-1129883993 None] /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-000deb4b-896c-4430-8609-5e2258a4f8fa.info is being set with open permissions: ugo+rw Jul 10 15:58:58 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-031daa51-979c-475c-980e-a4cb3ff1f1ee tempest-VolumesSnapshotListTestJSON-1129883993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-000deb4b-896c-4430-8609-5e2258a4f8fa.info {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:58:58 devstack sudo[98454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-000deb4b-896c-4430-8609-5e2258a4f8fa.info Jul 10 15:58:58 devstack sudo[98454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:58:59 devstack sudo[98454]: pam_unix(sudo:session): session closed for user root Jul 10 15:58:59 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-031daa51-979c-475c-980e-a4cb3ff1f1ee tempest-VolumesSnapshotListTestJSON-1129883993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-000deb4b-896c-4430-8609-5e2258a4f8fa.info" returned: 0 in 0.834s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:58:59 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-031daa51-979c-475c-980e-a4cb3ff1f1ee tempest-VolumesSnapshotListTestJSON-1129883993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.542s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:58:59 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-031daa51-979c-475c-980e-a4cb3ff1f1ee tempest-VolumesSnapshotListTestJSON-1129883993 None] Create snapshot completed successfully Jul 10 15:59:00 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-4502355a-adcf-4904-8dd5-d62d3b3e4c26 tempest-VolumesSnapshotListTestJSON-1129883993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:59:00 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-4502355a-adcf-4904-8dd5-d62d3b3e4c26 tempest-VolumesSnapshotListTestJSON-1129883993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:59:00 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-4502355a-adcf-4904-8dd5-d62d3b3e4c26 tempest-VolumesSnapshotListTestJSON-1129883993 None] Creating offline snapshot f77918e6-53e5-424c-bf95-8d87b8b2da91 of volume 000deb4b-896c-4430-8609-5e2258a4f8fa {{(pid=87420) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 15:59:00 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[56e4b22a-b01f-4e44-9658-a4e4497f71b5]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:59:00 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4502355a-adcf-4904-8dd5-d62d3b3e4c26 tempest-VolumesSnapshotListTestJSON-1129883993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-000deb4b-896c-4430-8609-5e2258a4f8fa.2e197ae7-74be-43dc-8a74-dac182419e7d {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:59:00 devstack sudo[98494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-000deb4b-896c-4430-8609-5e2258a4f8fa.2e197ae7-74be-43dc-8a74-dac182419e7d Jul 10 15:59:00 devstack sudo[98494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:59:01 devstack sudo[98494]: pam_unix(sudo:session): session closed for user root Jul 10 15:59:01 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4502355a-adcf-4904-8dd5-d62d3b3e4c26 tempest-VolumesSnapshotListTestJSON-1129883993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-000deb4b-896c-4430-8609-5e2258a4f8fa.2e197ae7-74be-43dc-8a74-dac182419e7d" returned: 0 in 1.018s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:59:01 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-4502355a-adcf-4904-8dd5-d62d3b3e4c26 tempest-VolumesSnapshotListTestJSON-1129883993 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-000deb4b-896c-4430-8609-5e2258a4f8fa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87420) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 15:59:01 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4502355a-adcf-4904-8dd5-d62d3b3e4c26 tempest-VolumesSnapshotListTestJSON-1129883993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-000deb4b-896c-4430-8609-5e2258a4f8fa.2e197ae7-74be-43dc-8a74-dac182419e7d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-000deb4b-896c-4430-8609-5e2258a4f8fa.f77918e6-53e5-424c-bf95-8d87b8b2da91 1G {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:59:01 devstack sudo[98501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-000deb4b-896c-4430-8609-5e2258a4f8fa.2e197ae7-74be-43dc-8a74-dac182419e7d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-000deb4b-896c-4430-8609-5e2258a4f8fa.f77918e6-53e5-424c-bf95-8d87b8b2da91 1G Jul 10 15:59:01 devstack sudo[98501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:59:02 devstack sudo[98501]: pam_unix(sudo:session): session closed for user root Jul 10 15:59:02 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4502355a-adcf-4904-8dd5-d62d3b3e4c26 tempest-VolumesSnapshotListTestJSON-1129883993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-000deb4b-896c-4430-8609-5e2258a4f8fa.2e197ae7-74be-43dc-8a74-dac182419e7d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-000deb4b-896c-4430-8609-5e2258a4f8fa.f77918e6-53e5-424c-bf95-8d87b8b2da91 1G" returned: 0 in 1.183s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:59:02 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4502355a-adcf-4904-8dd5-d62d3b3e4c26 tempest-VolumesSnapshotListTestJSON-1129883993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-000deb4b-896c-4430-8609-5e2258a4f8fa.2e197ae7-74be-43dc-8a74-dac182419e7d -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-000deb4b-896c-4430-8609-5e2258a4f8fa.f77918e6-53e5-424c-bf95-8d87b8b2da91 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:59:02 devstack sudo[98507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-000deb4b-896c-4430-8609-5e2258a4f8fa.2e197ae7-74be-43dc-8a74-dac182419e7d -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-000deb4b-896c-4430-8609-5e2258a4f8fa.f77918e6-53e5-424c-bf95-8d87b8b2da91 Jul 10 15:59:02 devstack sudo[98507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:59:03 devstack sudo[98507]: pam_unix(sudo:session): session closed for user root Jul 10 15:59:03 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4502355a-adcf-4904-8dd5-d62d3b3e4c26 tempest-VolumesSnapshotListTestJSON-1129883993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-000deb4b-896c-4430-8609-5e2258a4f8fa.2e197ae7-74be-43dc-8a74-dac182419e7d -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-000deb4b-896c-4430-8609-5e2258a4f8fa.f77918e6-53e5-424c-bf95-8d87b8b2da91" returned: 0 in 0.951s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:59:03 devstack cinder-volume[87420]: WARNING cinder.volume.drivers.remotefs [None req-4502355a-adcf-4904-8dd5-d62d3b3e4c26 tempest-VolumesSnapshotListTestJSON-1129883993 None] /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-000deb4b-896c-4430-8609-5e2258a4f8fa.f77918e6-53e5-424c-bf95-8d87b8b2da91 is being set with open permissions: ugo+rw Jul 10 15:59:03 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4502355a-adcf-4904-8dd5-d62d3b3e4c26 tempest-VolumesSnapshotListTestJSON-1129883993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-000deb4b-896c-4430-8609-5e2258a4f8fa.f77918e6-53e5-424c-bf95-8d87b8b2da91 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:59:03 devstack sudo[98515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-000deb4b-896c-4430-8609-5e2258a4f8fa.f77918e6-53e5-424c-bf95-8d87b8b2da91 Jul 10 15:59:03 devstack sudo[98515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:59:03 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-8653ce23-2527-432b-a3da-7d869bbdaa69 tempest-VolumesTransfersTest-1474644828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 15:59:03 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-8653ce23-2527-432b-a3da-7d869bbdaa69 tempest-VolumesTransfersTest-1474644828 None] Flow 'volume_create_manager' (2568e4e2-248c-425f-812d-2fb525934a1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:59:03 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-8653ce23-2527-432b-a3da-7d869bbdaa69 tempest-VolumesTransfersTest-1474644828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48d99372-9bbb-4dcb-a670-97bc48fd6024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:59:03 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-8653ce23-2527-432b-a3da-7d869bbdaa69 tempest-VolumesTransfersTest-1474644828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48d99372-9bbb-4dcb-a670-97bc48fd6024) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:59:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1416716687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2801f729-dad7-4105-a4e1-cf4d0237dd79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba1546a44c8d4e429e723fa1522159e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:59:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:59:04Z,use_quota=True,user_id='347b5ca5e25b4f3aba6e8e36e82387ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:59:03 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-8653ce23-2527-432b-a3da-7d869bbdaa69 tempest-VolumesTransfersTest-1474644828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2326ca17-07d7-43c0-a69b-cdf8aa6a38ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:59:03 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-8653ce23-2527-432b-a3da-7d869bbdaa69 tempest-VolumesTransfersTest-1474644828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2326ca17-07d7-43c0-a69b-cdf8aa6a38ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:59:03 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-8653ce23-2527-432b-a3da-7d869bbdaa69 tempest-VolumesTransfersTest-1474644828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f01325f-bc5c-4428-9b08-d87d4b3d6bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:59:04 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-8653ce23-2527-432b-a3da-7d869bbdaa69 tempest-VolumesTransfersTest-1474644828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f01325f-bc5c-4428-9b08-d87d4b3d6bc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2801f729-dad7-4105-a4e1-cf4d0237dd79', 'volume_name': 'volume-2801f729-dad7-4105-a4e1-cf4d0237dd79', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:59:04 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-8653ce23-2527-432b-a3da-7d869bbdaa69 tempest-VolumesTransfersTest-1474644828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6037610b-1857-40dd-af66-7e8f2dc2d09f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:59:04 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-8653ce23-2527-432b-a3da-7d869bbdaa69 tempest-VolumesTransfersTest-1474644828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6037610b-1857-40dd-af66-7e8f2dc2d09f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:59:04 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-8653ce23-2527-432b-a3da-7d869bbdaa69 tempest-VolumesTransfersTest-1474644828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ec55149-3ef7-4814-b0dd-ba16070d352d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:59:04 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-8653ce23-2527-432b-a3da-7d869bbdaa69 tempest-VolumesTransfersTest-1474644828 None] Volume 2801f729-dad7-4105-a4e1-cf4d0237dd79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2801f729-dad7-4105-a4e1-cf4d0237dd79', 'volume_size': 1} Jul 10 15:59:04 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-8653ce23-2527-432b-a3da-7d869bbdaa69 tempest-VolumesTransfersTest-1474644828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:59:04 devstack sudo[98515]: pam_unix(sudo:session): session closed for user root Jul 10 15:59:04 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4502355a-adcf-4904-8dd5-d62d3b3e4c26 tempest-VolumesSnapshotListTestJSON-1129883993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-000deb4b-896c-4430-8609-5e2258a4f8fa.f77918e6-53e5-424c-bf95-8d87b8b2da91" returned: 0 in 1.003s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:59:04 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-4502355a-adcf-4904-8dd5-d62d3b3e4c26 tempest-VolumesSnapshotListTestJSON-1129883993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.290s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:59:04 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-8653ce23-2527-432b-a3da-7d869bbdaa69 tempest-VolumesTransfersTest-1474644828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.360s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:59:04 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-8653ce23-2527-432b-a3da-7d869bbdaa69 tempest-VolumesTransfersTest-1474644828 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:59:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1416716687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2801f729-dad7-4105-a4e1-cf4d0237dd79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba1546a44c8d4e429e723fa1522159e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:59:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:59:04Z,use_quota=True,user_id='347b5ca5e25b4f3aba6e8e36e82387ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 15:59:04 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-8653ce23-2527-432b-a3da-7d869bbdaa69 tempest-VolumesTransfersTest-1474644828 None] Creating volume 2801f729-dad7-4105-a4e1-cf4d0237dd79 {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 15:59:04 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-8653ce23-2527-432b-a3da-7d869bbdaa69 tempest-VolumesTransfersTest-1474644828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:59:04 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-8653ce23-2527-432b-a3da-7d869bbdaa69 tempest-VolumesTransfersTest-1474644828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:59:04 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-8653ce23-2527-432b-a3da-7d869bbdaa69 tempest-VolumesTransfersTest-1474644828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:59:04 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-8653ce23-2527-432b-a3da-7d869bbdaa69 tempest-VolumesTransfersTest-1474644828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:59:04 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-8653ce23-2527-432b-a3da-7d869bbdaa69 tempest-VolumesTransfersTest-1474644828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:59:04 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-8653ce23-2527-432b-a3da-7d869bbdaa69 tempest-VolumesTransfersTest-1474644828 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 15:59:04 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-8653ce23-2527-432b-a3da-7d869bbdaa69 tempest-VolumesTransfersTest-1474644828 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 15:59:04 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8653ce23-2527-432b-a3da-7d869bbdaa69 tempest-VolumesTransfersTest-1474644828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-2801f729-dad7-4105-a4e1-cf4d0237dd79 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:59:04 devstack sudo[98518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-2801f729-dad7-4105-a4e1-cf4d0237dd79 1073741824 Jul 10 15:59:04 devstack sudo[98518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:59:04 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-4502355a-adcf-4904-8dd5-d62d3b3e4c26 tempest-VolumesSnapshotListTestJSON-1129883993 None] Create snapshot completed successfully Jul 10 15:59:05 devstack sudo[98518]: pam_unix(sudo:session): session closed for user root Jul 10 15:59:05 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8653ce23-2527-432b-a3da-7d869bbdaa69 tempest-VolumesTransfersTest-1474644828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-2801f729-dad7-4105-a4e1-cf4d0237dd79 1073741824" returned: 0 in 1.103s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:59:05 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8653ce23-2527-432b-a3da-7d869bbdaa69 tempest-VolumesTransfersTest-1474644828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-2801f729-dad7-4105-a4e1-cf4d0237dd79 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:59:05 devstack sudo[98523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-2801f729-dad7-4105-a4e1-cf4d0237dd79 Jul 10 15:59:05 devstack sudo[98523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:59:05 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-65380860-9d98-4b7d-b44d-5f3386825537 tempest-VolumesSnapshotListTestJSON-1129883993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:59:06 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-e38ba5d2-45a6-4fe7-b7b3-8b9fe6b2b7d3 tempest-TestStampPattern-1127543775 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 15:59:06 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-e38ba5d2-45a6-4fe7-b7b3-8b9fe6b2b7d3 tempest-TestStampPattern-1127543775 None] Flow 'volume_create_manager' (997db525-6b44-4a41-a72d-c8ab843813df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:59:06 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-e38ba5d2-45a6-4fe7-b7b3-8b9fe6b2b7d3 tempest-TestStampPattern-1127543775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f3d9d77-a4f6-4886-862e-873f873a495f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:59:06 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-e38ba5d2-45a6-4fe7-b7b3-8b9fe6b2b7d3 tempest-TestStampPattern-1127543775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f3d9d77-a4f6-4886-862e-873f873a495f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:59:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-917053510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=894f402d-cb97-4505-b7f9-5c40607bb703,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79fd7a10e9f64c09b86479308e5b43db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:59:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a9699ac7-4a2e-4683-be0d-ec67ec8cdf63,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:59:06Z,use_quota=True,user_id='6776f875785d4191bc9300d8de644c9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:59:06 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-e38ba5d2-45a6-4fe7-b7b3-8b9fe6b2b7d3 tempest-TestStampPattern-1127543775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b66d10a-7117-4e1a-89b7-6721290e0be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:59:06 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-e38ba5d2-45a6-4fe7-b7b3-8b9fe6b2b7d3 tempest-TestStampPattern-1127543775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b66d10a-7117-4e1a-89b7-6721290e0be8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:59:06 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-e38ba5d2-45a6-4fe7-b7b3-8b9fe6b2b7d3 tempest-TestStampPattern-1127543775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ba75123-413c-40e5-a083-83d96eeeffd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:59:06 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-e38ba5d2-45a6-4fe7-b7b3-8b9fe6b2b7d3 tempest-TestStampPattern-1127543775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ba75123-413c-40e5-a083-83d96eeeffd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '894f402d-cb97-4505-b7f9-5c40607bb703', 'volume_name': 'volume-894f402d-cb97-4505-b7f9-5c40607bb703', 'volume_size': 1, 'snapshot_id': 'a9699ac7-4a2e-4683-be0d-ec67ec8cdf63'}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:59:06 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-e38ba5d2-45a6-4fe7-b7b3-8b9fe6b2b7d3 tempest-TestStampPattern-1127543775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44fd0713-4c7a-49b8-83ca-1b1ffde19f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:59:06 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-e38ba5d2-45a6-4fe7-b7b3-8b9fe6b2b7d3 tempest-TestStampPattern-1127543775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44fd0713-4c7a-49b8-83ca-1b1ffde19f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:59:06 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-e38ba5d2-45a6-4fe7-b7b3-8b9fe6b2b7d3 tempest-TestStampPattern-1127543775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (545c2637-620c-42f7-a4a2-f39e66c9574f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:59:06 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-e38ba5d2-45a6-4fe7-b7b3-8b9fe6b2b7d3 tempest-TestStampPattern-1127543775 None] Volume 894f402d-cb97-4505-b7f9-5c40607bb703: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-894f402d-cb97-4505-b7f9-5c40607bb703', 'volume_size': 1, 'snapshot_id': 'a9699ac7-4a2e-4683-be0d-ec67ec8cdf63'} Jul 10 15:59:06 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-e38ba5d2-45a6-4fe7-b7b3-8b9fe6b2b7d3 tempest-TestStampPattern-1127543775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:59:06 devstack sudo[98523]: pam_unix(sudo:session): session closed for user root Jul 10 15:59:06 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8653ce23-2527-432b-a3da-7d869bbdaa69 tempest-VolumesTransfersTest-1474644828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-2801f729-dad7-4105-a4e1-cf4d0237dd79" returned: 0 in 0.883s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:59:06 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-8653ce23-2527-432b-a3da-7d869bbdaa69 tempest-VolumesTransfersTest-1474644828 None] <== create_volume: return (2055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 15:59:06 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-8653ce23-2527-432b-a3da-7d869bbdaa69 tempest-VolumesTransfersTest-1474644828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.059s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:59:06 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-65380860-9d98-4b7d-b44d-5f3386825537 tempest-VolumesSnapshotListTestJSON-1129883993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.719s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:59:06 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-8653ce23-2527-432b-a3da-7d869bbdaa69 tempest-VolumesTransfersTest-1474644828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ec55149-3ef7-4814-b0dd-ba16070d352d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2801f729-dad7-4105-a4e1-cf4d0237dd79', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:59:06 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-8653ce23-2527-432b-a3da-7d869bbdaa69 tempest-VolumesTransfersTest-1474644828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d440d6e9-587b-4103-af54-7573a92b4685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:59:06 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-65380860-9d98-4b7d-b44d-5f3386825537 tempest-VolumesSnapshotListTestJSON-1129883993 None] Creating offline snapshot 2611c20e-8045-4868-9170-dea61e2a9176 of volume 000deb4b-896c-4430-8609-5e2258a4f8fa {{(pid=87420) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 15:59:06 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-8653ce23-2527-432b-a3da-7d869bbdaa69 tempest-VolumesTransfersTest-1474644828 None] Volume volume-2801f729-dad7-4105-a4e1-cf4d0237dd79 (2801f729-dad7-4105-a4e1-cf4d0237dd79): created successfully Jul 10 15:59:06 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-8653ce23-2527-432b-a3da-7d869bbdaa69 tempest-VolumesTransfersTest-1474644828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d440d6e9-587b-4103-af54-7573a92b4685) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:59:06 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-8653ce23-2527-432b-a3da-7d869bbdaa69 tempest-VolumesTransfersTest-1474644828 None] Flow 'volume_create_manager' (2568e4e2-248c-425f-812d-2fb525934a1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:59:06 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc894aac-f239-481b-94ae-c8443a4fb14c]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:59:06 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-65380860-9d98-4b7d-b44d-5f3386825537 tempest-VolumesSnapshotListTestJSON-1129883993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-000deb4b-896c-4430-8609-5e2258a4f8fa.f77918e6-53e5-424c-bf95-8d87b8b2da91 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:59:06 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-8653ce23-2527-432b-a3da-7d869bbdaa69 tempest-VolumesTransfersTest-1474644828 None] Created volume successfully. Jul 10 15:59:06 devstack sudo[98526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-000deb4b-896c-4430-8609-5e2258a4f8fa.f77918e6-53e5-424c-bf95-8d87b8b2da91 Jul 10 15:59:06 devstack sudo[98526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:59:07 devstack sudo[98526]: pam_unix(sudo:session): session closed for user root Jul 10 15:59:07 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-65380860-9d98-4b7d-b44d-5f3386825537 tempest-VolumesSnapshotListTestJSON-1129883993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-000deb4b-896c-4430-8609-5e2258a4f8fa.f77918e6-53e5-424c-bf95-8d87b8b2da91" returned: 0 in 1.239s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:59:07 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-65380860-9d98-4b7d-b44d-5f3386825537 tempest-VolumesSnapshotListTestJSON-1129883993 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-000deb4b-896c-4430-8609-5e2258a4f8fa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87420) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 15:59:07 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-65380860-9d98-4b7d-b44d-5f3386825537 tempest-VolumesSnapshotListTestJSON-1129883993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-000deb4b-896c-4430-8609-5e2258a4f8fa.f77918e6-53e5-424c-bf95-8d87b8b2da91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-000deb4b-896c-4430-8609-5e2258a4f8fa.2611c20e-8045-4868-9170-dea61e2a9176 1G {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:59:07 devstack sudo[98531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-000deb4b-896c-4430-8609-5e2258a4f8fa.f77918e6-53e5-424c-bf95-8d87b8b2da91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-000deb4b-896c-4430-8609-5e2258a4f8fa.2611c20e-8045-4868-9170-dea61e2a9176 1G Jul 10 15:59:07 devstack sudo[98531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:59:08 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-770370ef-c069-4a0b-a444-edc337c8064d tempest-VolumesTransfersTest-32367074 None] Transfer volume completed successfully. Jul 10 15:59:09 devstack sudo[98531]: pam_unix(sudo:session): session closed for user root Jul 10 15:59:09 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-65380860-9d98-4b7d-b44d-5f3386825537 tempest-VolumesSnapshotListTestJSON-1129883993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-000deb4b-896c-4430-8609-5e2258a4f8fa.f77918e6-53e5-424c-bf95-8d87b8b2da91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-000deb4b-896c-4430-8609-5e2258a4f8fa.2611c20e-8045-4868-9170-dea61e2a9176 1G" returned: 0 in 1.366s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:59:09 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-65380860-9d98-4b7d-b44d-5f3386825537 tempest-VolumesSnapshotListTestJSON-1129883993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-000deb4b-896c-4430-8609-5e2258a4f8fa.f77918e6-53e5-424c-bf95-8d87b8b2da91 -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-000deb4b-896c-4430-8609-5e2258a4f8fa.2611c20e-8045-4868-9170-dea61e2a9176 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:59:09 devstack sudo[98548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-000deb4b-896c-4430-8609-5e2258a4f8fa.f77918e6-53e5-424c-bf95-8d87b8b2da91 -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-000deb4b-896c-4430-8609-5e2258a4f8fa.2611c20e-8045-4868-9170-dea61e2a9176 Jul 10 15:59:09 devstack sudo[98548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:59:09 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-315e2040-dcb5-4eda-9239-d76b84ef45e0 tempest-VolumesTransfersTest-506720907 None] Acquiring lock "cinder-2801f729-dad7-4105-a4e1-cf4d0237dd79-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:59:09 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-315e2040-dcb5-4eda-9239-d76b84ef45e0 tempest-VolumesTransfersTest-506720907 None] Lock "cinder-2801f729-dad7-4105-a4e1-cf4d0237dd79-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:59:09 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-315e2040-dcb5-4eda-9239-d76b84ef45e0 tempest-VolumesTransfersTest-506720907 None] Acquiring lock "cinder-quobyte-2801f729-dad7-4105-a4e1-cf4d0237dd79" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:59:09 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-315e2040-dcb5-4eda-9239-d76b84ef45e0 tempest-VolumesTransfersTest-506720907 None] Lock "cinder-quobyte-2801f729-dad7-4105-a4e1-cf4d0237dd79" acquired by "delete_volume" :: waited 0.034s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:59:09 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ba864f4-e00d-4c41-9501-212741ce3280]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:59:09 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-315e2040-dcb5-4eda-9239-d76b84ef45e0 tempest-VolumesTransfersTest-506720907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-2801f729-dad7-4105-a4e1-cf4d0237dd79 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:59:09 devstack sudo[98550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-2801f729-dad7-4105-a4e1-cf4d0237dd79 Jul 10 15:59:09 devstack sudo[98550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:59:10 devstack sudo[98548]: pam_unix(sudo:session): session closed for user root Jul 10 15:59:10 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-65380860-9d98-4b7d-b44d-5f3386825537 tempest-VolumesSnapshotListTestJSON-1129883993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-000deb4b-896c-4430-8609-5e2258a4f8fa.f77918e6-53e5-424c-bf95-8d87b8b2da91 -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-000deb4b-896c-4430-8609-5e2258a4f8fa.2611c20e-8045-4868-9170-dea61e2a9176" returned: 0 in 1.097s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:59:10 devstack cinder-volume[87420]: WARNING cinder.volume.drivers.remotefs [None req-65380860-9d98-4b7d-b44d-5f3386825537 tempest-VolumesSnapshotListTestJSON-1129883993 None] /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-000deb4b-896c-4430-8609-5e2258a4f8fa.2611c20e-8045-4868-9170-dea61e2a9176 is being set with open permissions: ugo+rw Jul 10 15:59:10 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-65380860-9d98-4b7d-b44d-5f3386825537 tempest-VolumesSnapshotListTestJSON-1129883993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-000deb4b-896c-4430-8609-5e2258a4f8fa.2611c20e-8045-4868-9170-dea61e2a9176 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:59:10 devstack sudo[98555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-000deb4b-896c-4430-8609-5e2258a4f8fa.2611c20e-8045-4868-9170-dea61e2a9176 Jul 10 15:59:10 devstack sudo[98555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:59:10 devstack sudo[98550]: pam_unix(sudo:session): session closed for user root Jul 10 15:59:10 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-315e2040-dcb5-4eda-9239-d76b84ef45e0 tempest-VolumesTransfersTest-506720907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-2801f729-dad7-4105-a4e1-cf4d0237dd79" returned: 0 in 1.118s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:59:10 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-315e2040-dcb5-4eda-9239-d76b84ef45e0 tempest-VolumesTransfersTest-506720907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-2801f729-dad7-4105-a4e1-cf4d0237dd79 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:59:10 devstack sudo[98560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-2801f729-dad7-4105-a4e1-cf4d0237dd79 Jul 10 15:59:10 devstack sudo[98560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:59:11 devstack sudo[98555]: pam_unix(sudo:session): session closed for user root Jul 10 15:59:11 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-65380860-9d98-4b7d-b44d-5f3386825537 tempest-VolumesSnapshotListTestJSON-1129883993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-000deb4b-896c-4430-8609-5e2258a4f8fa.2611c20e-8045-4868-9170-dea61e2a9176" returned: 0 in 1.043s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:59:11 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-65380860-9d98-4b7d-b44d-5f3386825537 tempest-VolumesSnapshotListTestJSON-1129883993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.907s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:59:11 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-e38ba5d2-45a6-4fe7-b7b3-8b9fe6b2b7d3 tempest-TestStampPattern-1127543775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 5.019s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:59:11 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-e38ba5d2-45a6-4fe7-b7b3-8b9fe6b2b7d3 tempest-TestStampPattern-1127543775 None] Acquiring lock "cinder-quobyte-a9699ac7-4a2e-4683-be0d-ec67ec8cdf63-894f402d-cb97-4505-b7f9-5c40607bb703" by "_create_volume_from_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:59:11 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-e38ba5d2-45a6-4fe7-b7b3-8b9fe6b2b7d3 tempest-TestStampPattern-1127543775 None] Lock "cinder-quobyte-a9699ac7-4a2e-4683-be0d-ec67ec8cdf63-894f402d-cb97-4505-b7f9-5c40607bb703" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:59:11 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-e38ba5d2-45a6-4fe7-b7b3-8b9fe6b2b7d3 tempest-TestStampPattern-1127543775 None] Creating volume 894f402d-cb97-4505-b7f9-5c40607bb703 from snapshot a9699ac7-4a2e-4683-be0d-ec67ec8cdf63 {{(pid=87420) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 10 15:59:11 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-e38ba5d2-45a6-4fe7-b7b3-8b9fe6b2b7d3 tempest-TestStampPattern-1127543775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:59:11 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-e38ba5d2-45a6-4fe7-b7b3-8b9fe6b2b7d3 tempest-TestStampPattern-1127543775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:59:11 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-e38ba5d2-45a6-4fe7-b7b3-8b9fe6b2b7d3 tempest-TestStampPattern-1127543775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:59:11 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-e38ba5d2-45a6-4fe7-b7b3-8b9fe6b2b7d3 tempest-TestStampPattern-1127543775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:59:11 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-e38ba5d2-45a6-4fe7-b7b3-8b9fe6b2b7d3 tempest-TestStampPattern-1127543775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:59:11 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-e38ba5d2-45a6-4fe7-b7b3-8b9fe6b2b7d3 tempest-TestStampPattern-1127543775 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 15:59:11 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-e38ba5d2-45a6-4fe7-b7b3-8b9fe6b2b7d3 tempest-TestStampPattern-1127543775 None] Acquiring lock "cinder-quobyte-894f402d-cb97-4505-b7f9-5c40607bb703" by "_copy_volume_from_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:59:11 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-65380860-9d98-4b7d-b44d-5f3386825537 tempest-VolumesSnapshotListTestJSON-1129883993 None] Create snapshot completed successfully Jul 10 15:59:11 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-e38ba5d2-45a6-4fe7-b7b3-8b9fe6b2b7d3 tempest-TestStampPattern-1127543775 None] Lock "cinder-quobyte-894f402d-cb97-4505-b7f9-5c40607bb703" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:59:11 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-e38ba5d2-45a6-4fe7-b7b3-8b9fe6b2b7d3 tempest-TestStampPattern-1127543775 None] snapshot: a9699ac7-4a2e-4683-be0d-ec67ec8cdf63, volume: 894f402d-cb97-4505-b7f9-5c40607bb703, {{(pid=87420) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 15:59:11 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-e38ba5d2-45a6-4fe7-b7b3-8b9fe6b2b7d3 tempest-TestStampPattern-1127543775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:59:11 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-e38ba5d2-45a6-4fe7-b7b3-8b9fe6b2b7d3 tempest-TestStampPattern-1127543775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:59:11 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-e38ba5d2-45a6-4fe7-b7b3-8b9fe6b2b7d3 tempest-TestStampPattern-1127543775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:59:11 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-e38ba5d2-45a6-4fe7-b7b3-8b9fe6b2b7d3 tempest-TestStampPattern-1127543775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:59:11 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-e38ba5d2-45a6-4fe7-b7b3-8b9fe6b2b7d3 tempest-TestStampPattern-1127543775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:59:11 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[dec01c58-412e-4feb-b933-8e4696ef9d3a]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:59:11 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-e38ba5d2-45a6-4fe7-b7b3-8b9fe6b2b7d3 tempest-TestStampPattern-1127543775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4ff68687-c9f5-4d47-a2bb-8312436fc4b7.a9699ac7-4a2e-4683-be0d-ec67ec8cdf63 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:59:11 devstack sudo[98560]: pam_unix(sudo:session): session closed for user root Jul 10 15:59:11 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-315e2040-dcb5-4eda-9239-d76b84ef45e0 tempest-VolumesTransfersTest-506720907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-2801f729-dad7-4105-a4e1-cf4d0237dd79" returned: 0 in 0.836s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:59:11 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-315e2040-dcb5-4eda-9239-d76b84ef45e0 tempest-VolumesTransfersTest-506720907 None] Lock "cinder-quobyte-2801f729-dad7-4105-a4e1-cf4d0237dd79" released by "delete_volume" :: held 2.026s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:59:11 devstack sudo[98564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4ff68687-c9f5-4d47-a2bb-8312436fc4b7.a9699ac7-4a2e-4683-be0d-ec67ec8cdf63 Jul 10 15:59:11 devstack sudo[98564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:59:11 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-315e2040-dcb5-4eda-9239-d76b84ef45e0 tempest-VolumesTransfersTest-506720907 None] Created reservations ['008c3d8a-3c8b-4dc1-a6c5-b4916e2a6414', '3733f586-1fef-44ca-8bcf-7e3f3a32b7be', '5996b9cf-debc-4368-991f-e3cb73f0e740', 'fa487c4b-4d4e-4071-a7e5-1de91051e35b'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 15:59:11 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-315e2040-dcb5-4eda-9239-d76b84ef45e0 tempest-VolumesTransfersTest-506720907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:59:11 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-315e2040-dcb5-4eda-9239-d76b84ef45e0 tempest-VolumesTransfersTest-506720907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:59:11 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-315e2040-dcb5-4eda-9239-d76b84ef45e0 tempest-VolumesTransfersTest-506720907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:59:11 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-315e2040-dcb5-4eda-9239-d76b84ef45e0 tempest-VolumesTransfersTest-506720907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:59:11 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-315e2040-dcb5-4eda-9239-d76b84ef45e0 tempest-VolumesTransfersTest-506720907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:59:11 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-315e2040-dcb5-4eda-9239-d76b84ef45e0 tempest-VolumesTransfersTest-506720907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:59:11 devstack sudo[98566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 15:59:11 devstack sudo[98566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:59:12 devstack sudo[98564]: pam_unix(sudo:session): session closed for user root Jul 10 15:59:12 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-e38ba5d2-45a6-4fe7-b7b3-8b9fe6b2b7d3 tempest-TestStampPattern-1127543775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4ff68687-c9f5-4d47-a2bb-8312436fc4b7.a9699ac7-4a2e-4683-be0d-ec67ec8cdf63" returned: 0 in 1.128s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:59:12 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-e38ba5d2-45a6-4fe7-b7b3-8b9fe6b2b7d3 tempest-TestStampPattern-1127543775 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ff68687-c9f5-4d47-a2bb-8312436fc4b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87420) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 15:59:12 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-e38ba5d2-45a6-4fe7-b7b3-8b9fe6b2b7d3 tempest-TestStampPattern-1127543775 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4ff68687-c9f5-4d47-a2bb-8312436fc4b7 {{(pid=87420) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 15:59:12 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-e38ba5d2-45a6-4fe7-b7b3-8b9fe6b2b7d3 tempest-TestStampPattern-1127543775 None] Creating direct copy from snapshot {{(pid=87420) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 15:59:12 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb93cfc2-a87b-4245-af1e-fdc80564302d tempest-VolumesTransfersTest-1474644828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 15:59:12 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-fb93cfc2-a87b-4245-af1e-fdc80564302d tempest-VolumesTransfersTest-1474644828 None] Flow 'volume_create_manager' (91cdc1f3-9929-4c35-a8b6-8325e1fc3c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:59:12 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-fb93cfc2-a87b-4245-af1e-fdc80564302d tempest-VolumesTransfersTest-1474644828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (360a79f2-fcbe-4217-9c29-6f06072af08f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:59:12 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[29f7eff5-71ad-406d-bb17-1c925850d425]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:59:12 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-e38ba5d2-45a6-4fe7-b7b3-8b9fe6b2b7d3 tempest-TestStampPattern-1127543775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4ff68687-c9f5-4d47-a2bb-8312436fc4b7 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:59:12 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-fb93cfc2-a87b-4245-af1e-fdc80564302d tempest-VolumesTransfersTest-1474644828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (360a79f2-fcbe-4217-9c29-6f06072af08f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:59:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1614980632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5df7fd2-15a0-4457-afab-94f1e5716bc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba1546a44c8d4e429e723fa1522159e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:59:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:59:13Z,use_quota=True,user_id='347b5ca5e25b4f3aba6e8e36e82387ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:59:12 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-fb93cfc2-a87b-4245-af1e-fdc80564302d tempest-VolumesTransfersTest-1474644828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4993fe20-203a-4cbd-bcf5-b38343b34f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:59:12 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-fb93cfc2-a87b-4245-af1e-fdc80564302d tempest-VolumesTransfersTest-1474644828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4993fe20-203a-4cbd-bcf5-b38343b34f35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:59:12 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-fb93cfc2-a87b-4245-af1e-fdc80564302d tempest-VolumesTransfersTest-1474644828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe18f1ab-2bcc-4776-8019-440f7c26bb68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:59:12 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-fb93cfc2-a87b-4245-af1e-fdc80564302d tempest-VolumesTransfersTest-1474644828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe18f1ab-2bcc-4776-8019-440f7c26bb68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5df7fd2-15a0-4457-afab-94f1e5716bc9', 'volume_name': 'volume-c5df7fd2-15a0-4457-afab-94f1e5716bc9', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:59:12 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-fb93cfc2-a87b-4245-af1e-fdc80564302d tempest-VolumesTransfersTest-1474644828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0430b9d5-03d5-4d7d-8992-b650d35baaea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:59:12 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-fb93cfc2-a87b-4245-af1e-fdc80564302d tempest-VolumesTransfersTest-1474644828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0430b9d5-03d5-4d7d-8992-b650d35baaea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:59:12 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-fb93cfc2-a87b-4245-af1e-fdc80564302d tempest-VolumesTransfersTest-1474644828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7af62ea8-c749-4e1a-b5d3-8797226b2ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:59:12 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-fb93cfc2-a87b-4245-af1e-fdc80564302d tempest-VolumesTransfersTest-1474644828 None] Volume c5df7fd2-15a0-4457-afab-94f1e5716bc9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5df7fd2-15a0-4457-afab-94f1e5716bc9', 'volume_size': 1} Jul 10 15:59:12 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-fb93cfc2-a87b-4245-af1e-fdc80564302d tempest-VolumesTransfersTest-1474644828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:59:12 devstack sudo[98574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4ff68687-c9f5-4d47-a2bb-8312436fc4b7 Jul 10 15:59:12 devstack sudo[98574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:59:12 devstack sudo[98566]: pam_unix(sudo:session): session closed for user root Jul 10 15:59:12 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-315e2040-dcb5-4eda-9239-d76b84ef45e0 tempest-VolumesTransfersTest-506720907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 1.126s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:59:12 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-315e2040-dcb5-4eda-9239-d76b84ef45e0 tempest-VolumesTransfersTest-506720907 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 15:59:12 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-315e2040-dcb5-4eda-9239-d76b84ef45e0 tempest-VolumesTransfersTest-506720907 None] Deleted volume successfully. Jul 10 15:59:12 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-315e2040-dcb5-4eda-9239-d76b84ef45e0 tempest-VolumesTransfersTest-506720907 None] Lock "cinder-2801f729-dad7-4105-a4e1-cf4d0237dd79-delete_volume" released by "delete_volume" :: held 3.474s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:59:13 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-4f712b11-8554-4f77-b81b-7deea503e01f tempest-VolumesSnapshotListTestJSON-1129883993 None] Acquiring lock "cinder-2611c20e-8045-4868-9170-dea61e2a9176-delete_snapshot" by "delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:59:13 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-4f712b11-8554-4f77-b81b-7deea503e01f tempest-VolumesSnapshotListTestJSON-1129883993 None] Lock "cinder-2611c20e-8045-4868-9170-dea61e2a9176-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:59:13 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-4f712b11-8554-4f77-b81b-7deea503e01f tempest-VolumesSnapshotListTestJSON-1129883993 None] Acquiring lock "cinder-quobyte-000deb4b-896c-4430-8609-5e2258a4f8fa" by "delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:59:13 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-4f712b11-8554-4f77-b81b-7deea503e01f tempest-VolumesSnapshotListTestJSON-1129883993 None] Lock "cinder-quobyte-000deb4b-896c-4430-8609-5e2258a4f8fa" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:59:13 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-4f712b11-8554-4f77-b81b-7deea503e01f tempest-VolumesSnapshotListTestJSON-1129883993 None] Acquiring lock "cinder-quobyte-2611c20e-8045-4868-9170-dea61e2a9176" by "_delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:59:13 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-4f712b11-8554-4f77-b81b-7deea503e01f tempest-VolumesSnapshotListTestJSON-1129883993 None] Lock "cinder-quobyte-2611c20e-8045-4868-9170-dea61e2a9176" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:59:13 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-4f712b11-8554-4f77-b81b-7deea503e01f tempest-VolumesSnapshotListTestJSON-1129883993 None] Deleting offline snapshot 2611c20e-8045-4868-9170-dea61e2a9176 of volume 000deb4b-896c-4430-8609-5e2258a4f8fa {{(pid=87420) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 15:59:13 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-4f712b11-8554-4f77-b81b-7deea503e01f tempest-VolumesSnapshotListTestJSON-1129883993 None] snapshot_file for this snap is: volume-000deb4b-896c-4430-8609-5e2258a4f8fa.2611c20e-8045-4868-9170-dea61e2a9176 {{(pid=87420) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 15:59:13 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f18b5c-9f04-4f70-a36d-c640dd337f8f]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:59:13 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4f712b11-8554-4f77-b81b-7deea503e01f tempest-VolumesSnapshotListTestJSON-1129883993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-000deb4b-896c-4430-8609-5e2258a4f8fa.2611c20e-8045-4868-9170-dea61e2a9176 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:59:13 devstack sudo[98574]: pam_unix(sudo:session): session closed for user root Jul 10 15:59:13 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-e38ba5d2-45a6-4fe7-b7b3-8b9fe6b2b7d3 tempest-TestStampPattern-1127543775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4ff68687-c9f5-4d47-a2bb-8312436fc4b7" returned: 0 in 0.951s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:59:13 devstack cinder-volume[87420]: DEBUG cinder.utils [None req-e38ba5d2-45a6-4fe7-b7b3-8b9fe6b2b7d3 tempest-TestStampPattern-1127543775 None] Path /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-894f402d-cb97-4505-b7f9-5c40607bb703 not found in is_blk_device check {{(pid=87420) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 15:59:13 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-e38ba5d2-45a6-4fe7-b7b3-8b9fe6b2b7d3 tempest-TestStampPattern-1127543775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4ff68687-c9f5-4d47-a2bb-8312436fc4b7 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-894f402d-cb97-4505-b7f9-5c40607bb703 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:59:13 devstack sudo[98582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4ff68687-c9f5-4d47-a2bb-8312436fc4b7 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-894f402d-cb97-4505-b7f9-5c40607bb703 Jul 10 15:59:13 devstack sudo[98582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:59:13 devstack sudo[98581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-000deb4b-896c-4430-8609-5e2258a4f8fa.2611c20e-8045-4868-9170-dea61e2a9176 Jul 10 15:59:13 devstack sudo[98581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:59:14 devstack sudo[98581]: pam_unix(sudo:session): session closed for user root Jul 10 15:59:14 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4f712b11-8554-4f77-b81b-7deea503e01f tempest-VolumesSnapshotListTestJSON-1129883993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-000deb4b-896c-4430-8609-5e2258a4f8fa.2611c20e-8045-4868-9170-dea61e2a9176" returned: 0 in 0.842s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:59:14 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-4f712b11-8554-4f77-b81b-7deea503e01f tempest-VolumesSnapshotListTestJSON-1129883993 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-000deb4b-896c-4430-8609-5e2258a4f8fa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87420) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 15:59:14 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[e62c2475-8f62-44c8-a8cb-9d29d30ccde7]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:59:14 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4f712b11-8554-4f77-b81b-7deea503e01f tempest-VolumesSnapshotListTestJSON-1129883993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-000deb4b-896c-4430-8609-5e2258a4f8fa.f77918e6-53e5-424c-bf95-8d87b8b2da91 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:59:14 devstack sudo[98593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-000deb4b-896c-4430-8609-5e2258a4f8fa.f77918e6-53e5-424c-bf95-8d87b8b2da91 Jul 10 15:59:14 devstack sudo[98593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:59:16 devstack sudo[98593]: pam_unix(sudo:session): session closed for user root Jul 10 15:59:16 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4f712b11-8554-4f77-b81b-7deea503e01f tempest-VolumesSnapshotListTestJSON-1129883993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-000deb4b-896c-4430-8609-5e2258a4f8fa.f77918e6-53e5-424c-bf95-8d87b8b2da91" returned: 0 in 1.808s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:59:16 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-4f712b11-8554-4f77-b81b-7deea503e01f tempest-VolumesSnapshotListTestJSON-1129883993 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-000deb4b-896c-4430-8609-5e2258a4f8fa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87420) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 15:59:16 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4f712b11-8554-4f77-b81b-7deea503e01f tempest-VolumesSnapshotListTestJSON-1129883993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-000deb4b-896c-4430-8609-5e2258a4f8fa.2611c20e-8045-4868-9170-dea61e2a9176 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:59:16 devstack sudo[98604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-000deb4b-896c-4430-8609-5e2258a4f8fa.2611c20e-8045-4868-9170-dea61e2a9176 Jul 10 15:59:16 devstack sudo[98604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:59:17 devstack cinder-volume[87420]: DEBUG oslo_service.periodic_task [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87420) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 15:59:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:59:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:59:17 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:59:17 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:59:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:59:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:59:17 devstack sudo[98606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 15:59:17 devstack sudo[98606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:59:18 devstack sudo[98606]: pam_unix(sudo:session): session closed for user root Jul 10 15:59:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 1.588s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:59:19 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 15:59:19 devstack cinder-volume[87420]: DEBUG oslo_service.periodic_task [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Running periodic task VolumeManager._thread_info {{(pid=87420) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 15:59:19 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] thread count: 28 {{(pid=87420) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 15:59:19 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] thread info: [<_MainThread(MainThread, started 133639250378880)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87420) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 15:59:19 devstack sudo[98604]: pam_unix(sudo:session): session closed for user root Jul 10 15:59:19 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4f712b11-8554-4f77-b81b-7deea503e01f tempest-VolumesSnapshotListTestJSON-1129883993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-000deb4b-896c-4430-8609-5e2258a4f8fa.2611c20e-8045-4868-9170-dea61e2a9176" returned: 0 in 3.232s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:59:19 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4f712b11-8554-4f77-b81b-7deea503e01f tempest-VolumesSnapshotListTestJSON-1129883993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-000deb4b-896c-4430-8609-5e2258a4f8fa.2611c20e-8045-4868-9170-dea61e2a9176 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:59:19 devstack sudo[98614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-000deb4b-896c-4430-8609-5e2258a4f8fa.2611c20e-8045-4868-9170-dea61e2a9176 Jul 10 15:59:19 devstack sudo[98614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:59:21 devstack sudo[98582]: pam_unix(sudo:session): session closed for user root Jul 10 15:59:21 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-e38ba5d2-45a6-4fe7-b7b3-8b9fe6b2b7d3 tempest-TestStampPattern-1127543775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4ff68687-c9f5-4d47-a2bb-8312436fc4b7 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-894f402d-cb97-4505-b7f9-5c40607bb703" returned: 0 in 7.619s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:59:21 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[04c8d784-530a-419d-9ff6-ec110348e2b2]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:59:21 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-e38ba5d2-45a6-4fe7-b7b3-8b9fe6b2b7d3 tempest-TestStampPattern-1127543775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4ff68687-c9f5-4d47-a2bb-8312436fc4b7 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:59:21 devstack sudo[98614]: pam_unix(sudo:session): session closed for user root Jul 10 15:59:21 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4f712b11-8554-4f77-b81b-7deea503e01f tempest-VolumesSnapshotListTestJSON-1129883993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-000deb4b-896c-4430-8609-5e2258a4f8fa.2611c20e-8045-4868-9170-dea61e2a9176" returned: 0 in 1.839s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:59:21 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-4f712b11-8554-4f77-b81b-7deea503e01f tempest-VolumesSnapshotListTestJSON-1129883993 None] Lock "cinder-quobyte-2611c20e-8045-4868-9170-dea61e2a9176" released by "_delete_snapshot" :: held 7.854s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:59:21 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-4f712b11-8554-4f77-b81b-7deea503e01f tempest-VolumesSnapshotListTestJSON-1129883993 None] Lock "cinder-quobyte-000deb4b-896c-4430-8609-5e2258a4f8fa" released by "delete_snapshot" :: held 7.887s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:59:21 devstack sudo[98639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4ff68687-c9f5-4d47-a2bb-8312436fc4b7 Jul 10 15:59:21 devstack sudo[98639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:59:21 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-4f712b11-8554-4f77-b81b-7deea503e01f tempest-VolumesSnapshotListTestJSON-1129883993 None] Created reservations ['ee1078f9-b06c-4feb-87e4-6de616939748', '1b24d45e-3e53-4c09-8dc6-a5f02aa861af', '6fbcac8e-b81a-4c01-96bc-7238ae8e1a61', 'ea53ce7d-64e7-4965-ac65-24ece8990d16'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 15:59:21 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-4f712b11-8554-4f77-b81b-7deea503e01f tempest-VolumesSnapshotListTestJSON-1129883993 None] Delete snapshot completed successfully. Jul 10 15:59:21 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-4f712b11-8554-4f77-b81b-7deea503e01f tempest-VolumesSnapshotListTestJSON-1129883993 None] Lock "cinder-2611c20e-8045-4868-9170-dea61e2a9176-delete_snapshot" released by "delete_snapshot" :: held 8.103s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:59:22 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-a93fff7d-b9ca-4876-b392-d0431d9140d0 tempest-VolumesSnapshotListTestJSON-1129883993 None] Acquiring lock "cinder-f77918e6-53e5-424c-bf95-8d87b8b2da91-delete_snapshot" by "delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:59:22 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-a93fff7d-b9ca-4876-b392-d0431d9140d0 tempest-VolumesSnapshotListTestJSON-1129883993 None] Lock "cinder-f77918e6-53e5-424c-bf95-8d87b8b2da91-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:59:22 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-a93fff7d-b9ca-4876-b392-d0431d9140d0 tempest-VolumesSnapshotListTestJSON-1129883993 None] Acquiring lock "cinder-quobyte-000deb4b-896c-4430-8609-5e2258a4f8fa" by "delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:59:22 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-a93fff7d-b9ca-4876-b392-d0431d9140d0 tempest-VolumesSnapshotListTestJSON-1129883993 None] Lock "cinder-quobyte-000deb4b-896c-4430-8609-5e2258a4f8fa" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:59:22 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-a93fff7d-b9ca-4876-b392-d0431d9140d0 tempest-VolumesSnapshotListTestJSON-1129883993 None] Acquiring lock "cinder-quobyte-f77918e6-53e5-424c-bf95-8d87b8b2da91" by "_delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:59:22 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-a93fff7d-b9ca-4876-b392-d0431d9140d0 tempest-VolumesSnapshotListTestJSON-1129883993 None] Lock "cinder-quobyte-f77918e6-53e5-424c-bf95-8d87b8b2da91" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:59:22 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-a93fff7d-b9ca-4876-b392-d0431d9140d0 tempest-VolumesSnapshotListTestJSON-1129883993 None] Deleting offline snapshot f77918e6-53e5-424c-bf95-8d87b8b2da91 of volume 000deb4b-896c-4430-8609-5e2258a4f8fa {{(pid=87420) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 15:59:22 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-a93fff7d-b9ca-4876-b392-d0431d9140d0 tempest-VolumesSnapshotListTestJSON-1129883993 None] snapshot_file for this snap is: volume-000deb4b-896c-4430-8609-5e2258a4f8fa.f77918e6-53e5-424c-bf95-8d87b8b2da91 {{(pid=87420) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 15:59:22 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc3b4abf-01b5-4af4-8c39-ffa067d74525]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:59:22 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a93fff7d-b9ca-4876-b392-d0431d9140d0 tempest-VolumesSnapshotListTestJSON-1129883993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-000deb4b-896c-4430-8609-5e2258a4f8fa.f77918e6-53e5-424c-bf95-8d87b8b2da91 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:59:22 devstack sudo[98662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-000deb4b-896c-4430-8609-5e2258a4f8fa.f77918e6-53e5-424c-bf95-8d87b8b2da91 Jul 10 15:59:22 devstack sudo[98662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:59:22 devstack sudo[98639]: pam_unix(sudo:session): session closed for user root Jul 10 15:59:22 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-e38ba5d2-45a6-4fe7-b7b3-8b9fe6b2b7d3 tempest-TestStampPattern-1127543775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4ff68687-c9f5-4d47-a2bb-8312436fc4b7" returned: 0 in 1.300s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:59:22 devstack cinder-volume[87420]: DEBUG cinder.image.image_utils [None req-e38ba5d2-45a6-4fe7-b7b3-8b9fe6b2b7d3 tempest-TestStampPattern-1127543775 None] Image conversion details: src /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4ff68687-c9f5-4d47-a2bb-8312436fc4b7, size 1024.00 MB, duration 7.62 sec, destination /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-894f402d-cb97-4505-b7f9-5c40607bb703 {{(pid=87420) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 15:59:22 devstack cinder-volume[87420]: INFO cinder.image.image_utils [None req-e38ba5d2-45a6-4fe7-b7b3-8b9fe6b2b7d3 tempest-TestStampPattern-1127543775 None] Converted 1024.00 MB image at 134.38 MB/s Jul 10 15:59:22 devstack cinder-volume[87420]: WARNING cinder.volume.drivers.remotefs [None req-e38ba5d2-45a6-4fe7-b7b3-8b9fe6b2b7d3 tempest-TestStampPattern-1127543775 None] /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-894f402d-cb97-4505-b7f9-5c40607bb703 is being set with open permissions: ugo+rw Jul 10 15:59:22 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-e38ba5d2-45a6-4fe7-b7b3-8b9fe6b2b7d3 tempest-TestStampPattern-1127543775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-894f402d-cb97-4505-b7f9-5c40607bb703 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:59:22 devstack sudo[98670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-894f402d-cb97-4505-b7f9-5c40607bb703 Jul 10 15:59:22 devstack sudo[98670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:59:23 devstack sudo[98670]: pam_unix(sudo:session): session closed for user root Jul 10 15:59:23 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-e38ba5d2-45a6-4fe7-b7b3-8b9fe6b2b7d3 tempest-TestStampPattern-1127543775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-894f402d-cb97-4505-b7f9-5c40607bb703" returned: 0 in 0.769s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:59:23 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-e38ba5d2-45a6-4fe7-b7b3-8b9fe6b2b7d3 tempest-TestStampPattern-1127543775 None] Lock "cinder-quobyte-894f402d-cb97-4505-b7f9-5c40607bb703" released by "_copy_volume_from_snapshot" :: held 11.925s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:59:23 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-e38ba5d2-45a6-4fe7-b7b3-8b9fe6b2b7d3 tempest-TestStampPattern-1127543775 None] Lock "cinder-quobyte-a9699ac7-4a2e-4683-be0d-ec67ec8cdf63-894f402d-cb97-4505-b7f9-5c40607bb703" released by "_create_volume_from_snapshot" :: held 11.972s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:59:23 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-e38ba5d2-45a6-4fe7-b7b3-8b9fe6b2b7d3 tempest-TestStampPattern-1127543775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.999s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:59:23 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-fb93cfc2-a87b-4245-af1e-fdc80564302d tempest-VolumesTransfersTest-1474644828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.622s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:59:23 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-fb93cfc2-a87b-4245-af1e-fdc80564302d tempest-VolumesTransfersTest-1474644828 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:59:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1614980632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5df7fd2-15a0-4457-afab-94f1e5716bc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba1546a44c8d4e429e723fa1522159e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:59:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:59:13Z,use_quota=True,user_id='347b5ca5e25b4f3aba6e8e36e82387ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 15:59:23 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-fb93cfc2-a87b-4245-af1e-fdc80564302d tempest-VolumesTransfersTest-1474644828 None] Creating volume c5df7fd2-15a0-4457-afab-94f1e5716bc9 {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 15:59:23 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-fb93cfc2-a87b-4245-af1e-fdc80564302d tempest-VolumesTransfersTest-1474644828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:59:23 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-fb93cfc2-a87b-4245-af1e-fdc80564302d tempest-VolumesTransfersTest-1474644828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:59:23 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-fb93cfc2-a87b-4245-af1e-fdc80564302d tempest-VolumesTransfersTest-1474644828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:59:23 devstack sudo[98662]: pam_unix(sudo:session): session closed for user root Jul 10 15:59:23 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-fb93cfc2-a87b-4245-af1e-fdc80564302d tempest-VolumesTransfersTest-1474644828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:59:23 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-fb93cfc2-a87b-4245-af1e-fdc80564302d tempest-VolumesTransfersTest-1474644828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:59:23 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-fb93cfc2-a87b-4245-af1e-fdc80564302d tempest-VolumesTransfersTest-1474644828 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 15:59:23 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-fb93cfc2-a87b-4245-af1e-fdc80564302d tempest-VolumesTransfersTest-1474644828 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 15:59:23 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-fb93cfc2-a87b-4245-af1e-fdc80564302d tempest-VolumesTransfersTest-1474644828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-c5df7fd2-15a0-4457-afab-94f1e5716bc9 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:59:23 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a93fff7d-b9ca-4876-b392-d0431d9140d0 tempest-VolumesSnapshotListTestJSON-1129883993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-000deb4b-896c-4430-8609-5e2258a4f8fa.f77918e6-53e5-424c-bf95-8d87b8b2da91" returned: 0 in 1.016s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:59:23 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-a93fff7d-b9ca-4876-b392-d0431d9140d0 tempest-VolumesSnapshotListTestJSON-1129883993 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-000deb4b-896c-4430-8609-5e2258a4f8fa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87420) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 15:59:23 devstack sudo[98681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-c5df7fd2-15a0-4457-afab-94f1e5716bc9 1073741824 Jul 10 15:59:23 devstack sudo[98681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:59:23 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4a598ef-8f48-44b4-bbae-081539232179]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:59:23 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a93fff7d-b9ca-4876-b392-d0431d9140d0 tempest-VolumesSnapshotListTestJSON-1129883993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-000deb4b-896c-4430-8609-5e2258a4f8fa.2e197ae7-74be-43dc-8a74-dac182419e7d {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:59:23 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-e38ba5d2-45a6-4fe7-b7b3-8b9fe6b2b7d3 tempest-TestStampPattern-1127543775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (545c2637-620c-42f7-a4a2-f39e66c9574f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-894f402d-cb97-4505-b7f9-5c40607bb703', 'volume_size': 1, 'snapshot_id': 'a9699ac7-4a2e-4683-be0d-ec67ec8cdf63'}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:59:23 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-e38ba5d2-45a6-4fe7-b7b3-8b9fe6b2b7d3 tempest-TestStampPattern-1127543775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3056b23b-b1b9-436e-9824-9b0b4d2deaf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:59:23 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-e38ba5d2-45a6-4fe7-b7b3-8b9fe6b2b7d3 tempest-TestStampPattern-1127543775 None] Volume volume-894f402d-cb97-4505-b7f9-5c40607bb703 (894f402d-cb97-4505-b7f9-5c40607bb703): created successfully Jul 10 15:59:23 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-e38ba5d2-45a6-4fe7-b7b3-8b9fe6b2b7d3 tempest-TestStampPattern-1127543775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3056b23b-b1b9-436e-9824-9b0b4d2deaf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:59:23 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-e38ba5d2-45a6-4fe7-b7b3-8b9fe6b2b7d3 tempest-TestStampPattern-1127543775 None] Flow 'volume_create_manager' (997db525-6b44-4a41-a72d-c8ab843813df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:59:23 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-e38ba5d2-45a6-4fe7-b7b3-8b9fe6b2b7d3 tempest-TestStampPattern-1127543775 None] Created volume successfully. Jul 10 15:59:23 devstack sudo[98683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-000deb4b-896c-4430-8609-5e2258a4f8fa.2e197ae7-74be-43dc-8a74-dac182419e7d Jul 10 15:59:23 devstack sudo[98683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:59:24 devstack sudo[98683]: pam_unix(sudo:session): session closed for user root Jul 10 15:59:24 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a93fff7d-b9ca-4876-b392-d0431d9140d0 tempest-VolumesSnapshotListTestJSON-1129883993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-000deb4b-896c-4430-8609-5e2258a4f8fa.2e197ae7-74be-43dc-8a74-dac182419e7d" returned: 0 in 0.885s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:59:24 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-a93fff7d-b9ca-4876-b392-d0431d9140d0 tempest-VolumesSnapshotListTestJSON-1129883993 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-000deb4b-896c-4430-8609-5e2258a4f8fa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87420) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 15:59:24 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a93fff7d-b9ca-4876-b392-d0431d9140d0 tempest-VolumesSnapshotListTestJSON-1129883993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-000deb4b-896c-4430-8609-5e2258a4f8fa.f77918e6-53e5-424c-bf95-8d87b8b2da91 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:59:24 devstack sudo[98693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-000deb4b-896c-4430-8609-5e2258a4f8fa.f77918e6-53e5-424c-bf95-8d87b8b2da91 Jul 10 15:59:24 devstack sudo[98693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:59:24 devstack sudo[98681]: pam_unix(sudo:session): session closed for user root Jul 10 15:59:24 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-fb93cfc2-a87b-4245-af1e-fdc80564302d tempest-VolumesTransfersTest-1474644828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-c5df7fd2-15a0-4457-afab-94f1e5716bc9 1073741824" returned: 0 in 1.062s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:59:24 devstack cinder-volume[87420]: DEBUG dbcounter [-] [87420] Writing DB stats cinder:SELECT=83,cinder:INSERT=24,cinder:UPDATE=80,cinder:DELETE=10 {{(pid=87420) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 15:59:24 devstack cinder-volume[87420]: DEBUG dbcounter [-] [87420] Writing DB stats cinder:SELECT=75,cinder:UPDATE=94,cinder:DELETE=9,cinder:INSERT=16 {{(pid=87420) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 15:59:24 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-fb93cfc2-a87b-4245-af1e-fdc80564302d tempest-VolumesTransfersTest-1474644828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-c5df7fd2-15a0-4457-afab-94f1e5716bc9 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:59:24 devstack sudo[98696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-c5df7fd2-15a0-4457-afab-94f1e5716bc9 Jul 10 15:59:24 devstack sudo[98696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:59:25 devstack sudo[98696]: pam_unix(sudo:session): session closed for user root Jul 10 15:59:25 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-fb93cfc2-a87b-4245-af1e-fdc80564302d tempest-VolumesTransfersTest-1474644828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-c5df7fd2-15a0-4457-afab-94f1e5716bc9" returned: 0 in 0.677s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:59:25 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-fb93cfc2-a87b-4245-af1e-fdc80564302d tempest-VolumesTransfersTest-1474644828 None] <== create_volume: return (1812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 15:59:25 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-fb93cfc2-a87b-4245-af1e-fdc80564302d tempest-VolumesTransfersTest-1474644828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.818s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:59:25 devstack sudo[98693]: pam_unix(sudo:session): session closed for user root Jul 10 15:59:25 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a93fff7d-b9ca-4876-b392-d0431d9140d0 tempest-VolumesSnapshotListTestJSON-1129883993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-000deb4b-896c-4430-8609-5e2258a4f8fa.f77918e6-53e5-424c-bf95-8d87b8b2da91" returned: 0 in 0.858s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:59:25 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a93fff7d-b9ca-4876-b392-d0431d9140d0 tempest-VolumesSnapshotListTestJSON-1129883993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-000deb4b-896c-4430-8609-5e2258a4f8fa.f77918e6-53e5-424c-bf95-8d87b8b2da91 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:59:25 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-fb93cfc2-a87b-4245-af1e-fdc80564302d tempest-VolumesTransfersTest-1474644828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7af62ea8-c749-4e1a-b5d3-8797226b2ddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5df7fd2-15a0-4457-afab-94f1e5716bc9', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:59:25 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-fb93cfc2-a87b-4245-af1e-fdc80564302d tempest-VolumesTransfersTest-1474644828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06476f2c-6e90-480c-9be5-0a4d3f2e2fc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:59:25 devstack sudo[98702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-000deb4b-896c-4430-8609-5e2258a4f8fa.f77918e6-53e5-424c-bf95-8d87b8b2da91 Jul 10 15:59:25 devstack sudo[98702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:59:25 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-fb93cfc2-a87b-4245-af1e-fdc80564302d tempest-VolumesTransfersTest-1474644828 None] Volume volume-c5df7fd2-15a0-4457-afab-94f1e5716bc9 (c5df7fd2-15a0-4457-afab-94f1e5716bc9): created successfully Jul 10 15:59:25 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-fb93cfc2-a87b-4245-af1e-fdc80564302d tempest-VolumesTransfersTest-1474644828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06476f2c-6e90-480c-9be5-0a4d3f2e2fc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:59:25 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-fb93cfc2-a87b-4245-af1e-fdc80564302d tempest-VolumesTransfersTest-1474644828 None] Flow 'volume_create_manager' (91cdc1f3-9929-4c35-a8b6-8325e1fc3c4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:59:25 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-fb93cfc2-a87b-4245-af1e-fdc80564302d tempest-VolumesTransfersTest-1474644828 None] Created volume successfully. Jul 10 15:59:25 devstack sudo[98702]: pam_unix(sudo:session): session closed for user root Jul 10 15:59:25 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a93fff7d-b9ca-4876-b392-d0431d9140d0 tempest-VolumesSnapshotListTestJSON-1129883993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-000deb4b-896c-4430-8609-5e2258a4f8fa.f77918e6-53e5-424c-bf95-8d87b8b2da91" returned: 0 in 0.772s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:59:26 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-a93fff7d-b9ca-4876-b392-d0431d9140d0 tempest-VolumesSnapshotListTestJSON-1129883993 None] Lock "cinder-quobyte-f77918e6-53e5-424c-bf95-8d87b8b2da91" released by "_delete_snapshot" :: held 3.682s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:59:26 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-a93fff7d-b9ca-4876-b392-d0431d9140d0 tempest-VolumesSnapshotListTestJSON-1129883993 None] Lock "cinder-quobyte-000deb4b-896c-4430-8609-5e2258a4f8fa" released by "delete_snapshot" :: held 3.725s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:59:26 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-a93fff7d-b9ca-4876-b392-d0431d9140d0 tempest-VolumesSnapshotListTestJSON-1129883993 None] Created reservations ['2d4b16ef-2af4-4169-8431-b17e2aef4334', '6dc4ad09-b7d7-496c-ad46-15800dcf8494', '1ee81c84-4c01-4b58-87a4-441ec69e3180', '3fd5b9b3-f097-48b6-8c7b-2a2afc92e6ce'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 15:59:26 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-a93fff7d-b9ca-4876-b392-d0431d9140d0 tempest-VolumesSnapshotListTestJSON-1129883993 None] Delete snapshot completed successfully. Jul 10 15:59:26 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-a93fff7d-b9ca-4876-b392-d0431d9140d0 tempest-VolumesSnapshotListTestJSON-1129883993 None] Lock "cinder-f77918e6-53e5-424c-bf95-8d87b8b2da91-delete_snapshot" released by "delete_snapshot" :: held 4.015s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:59:26 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-aba81798-99b1-487b-90ab-45a48a59bbb9 tempest-VolumesSnapshotListTestJSON-1129883993 None] Acquiring lock "cinder-2e197ae7-74be-43dc-8a74-dac182419e7d-delete_snapshot" by "delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:59:26 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-aba81798-99b1-487b-90ab-45a48a59bbb9 tempest-VolumesSnapshotListTestJSON-1129883993 None] Lock "cinder-2e197ae7-74be-43dc-8a74-dac182419e7d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:59:26 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-aba81798-99b1-487b-90ab-45a48a59bbb9 tempest-VolumesSnapshotListTestJSON-1129883993 None] Acquiring lock "cinder-quobyte-000deb4b-896c-4430-8609-5e2258a4f8fa" by "delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:59:26 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-aba81798-99b1-487b-90ab-45a48a59bbb9 tempest-VolumesSnapshotListTestJSON-1129883993 None] Lock "cinder-quobyte-000deb4b-896c-4430-8609-5e2258a4f8fa" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:59:26 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-aba81798-99b1-487b-90ab-45a48a59bbb9 tempest-VolumesSnapshotListTestJSON-1129883993 None] Acquiring lock "cinder-quobyte-2e197ae7-74be-43dc-8a74-dac182419e7d" by "_delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:59:26 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-aba81798-99b1-487b-90ab-45a48a59bbb9 tempest-VolumesSnapshotListTestJSON-1129883993 None] Lock "cinder-quobyte-2e197ae7-74be-43dc-8a74-dac182419e7d" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:59:26 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-aba81798-99b1-487b-90ab-45a48a59bbb9 tempest-VolumesSnapshotListTestJSON-1129883993 None] Deleting offline snapshot 2e197ae7-74be-43dc-8a74-dac182419e7d of volume 000deb4b-896c-4430-8609-5e2258a4f8fa {{(pid=87420) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 15:59:26 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-aba81798-99b1-487b-90ab-45a48a59bbb9 tempest-VolumesSnapshotListTestJSON-1129883993 None] snapshot_file for this snap is: volume-000deb4b-896c-4430-8609-5e2258a4f8fa.2e197ae7-74be-43dc-8a74-dac182419e7d {{(pid=87420) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 15:59:26 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[54076eec-b330-4a17-8097-c6833bb3e611]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:59:26 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-aba81798-99b1-487b-90ab-45a48a59bbb9 tempest-VolumesSnapshotListTestJSON-1129883993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-000deb4b-896c-4430-8609-5e2258a4f8fa.2e197ae7-74be-43dc-8a74-dac182419e7d {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:59:26 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-e32ec019-0611-4b1a-9d8f-3362a27fe2a6 tempest-VolumesTransfersTest-506720907 None] Acquiring lock "cinder-c5df7fd2-15a0-4457-afab-94f1e5716bc9-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:59:26 devstack sudo[98758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-000deb4b-896c-4430-8609-5e2258a4f8fa.2e197ae7-74be-43dc-8a74-dac182419e7d Jul 10 15:59:26 devstack sudo[98758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:59:26 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-e32ec019-0611-4b1a-9d8f-3362a27fe2a6 tempest-VolumesTransfersTest-506720907 None] Lock "cinder-c5df7fd2-15a0-4457-afab-94f1e5716bc9-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:59:27 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-e32ec019-0611-4b1a-9d8f-3362a27fe2a6 tempest-VolumesTransfersTest-506720907 None] Acquiring lock "cinder-quobyte-c5df7fd2-15a0-4457-afab-94f1e5716bc9" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:59:27 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-e32ec019-0611-4b1a-9d8f-3362a27fe2a6 tempest-VolumesTransfersTest-506720907 None] Lock "cinder-quobyte-c5df7fd2-15a0-4457-afab-94f1e5716bc9" acquired by "delete_volume" :: waited 0.017s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:59:27 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5f3b0ed-1415-48b7-8640-0ab3f79354ec]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:59:27 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-e32ec019-0611-4b1a-9d8f-3362a27fe2a6 tempest-VolumesTransfersTest-506720907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-c5df7fd2-15a0-4457-afab-94f1e5716bc9 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:59:27 devstack sudo[98768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-c5df7fd2-15a0-4457-afab-94f1e5716bc9 Jul 10 15:59:27 devstack sudo[98768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:59:27 devstack sudo[98758]: pam_unix(sudo:session): session closed for user root Jul 10 15:59:27 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-aba81798-99b1-487b-90ab-45a48a59bbb9 tempest-VolumesSnapshotListTestJSON-1129883993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-000deb4b-896c-4430-8609-5e2258a4f8fa.2e197ae7-74be-43dc-8a74-dac182419e7d" returned: 0 in 1.001s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:59:27 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-aba81798-99b1-487b-90ab-45a48a59bbb9 tempest-VolumesSnapshotListTestJSON-1129883993 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-000deb4b-896c-4430-8609-5e2258a4f8fa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87420) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 15:59:27 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[4892183b-1e03-4018-bd8f-ea2555c88e51]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:59:27 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-aba81798-99b1-487b-90ab-45a48a59bbb9 tempest-VolumesSnapshotListTestJSON-1129883993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-000deb4b-896c-4430-8609-5e2258a4f8fa {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:59:27 devstack sudo[98800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-000deb4b-896c-4430-8609-5e2258a4f8fa Jul 10 15:59:27 devstack sudo[98800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:59:27 devstack sudo[98768]: pam_unix(sudo:session): session closed for user root Jul 10 15:59:27 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-e32ec019-0611-4b1a-9d8f-3362a27fe2a6 tempest-VolumesTransfersTest-506720907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-c5df7fd2-15a0-4457-afab-94f1e5716bc9" returned: 0 in 0.870s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:59:27 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-e32ec019-0611-4b1a-9d8f-3362a27fe2a6 tempest-VolumesTransfersTest-506720907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-c5df7fd2-15a0-4457-afab-94f1e5716bc9 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:59:28 devstack sudo[98821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-c5df7fd2-15a0-4457-afab-94f1e5716bc9 Jul 10 15:59:28 devstack sudo[98821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:59:28 devstack sudo[98800]: pam_unix(sudo:session): session closed for user root Jul 10 15:59:28 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-aba81798-99b1-487b-90ab-45a48a59bbb9 tempest-VolumesSnapshotListTestJSON-1129883993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-000deb4b-896c-4430-8609-5e2258a4f8fa" returned: 0 in 1.225s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:59:28 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-aba81798-99b1-487b-90ab-45a48a59bbb9 tempest-VolumesSnapshotListTestJSON-1129883993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-000deb4b-896c-4430-8609-5e2258a4f8fa.2e197ae7-74be-43dc-8a74-dac182419e7d {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:59:29 devstack sudo[98830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-000deb4b-896c-4430-8609-5e2258a4f8fa.2e197ae7-74be-43dc-8a74-dac182419e7d Jul 10 15:59:29 devstack sudo[98830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:59:29 devstack sudo[98821]: pam_unix(sudo:session): session closed for user root Jul 10 15:59:29 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-e32ec019-0611-4b1a-9d8f-3362a27fe2a6 tempest-VolumesTransfersTest-506720907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-c5df7fd2-15a0-4457-afab-94f1e5716bc9" returned: 0 in 1.075s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:59:29 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-e32ec019-0611-4b1a-9d8f-3362a27fe2a6 tempest-VolumesTransfersTest-506720907 None] Lock "cinder-quobyte-c5df7fd2-15a0-4457-afab-94f1e5716bc9" released by "delete_volume" :: held 2.017s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:59:29 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-e32ec019-0611-4b1a-9d8f-3362a27fe2a6 tempest-VolumesTransfersTest-506720907 None] Created reservations ['c68d1a91-8869-4e5e-875e-c09fdb19c00e', 'ee89a4ef-b977-4d0d-87ff-7ce3febc52f8', 'd19be9ad-f9d3-4496-813c-10a8cb5fed70', 'beef3107-8dbe-49d2-baab-82f1365fb0ee'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 15:59:29 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-e32ec019-0611-4b1a-9d8f-3362a27fe2a6 tempest-VolumesTransfersTest-506720907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:59:29 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-e32ec019-0611-4b1a-9d8f-3362a27fe2a6 tempest-VolumesTransfersTest-506720907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:59:29 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-e32ec019-0611-4b1a-9d8f-3362a27fe2a6 tempest-VolumesTransfersTest-506720907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:59:29 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-e32ec019-0611-4b1a-9d8f-3362a27fe2a6 tempest-VolumesTransfersTest-506720907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:59:29 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-e32ec019-0611-4b1a-9d8f-3362a27fe2a6 tempest-VolumesTransfersTest-506720907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:59:29 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-e32ec019-0611-4b1a-9d8f-3362a27fe2a6 tempest-VolumesTransfersTest-506720907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:59:29 devstack sudo[98834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 15:59:29 devstack sudo[98834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:59:30 devstack sudo[98830]: pam_unix(sudo:session): session closed for user root Jul 10 15:59:30 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-aba81798-99b1-487b-90ab-45a48a59bbb9 tempest-VolumesSnapshotListTestJSON-1129883993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-000deb4b-896c-4430-8609-5e2258a4f8fa.2e197ae7-74be-43dc-8a74-dac182419e7d" returned: 0 in 1.569s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:59:30 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-aba81798-99b1-487b-90ab-45a48a59bbb9 tempest-VolumesSnapshotListTestJSON-1129883993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-000deb4b-896c-4430-8609-5e2258a4f8fa.2e197ae7-74be-43dc-8a74-dac182419e7d {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:59:30 devstack sudo[98840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-000deb4b-896c-4430-8609-5e2258a4f8fa.2e197ae7-74be-43dc-8a74-dac182419e7d Jul 10 15:59:30 devstack sudo[98840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:59:30 devstack sudo[98834]: pam_unix(sudo:session): session closed for user root Jul 10 15:59:30 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-e32ec019-0611-4b1a-9d8f-3362a27fe2a6 tempest-VolumesTransfersTest-506720907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 1.495s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:59:30 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-e32ec019-0611-4b1a-9d8f-3362a27fe2a6 tempest-VolumesTransfersTest-506720907 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 15:59:30 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-e32ec019-0611-4b1a-9d8f-3362a27fe2a6 tempest-VolumesTransfersTest-506720907 None] Deleted volume successfully. Jul 10 15:59:30 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-e32ec019-0611-4b1a-9d8f-3362a27fe2a6 tempest-VolumesTransfersTest-506720907 None] Lock "cinder-c5df7fd2-15a0-4457-afab-94f1e5716bc9-delete_volume" released by "delete_volume" :: held 3.943s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:59:31 devstack sudo[98840]: pam_unix(sudo:session): session closed for user root Jul 10 15:59:31 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-aba81798-99b1-487b-90ab-45a48a59bbb9 tempest-VolumesSnapshotListTestJSON-1129883993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-000deb4b-896c-4430-8609-5e2258a4f8fa.2e197ae7-74be-43dc-8a74-dac182419e7d" returned: 0 in 1.425s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:59:32 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-aba81798-99b1-487b-90ab-45a48a59bbb9 tempest-VolumesSnapshotListTestJSON-1129883993 None] Lock "cinder-quobyte-2e197ae7-74be-43dc-8a74-dac182419e7d" released by "_delete_snapshot" :: held 5.400s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:59:32 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-aba81798-99b1-487b-90ab-45a48a59bbb9 tempest-VolumesSnapshotListTestJSON-1129883993 None] Lock "cinder-quobyte-000deb4b-896c-4430-8609-5e2258a4f8fa" released by "delete_snapshot" :: held 5.446s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:59:32 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-aba81798-99b1-487b-90ab-45a48a59bbb9 tempest-VolumesSnapshotListTestJSON-1129883993 None] Created reservations ['6e38c8d8-36aa-417b-8192-cdbe39d6b0e2', '797648c0-4f04-4916-804e-45e1df39f1d8', 'e576b16e-eaf9-4223-8a1e-3d5934f69d5d', 'b692c5cd-2c50-41af-afdf-616bb7b7eeea'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 15:59:32 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-aba81798-99b1-487b-90ab-45a48a59bbb9 tempest-VolumesSnapshotListTestJSON-1129883993 None] Delete snapshot completed successfully. Jul 10 15:59:32 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-aba81798-99b1-487b-90ab-45a48a59bbb9 tempest-VolumesSnapshotListTestJSON-1129883993 None] Lock "cinder-2e197ae7-74be-43dc-8a74-dac182419e7d-delete_snapshot" released by "delete_snapshot" :: held 5.747s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:59:33 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-90fa9a61-495f-44a5-b4f0-3c8c61cc4bc3 tempest-VolumesSnapshotListTestJSON-1129883993 None] Acquiring lock "cinder-000deb4b-896c-4430-8609-5e2258a4f8fa-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:59:33 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-90fa9a61-495f-44a5-b4f0-3c8c61cc4bc3 tempest-VolumesSnapshotListTestJSON-1129883993 None] Lock "cinder-000deb4b-896c-4430-8609-5e2258a4f8fa-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:59:33 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-90fa9a61-495f-44a5-b4f0-3c8c61cc4bc3 tempest-VolumesSnapshotListTestJSON-1129883993 None] Acquiring lock "cinder-quobyte-000deb4b-896c-4430-8609-5e2258a4f8fa" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:59:33 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-90fa9a61-495f-44a5-b4f0-3c8c61cc4bc3 tempest-VolumesSnapshotListTestJSON-1129883993 None] Lock "cinder-quobyte-000deb4b-896c-4430-8609-5e2258a4f8fa" acquired by "delete_volume" :: waited 0.043s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:59:33 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[837442b9-b59c-479a-ae6d-ae7c27f24605]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:59:33 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-90fa9a61-495f-44a5-b4f0-3c8c61cc4bc3 tempest-VolumesSnapshotListTestJSON-1129883993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-000deb4b-896c-4430-8609-5e2258a4f8fa {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:59:33 devstack sudo[98880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-000deb4b-896c-4430-8609-5e2258a4f8fa Jul 10 15:59:33 devstack sudo[98880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:59:34 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-906259d5-0cb4-476d-a779-2a120b0702fa tempest-VolumesActionsTest-462308728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 15:59:34 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-906259d5-0cb4-476d-a779-2a120b0702fa tempest-VolumesActionsTest-462308728 None] Flow 'volume_create_manager' (b42471cc-48ae-4130-b618-baa08abd7ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:59:34 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-906259d5-0cb4-476d-a779-2a120b0702fa tempest-VolumesActionsTest-462308728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a8ec286-6ad6-492c-b2a9-1a224d5f4c60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:59:34 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-906259d5-0cb4-476d-a779-2a120b0702fa tempest-VolumesActionsTest-462308728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a8ec286-6ad6-492c-b2a9-1a224d5f4c60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:59:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-155672473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cf1466f-5832-4dcf-941a-9cde59b1210b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1c36a9c42fa40b78bc74dd9edaf17ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:59:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:59:35Z,use_quota=True,user_id='269a68e2fcc64ca3ae097dcfc9d72e93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:59:34 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-906259d5-0cb4-476d-a779-2a120b0702fa tempest-VolumesActionsTest-462308728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ba26995-ef2e-4351-a5e2-6308a2d3828e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:59:34 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-906259d5-0cb4-476d-a779-2a120b0702fa tempest-VolumesActionsTest-462308728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ba26995-ef2e-4351-a5e2-6308a2d3828e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:59:35 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-906259d5-0cb4-476d-a779-2a120b0702fa tempest-VolumesActionsTest-462308728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4876443d-d0b2-4654-9933-c7d2b414b4b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:59:35 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-906259d5-0cb4-476d-a779-2a120b0702fa tempest-VolumesActionsTest-462308728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4876443d-d0b2-4654-9933-c7d2b414b4b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0cf1466f-5832-4dcf-941a-9cde59b1210b', 'volume_name': 'volume-0cf1466f-5832-4dcf-941a-9cde59b1210b', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:59:35 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-906259d5-0cb4-476d-a779-2a120b0702fa tempest-VolumesActionsTest-462308728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (566d40d3-f5ab-4f19-8957-4ff4b748d4c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:59:35 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-906259d5-0cb4-476d-a779-2a120b0702fa tempest-VolumesActionsTest-462308728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (566d40d3-f5ab-4f19-8957-4ff4b748d4c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:59:35 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-906259d5-0cb4-476d-a779-2a120b0702fa tempest-VolumesActionsTest-462308728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d06e1bcb-083d-4c66-b51c-89f0803cb30f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:59:35 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-906259d5-0cb4-476d-a779-2a120b0702fa tempest-VolumesActionsTest-462308728 None] Volume 0cf1466f-5832-4dcf-941a-9cde59b1210b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0cf1466f-5832-4dcf-941a-9cde59b1210b', 'volume_size': 1} Jul 10 15:59:35 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-906259d5-0cb4-476d-a779-2a120b0702fa tempest-VolumesActionsTest-462308728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:59:35 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-906259d5-0cb4-476d-a779-2a120b0702fa tempest-VolumesActionsTest-462308728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:59:35 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-906259d5-0cb4-476d-a779-2a120b0702fa tempest-VolumesActionsTest-462308728 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:59:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-155672473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cf1466f-5832-4dcf-941a-9cde59b1210b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1c36a9c42fa40b78bc74dd9edaf17ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:59:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:59:35Z,use_quota=True,user_id='269a68e2fcc64ca3ae097dcfc9d72e93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 15:59:35 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-906259d5-0cb4-476d-a779-2a120b0702fa tempest-VolumesActionsTest-462308728 None] Creating volume 0cf1466f-5832-4dcf-941a-9cde59b1210b {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 15:59:35 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-906259d5-0cb4-476d-a779-2a120b0702fa tempest-VolumesActionsTest-462308728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:59:35 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-906259d5-0cb4-476d-a779-2a120b0702fa tempest-VolumesActionsTest-462308728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:59:35 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-906259d5-0cb4-476d-a779-2a120b0702fa tempest-VolumesActionsTest-462308728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:59:35 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-906259d5-0cb4-476d-a779-2a120b0702fa tempest-VolumesActionsTest-462308728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:59:35 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-906259d5-0cb4-476d-a779-2a120b0702fa tempest-VolumesActionsTest-462308728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:59:35 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-906259d5-0cb4-476d-a779-2a120b0702fa tempest-VolumesActionsTest-462308728 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 15:59:35 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-906259d5-0cb4-476d-a779-2a120b0702fa tempest-VolumesActionsTest-462308728 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 15:59:35 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-906259d5-0cb4-476d-a779-2a120b0702fa tempest-VolumesActionsTest-462308728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-0cf1466f-5832-4dcf-941a-9cde59b1210b 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:59:35 devstack sudo[98886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-0cf1466f-5832-4dcf-941a-9cde59b1210b 1073741824 Jul 10 15:59:35 devstack sudo[98886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:59:35 devstack sudo[98880]: pam_unix(sudo:session): session closed for user root Jul 10 15:59:35 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-90fa9a61-495f-44a5-b4f0-3c8c61cc4bc3 tempest-VolumesSnapshotListTestJSON-1129883993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-000deb4b-896c-4430-8609-5e2258a4f8fa" returned: 0 in 1.696s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:59:35 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-90fa9a61-495f-44a5-b4f0-3c8c61cc4bc3 tempest-VolumesSnapshotListTestJSON-1129883993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-000deb4b-896c-4430-8609-5e2258a4f8fa {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:59:35 devstack sudo[98888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-000deb4b-896c-4430-8609-5e2258a4f8fa Jul 10 15:59:35 devstack sudo[98888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:59:36 devstack sudo[98888]: pam_unix(sudo:session): session closed for user root Jul 10 15:59:36 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-90fa9a61-495f-44a5-b4f0-3c8c61cc4bc3 tempest-VolumesSnapshotListTestJSON-1129883993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-000deb4b-896c-4430-8609-5e2258a4f8fa" returned: 0 in 1.541s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:59:36 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-90fa9a61-495f-44a5-b4f0-3c8c61cc4bc3 tempest-VolumesSnapshotListTestJSON-1129883993 None] Lock "cinder-quobyte-000deb4b-896c-4430-8609-5e2258a4f8fa" released by "delete_volume" :: held 3.473s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:59:37 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-90fa9a61-495f-44a5-b4f0-3c8c61cc4bc3 tempest-VolumesSnapshotListTestJSON-1129883993 None] Created reservations ['8e20fb2a-e569-4514-9279-16edc628dc4e', '36d1d5ee-2c6d-4e3f-9af5-1e00f9725fbe', '845d5bbb-5225-4b72-b8e3-3c56ed61eb0b', '8f5b8d26-ff89-448b-9347-2c643795df87'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 15:59:37 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-90fa9a61-495f-44a5-b4f0-3c8c61cc4bc3 tempest-VolumesSnapshotListTestJSON-1129883993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:59:37 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-90fa9a61-495f-44a5-b4f0-3c8c61cc4bc3 tempest-VolumesSnapshotListTestJSON-1129883993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:59:37 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-90fa9a61-495f-44a5-b4f0-3c8c61cc4bc3 tempest-VolumesSnapshotListTestJSON-1129883993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:59:37 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-90fa9a61-495f-44a5-b4f0-3c8c61cc4bc3 tempest-VolumesSnapshotListTestJSON-1129883993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:59:37 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-90fa9a61-495f-44a5-b4f0-3c8c61cc4bc3 tempest-VolumesSnapshotListTestJSON-1129883993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:59:37 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-90fa9a61-495f-44a5-b4f0-3c8c61cc4bc3 tempest-VolumesSnapshotListTestJSON-1129883993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:59:37 devstack sudo[98896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 15:59:37 devstack sudo[98896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:59:37 devstack sudo[98886]: pam_unix(sudo:session): session closed for user root Jul 10 15:59:37 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-906259d5-0cb4-476d-a779-2a120b0702fa tempest-VolumesActionsTest-462308728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-0cf1466f-5832-4dcf-941a-9cde59b1210b 1073741824" returned: 0 in 2.279s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:59:37 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-906259d5-0cb4-476d-a779-2a120b0702fa tempest-VolumesActionsTest-462308728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-0cf1466f-5832-4dcf-941a-9cde59b1210b {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:59:37 devstack sudo[98898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-0cf1466f-5832-4dcf-941a-9cde59b1210b Jul 10 15:59:37 devstack sudo[98898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:59:38 devstack sudo[98896]: pam_unix(sudo:session): session closed for user root Jul 10 15:59:38 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-90fa9a61-495f-44a5-b4f0-3c8c61cc4bc3 tempest-VolumesSnapshotListTestJSON-1129883993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 1.587s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:59:38 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-90fa9a61-495f-44a5-b4f0-3c8c61cc4bc3 tempest-VolumesSnapshotListTestJSON-1129883993 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 15:59:38 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-90fa9a61-495f-44a5-b4f0-3c8c61cc4bc3 tempest-VolumesSnapshotListTestJSON-1129883993 None] Deleted volume successfully. Jul 10 15:59:38 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-90fa9a61-495f-44a5-b4f0-3c8c61cc4bc3 tempest-VolumesSnapshotListTestJSON-1129883993 None] Lock "cinder-000deb4b-896c-4430-8609-5e2258a4f8fa-delete_volume" released by "delete_volume" :: held 5.624s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:59:39 devstack sudo[98898]: pam_unix(sudo:session): session closed for user root Jul 10 15:59:39 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-906259d5-0cb4-476d-a779-2a120b0702fa tempest-VolumesActionsTest-462308728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-0cf1466f-5832-4dcf-941a-9cde59b1210b" returned: 0 in 1.656s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:59:39 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-906259d5-0cb4-476d-a779-2a120b0702fa tempest-VolumesActionsTest-462308728 None] <== create_volume: return (4032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 15:59:39 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-906259d5-0cb4-476d-a779-2a120b0702fa tempest-VolumesActionsTest-462308728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.041s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:59:39 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-906259d5-0cb4-476d-a779-2a120b0702fa tempest-VolumesActionsTest-462308728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d06e1bcb-083d-4c66-b51c-89f0803cb30f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cf1466f-5832-4dcf-941a-9cde59b1210b', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:59:39 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-906259d5-0cb4-476d-a779-2a120b0702fa tempest-VolumesActionsTest-462308728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (041df39e-22c5-4628-b4ba-72604cc1994d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:59:39 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-906259d5-0cb4-476d-a779-2a120b0702fa tempest-VolumesActionsTest-462308728 None] Volume volume-0cf1466f-5832-4dcf-941a-9cde59b1210b (0cf1466f-5832-4dcf-941a-9cde59b1210b): created successfully Jul 10 15:59:39 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-906259d5-0cb4-476d-a779-2a120b0702fa tempest-VolumesActionsTest-462308728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (041df39e-22c5-4628-b4ba-72604cc1994d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:59:39 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-906259d5-0cb4-476d-a779-2a120b0702fa tempest-VolumesActionsTest-462308728 None] Flow 'volume_create_manager' (b42471cc-48ae-4130-b618-baa08abd7ccd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:59:39 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-906259d5-0cb4-476d-a779-2a120b0702fa tempest-VolumesActionsTest-462308728 None] Created volume successfully. Jul 10 15:59:40 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-92439531-7d6c-4bc3-b936-37932feb6831 tempest-VolumesActionsTest-462308728 None] Acquiring lock "cinder-0cf1466f-5832-4dcf-941a-9cde59b1210b" by "attach_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:59:40 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-92439531-7d6c-4bc3-b936-37932feb6831 tempest-VolumesActionsTest-462308728 None] Lock "cinder-0cf1466f-5832-4dcf-941a-9cde59b1210b" acquired by "attach_volume" :: waited 0.043s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:59:40 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-92439531-7d6c-4bc3-b936-37932feb6831 tempest-VolumesActionsTest-462308728 None] Attaching volume 0cf1466f-5832-4dcf-941a-9cde59b1210b to instance 3bda41b6-af5e-47c8-8b68-110ac76fdf20 at mountpoint /dev/vdb on host None. Jul 10 15:59:40 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-92439531-7d6c-4bc3-b936-37932feb6831 tempest-VolumesActionsTest-462308728 None] Attach volume completed successfully. Jul 10 15:59:40 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-92439531-7d6c-4bc3-b936-37932feb6831 tempest-VolumesActionsTest-462308728 None] Lock "cinder-0cf1466f-5832-4dcf-941a-9cde59b1210b" released by "attach_volume" :: held 0.243s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:59:42 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-211573d6-633b-4823-88bc-9f2b9c4b02e4 tempest-VolumesActionsTest-306599127 None] Terminate volume connection completed successfully. Jul 10 15:59:42 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-211573d6-633b-4823-88bc-9f2b9c4b02e4 tempest-VolumesActionsTest-306599127 None] Acquiring lock "cinder-0cf1466f-5832-4dcf-941a-9cde59b1210b-detach_volume" by "detach_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:59:42 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-211573d6-633b-4823-88bc-9f2b9c4b02e4 tempest-VolumesActionsTest-306599127 None] Lock "cinder-0cf1466f-5832-4dcf-941a-9cde59b1210b-detach_volume" acquired by "detach_volume" :: waited 0.023s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:59:42 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-211573d6-633b-4823-88bc-9f2b9c4b02e4 tempest-VolumesActionsTest-306599127 None] Detaching volume 0cf1466f-5832-4dcf-941a-9cde59b1210b from instance 3bda41b6-af5e-47c8-8b68-110ac76fdf20. Jul 10 15:59:42 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-211573d6-633b-4823-88bc-9f2b9c4b02e4 tempest-VolumesActionsTest-306599127 None] Detach volume completed successfully. Jul 10 15:59:42 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-211573d6-633b-4823-88bc-9f2b9c4b02e4 tempest-VolumesActionsTest-306599127 None] Lock "cinder-0cf1466f-5832-4dcf-941a-9cde59b1210b-detach_volume" released by "detach_volume" :: held 0.090s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:59:43 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-20dde8ea-9c72-4d8c-8a97-018ee8f5b148 tempest-VolumesActionsTest-462308728 None] Acquiring lock "cinder-0cf1466f-5832-4dcf-941a-9cde59b1210b-detach_volume" by "detach_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:59:43 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-20dde8ea-9c72-4d8c-8a97-018ee8f5b148 tempest-VolumesActionsTest-462308728 None] Lock "cinder-0cf1466f-5832-4dcf-941a-9cde59b1210b-detach_volume" acquired by "detach_volume" :: waited 0.036s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:59:43 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-20dde8ea-9c72-4d8c-8a97-018ee8f5b148 tempest-VolumesActionsTest-462308728 None] Volume detach called, but volume not attached. Jul 10 15:59:43 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-20dde8ea-9c72-4d8c-8a97-018ee8f5b148 tempest-VolumesActionsTest-462308728 None] Lock "cinder-0cf1466f-5832-4dcf-941a-9cde59b1210b-detach_volume" released by "detach_volume" :: held 0.023s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:59:43 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-a557aac1-6d5b-4dba-9ab8-2868ff5e11eb tempest-VolumesTransfersV355Test-1053559699 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 15:59:43 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-a557aac1-6d5b-4dba-9ab8-2868ff5e11eb tempest-VolumesTransfersV355Test-1053559699 None] Flow 'volume_create_manager' (ed2c83a3-31a6-47bc-8073-f8ca8cf61f41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:59:43 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-a557aac1-6d5b-4dba-9ab8-2868ff5e11eb tempest-VolumesTransfersV355Test-1053559699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a25ca5d8-0175-4a13-b63e-8fb5aa84c3b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:59:43 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-a557aac1-6d5b-4dba-9ab8-2868ff5e11eb tempest-VolumesTransfersV355Test-1053559699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a25ca5d8-0175-4a13-b63e-8fb5aa84c3b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:59:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-344327081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c2139f9-6a3e-47c3-8f9b-992a77dfc3ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e478de5441a74bcea81b5afa5c28b6a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:59:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:59:44Z,use_quota=True,user_id='baf5995c4fdd4f3f86379b2be2c6c723',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:59:43 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-a557aac1-6d5b-4dba-9ab8-2868ff5e11eb tempest-VolumesTransfersV355Test-1053559699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f5273b0-5e48-4307-bdd2-160edfa345fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:59:43 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-a557aac1-6d5b-4dba-9ab8-2868ff5e11eb tempest-VolumesTransfersV355Test-1053559699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f5273b0-5e48-4307-bdd2-160edfa345fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:59:43 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-a557aac1-6d5b-4dba-9ab8-2868ff5e11eb tempest-VolumesTransfersV355Test-1053559699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e9d8e1b-a8ce-4538-8a67-c24ca9c1aa96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:59:43 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-a557aac1-6d5b-4dba-9ab8-2868ff5e11eb tempest-VolumesTransfersV355Test-1053559699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e9d8e1b-a8ce-4538-8a67-c24ca9c1aa96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c2139f9-6a3e-47c3-8f9b-992a77dfc3ee', 'volume_name': 'volume-1c2139f9-6a3e-47c3-8f9b-992a77dfc3ee', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:59:43 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-a557aac1-6d5b-4dba-9ab8-2868ff5e11eb tempest-VolumesTransfersV355Test-1053559699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (814179f8-679b-4106-825b-25a8f0ae087b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:59:43 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-a557aac1-6d5b-4dba-9ab8-2868ff5e11eb tempest-VolumesTransfersV355Test-1053559699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (814179f8-679b-4106-825b-25a8f0ae087b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:59:43 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-a557aac1-6d5b-4dba-9ab8-2868ff5e11eb tempest-VolumesTransfersV355Test-1053559699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7356cc3-0957-47e3-b55b-cdaf201fd376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:59:43 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-a557aac1-6d5b-4dba-9ab8-2868ff5e11eb tempest-VolumesTransfersV355Test-1053559699 None] Volume 1c2139f9-6a3e-47c3-8f9b-992a77dfc3ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c2139f9-6a3e-47c3-8f9b-992a77dfc3ee', 'volume_size': 1} Jul 10 15:59:43 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-a557aac1-6d5b-4dba-9ab8-2868ff5e11eb tempest-VolumesTransfersV355Test-1053559699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:59:43 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-a557aac1-6d5b-4dba-9ab8-2868ff5e11eb tempest-VolumesTransfersV355Test-1053559699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:59:43 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-a557aac1-6d5b-4dba-9ab8-2868ff5e11eb tempest-VolumesTransfersV355Test-1053559699 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:59:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-344327081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c2139f9-6a3e-47c3-8f9b-992a77dfc3ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e478de5441a74bcea81b5afa5c28b6a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:59:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:59:44Z,use_quota=True,user_id='baf5995c4fdd4f3f86379b2be2c6c723',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 15:59:43 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-a557aac1-6d5b-4dba-9ab8-2868ff5e11eb tempest-VolumesTransfersV355Test-1053559699 None] Creating volume 1c2139f9-6a3e-47c3-8f9b-992a77dfc3ee {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 15:59:43 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-a557aac1-6d5b-4dba-9ab8-2868ff5e11eb tempest-VolumesTransfersV355Test-1053559699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:59:43 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-a557aac1-6d5b-4dba-9ab8-2868ff5e11eb tempest-VolumesTransfersV355Test-1053559699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:59:43 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-a557aac1-6d5b-4dba-9ab8-2868ff5e11eb tempest-VolumesTransfersV355Test-1053559699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:59:43 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-a557aac1-6d5b-4dba-9ab8-2868ff5e11eb tempest-VolumesTransfersV355Test-1053559699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:59:43 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-a557aac1-6d5b-4dba-9ab8-2868ff5e11eb tempest-VolumesTransfersV355Test-1053559699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:59:43 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-a557aac1-6d5b-4dba-9ab8-2868ff5e11eb tempest-VolumesTransfersV355Test-1053559699 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 15:59:43 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-a557aac1-6d5b-4dba-9ab8-2868ff5e11eb tempest-VolumesTransfersV355Test-1053559699 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 15:59:43 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a557aac1-6d5b-4dba-9ab8-2868ff5e11eb tempest-VolumesTransfersV355Test-1053559699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1c2139f9-6a3e-47c3-8f9b-992a77dfc3ee 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:59:43 devstack sudo[98914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1c2139f9-6a3e-47c3-8f9b-992a77dfc3ee 1073741824 Jul 10 15:59:43 devstack sudo[98914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:59:44 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-6a0457d1-c2d2-4992-81f6-3ddda556c161 tempest-VolumesActionsTest-462308728 None] Acquiring lock "cinder-0cf1466f-5832-4dcf-941a-9cde59b1210b-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:59:44 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-6a0457d1-c2d2-4992-81f6-3ddda556c161 tempest-VolumesActionsTest-462308728 None] Lock "cinder-0cf1466f-5832-4dcf-941a-9cde59b1210b-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:59:44 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-6a0457d1-c2d2-4992-81f6-3ddda556c161 tempest-VolumesActionsTest-462308728 None] Acquiring lock "cinder-quobyte-0cf1466f-5832-4dcf-941a-9cde59b1210b" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:59:44 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-6a0457d1-c2d2-4992-81f6-3ddda556c161 tempest-VolumesActionsTest-462308728 None] Lock "cinder-quobyte-0cf1466f-5832-4dcf-941a-9cde59b1210b" acquired by "delete_volume" :: waited 0.027s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:59:44 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[5099713a-125c-44c0-a584-f0a2af5aa501]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:59:44 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6a0457d1-c2d2-4992-81f6-3ddda556c161 tempest-VolumesActionsTest-462308728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-0cf1466f-5832-4dcf-941a-9cde59b1210b {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:59:44 devstack sudo[98918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-0cf1466f-5832-4dcf-941a-9cde59b1210b Jul 10 15:59:44 devstack sudo[98918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:59:45 devstack sudo[98914]: pam_unix(sudo:session): session closed for user root Jul 10 15:59:45 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a557aac1-6d5b-4dba-9ab8-2868ff5e11eb tempest-VolumesTransfersV355Test-1053559699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1c2139f9-6a3e-47c3-8f9b-992a77dfc3ee 1073741824" returned: 0 in 1.209s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:59:45 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a557aac1-6d5b-4dba-9ab8-2868ff5e11eb tempest-VolumesTransfersV355Test-1053559699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1c2139f9-6a3e-47c3-8f9b-992a77dfc3ee {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:59:45 devstack sudo[98949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1c2139f9-6a3e-47c3-8f9b-992a77dfc3ee Jul 10 15:59:45 devstack sudo[98949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:59:45 devstack sudo[98918]: pam_unix(sudo:session): session closed for user root Jul 10 15:59:45 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6a0457d1-c2d2-4992-81f6-3ddda556c161 tempest-VolumesActionsTest-462308728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-0cf1466f-5832-4dcf-941a-9cde59b1210b" returned: 0 in 0.883s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:59:45 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6a0457d1-c2d2-4992-81f6-3ddda556c161 tempest-VolumesActionsTest-462308728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-0cf1466f-5832-4dcf-941a-9cde59b1210b {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:59:45 devstack sudo[98954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-0cf1466f-5832-4dcf-941a-9cde59b1210b Jul 10 15:59:45 devstack sudo[98954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:59:45 devstack sudo[98949]: pam_unix(sudo:session): session closed for user root Jul 10 15:59:45 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a557aac1-6d5b-4dba-9ab8-2868ff5e11eb tempest-VolumesTransfersV355Test-1053559699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1c2139f9-6a3e-47c3-8f9b-992a77dfc3ee" returned: 0 in 0.726s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:59:45 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-a557aac1-6d5b-4dba-9ab8-2868ff5e11eb tempest-VolumesTransfersV355Test-1053559699 None] <== create_volume: return (1990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 15:59:45 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-a557aac1-6d5b-4dba-9ab8-2868ff5e11eb tempest-VolumesTransfersV355Test-1053559699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.993s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:59:45 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-a557aac1-6d5b-4dba-9ab8-2868ff5e11eb tempest-VolumesTransfersV355Test-1053559699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7356cc3-0957-47e3-b55b-cdaf201fd376) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c2139f9-6a3e-47c3-8f9b-992a77dfc3ee', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:59:45 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-a557aac1-6d5b-4dba-9ab8-2868ff5e11eb tempest-VolumesTransfersV355Test-1053559699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a3ab770-8b58-4374-9f3b-e7fcffe83d84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:59:45 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-a557aac1-6d5b-4dba-9ab8-2868ff5e11eb tempest-VolumesTransfersV355Test-1053559699 None] Volume volume-1c2139f9-6a3e-47c3-8f9b-992a77dfc3ee (1c2139f9-6a3e-47c3-8f9b-992a77dfc3ee): created successfully Jul 10 15:59:45 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-a557aac1-6d5b-4dba-9ab8-2868ff5e11eb tempest-VolumesTransfersV355Test-1053559699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a3ab770-8b58-4374-9f3b-e7fcffe83d84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:59:45 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-a557aac1-6d5b-4dba-9ab8-2868ff5e11eb tempest-VolumesTransfersV355Test-1053559699 None] Flow 'volume_create_manager' (ed2c83a3-31a6-47bc-8073-f8ca8cf61f41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:59:45 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-a557aac1-6d5b-4dba-9ab8-2868ff5e11eb tempest-VolumesTransfersV355Test-1053559699 None] Created volume successfully. Jul 10 15:59:46 devstack sudo[98954]: pam_unix(sudo:session): session closed for user root Jul 10 15:59:46 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6a0457d1-c2d2-4992-81f6-3ddda556c161 tempest-VolumesActionsTest-462308728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-0cf1466f-5832-4dcf-941a-9cde59b1210b" returned: 0 in 0.750s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:59:46 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-6a0457d1-c2d2-4992-81f6-3ddda556c161 tempest-VolumesActionsTest-462308728 None] Lock "cinder-quobyte-0cf1466f-5832-4dcf-941a-9cde59b1210b" released by "delete_volume" :: held 1.686s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:59:46 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-6a0457d1-c2d2-4992-81f6-3ddda556c161 tempest-VolumesActionsTest-462308728 None] Created reservations ['c45a231e-87e3-4e3b-9786-e102ce726b49', 'ef31e6d1-708e-4210-a869-577ae383f551', 'dc0a1a66-a6f1-494b-b8b5-ec8f3a02f9f4', '8e2ea22c-8847-4a05-83a3-f727492cd16f'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 15:59:46 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-6a0457d1-c2d2-4992-81f6-3ddda556c161 tempest-VolumesActionsTest-462308728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:59:46 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-6a0457d1-c2d2-4992-81f6-3ddda556c161 tempest-VolumesActionsTest-462308728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:59:46 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-6a0457d1-c2d2-4992-81f6-3ddda556c161 tempest-VolumesActionsTest-462308728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:59:46 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-6a0457d1-c2d2-4992-81f6-3ddda556c161 tempest-VolumesActionsTest-462308728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:59:46 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-6a0457d1-c2d2-4992-81f6-3ddda556c161 tempest-VolumesActionsTest-462308728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:59:46 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6a0457d1-c2d2-4992-81f6-3ddda556c161 tempest-VolumesActionsTest-462308728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:59:46 devstack sudo[98958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 15:59:46 devstack sudo[98958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:59:47 devstack sudo[98958]: pam_unix(sudo:session): session closed for user root Jul 10 15:59:47 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6a0457d1-c2d2-4992-81f6-3ddda556c161 tempest-VolumesActionsTest-462308728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.761s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:59:47 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-6a0457d1-c2d2-4992-81f6-3ddda556c161 tempest-VolumesActionsTest-462308728 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 15:59:47 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-6a0457d1-c2d2-4992-81f6-3ddda556c161 tempest-VolumesActionsTest-462308728 None] Deleted volume successfully. Jul 10 15:59:47 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-6a0457d1-c2d2-4992-81f6-3ddda556c161 tempest-VolumesActionsTest-462308728 None] Lock "cinder-0cf1466f-5832-4dcf-941a-9cde59b1210b-delete_volume" released by "delete_volume" :: held 2.715s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:59:47 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-5566fa00-3442-40ba-aaf9-dca8aa6b8d69 tempest-VolumesTransfersV355Test-1549736232 None] Transfer volume completed successfully. Jul 10 15:59:48 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccb6020d-d5e9-4893-80e3-3322922b3edd tempest-VolumeAndVolumeTypeFromImageTest-1479156633 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 15:59:48 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ccb6020d-d5e9-4893-80e3-3322922b3edd tempest-VolumeAndVolumeTypeFromImageTest-1479156633 None] Flow 'volume_create_manager' (b3ebacb9-05e6-488b-8c2e-ac004dd7ad16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:59:48 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ccb6020d-d5e9-4893-80e3-3322922b3edd tempest-VolumeAndVolumeTypeFromImageTest-1479156633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fc9859e-8b86-41a0-8ca7-c5ab55704282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:59:48 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ccb6020d-d5e9-4893-80e3-3322922b3edd tempest-VolumeAndVolumeTypeFromImageTest-1479156633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fc9859e-8b86-41a0-8ca7-c5ab55704282) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:59:48Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcaf7bb6-e137-4407-a8e2-068ba577a343,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51f7c4eb92ed4c8d8189f0edd11cc5fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:59:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:59:48Z,use_quota=True,user_id='7c3c1d323ca8461bb9dd110d7071da4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38613d7a-7dbe-4934-9525-ad5c1d84d063),volume_type_id=38613d7a-7dbe-4934-9525-ad5c1d84d063)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:59:48 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ccb6020d-d5e9-4893-80e3-3322922b3edd tempest-VolumeAndVolumeTypeFromImageTest-1479156633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbcda545-1642-49f7-8b68-e975fe4e93bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:59:48 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ccb6020d-d5e9-4893-80e3-3322922b3edd tempest-VolumeAndVolumeTypeFromImageTest-1479156633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbcda545-1642-49f7-8b68-e975fe4e93bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:59:48 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ccb6020d-d5e9-4893-80e3-3322922b3edd tempest-VolumeAndVolumeTypeFromImageTest-1479156633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c2a966b-6c14-402a-bf87-4c8e765cda43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:59:48 devstack cinder-volume[87420]: DEBUG cinder.image.glance [None req-ccb6020d-d5e9-4893-80e3-3322922b3edd tempest-VolumeAndVolumeTypeFromImageTest-1479156633 None] Creating Keystone auth plugin from conf {{(pid=87420) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 10 15:59:48 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-8a5152c4-4f7f-49f7-b6ff-558cebbd6422 tempest-VolumesTransfersV355Test-996250049 None] Acquiring lock "cinder-1c2139f9-6a3e-47c3-8f9b-992a77dfc3ee-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:59:48 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ccb6020d-d5e9-4893-80e3-3322922b3edd tempest-VolumeAndVolumeTypeFromImageTest-1479156633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c2a966b-6c14-402a-bf87-4c8e765cda43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fcaf7bb6-e137-4407-a8e2-068ba577a343', 'volume_name': 'volume-fcaf7bb6-e137-4407-a8e2-068ba577a343', 'volume_size': 1, 'image_id': '5c4ed4f7-366f-4a40-836d-0953ba325130', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5c4ed4f7-366f-4a40-836d-0953ba325130', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b587487bf9d36e0103553ae74adf4be4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '51f7c4eb92ed4c8d8189f0edd11cc5fb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0b93f9a409dbe171a68af6c839fbda52e4631046353f2091a0754ac4cd2767a4585ef5589c63705f8b8542e30dbb53d1483978350ed81776c10fb40a8495dd56', 'id': '5c4ed4f7-366f-4a40-836d-0953ba325130', 'created_at': datetime.datetime(2026, 7, 10, 13, 59, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 13, 59, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5c4ed4f7-366f-4a40-836d-0953ba325130/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:59:48 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ccb6020d-d5e9-4893-80e3-3322922b3edd tempest-VolumeAndVolumeTypeFromImageTest-1479156633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cbaf251-e53c-43ce-aaf2-1ece573a9920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:59:48 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ccb6020d-d5e9-4893-80e3-3322922b3edd tempest-VolumeAndVolumeTypeFromImageTest-1479156633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cbaf251-e53c-43ce-aaf2-1ece573a9920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:59:48 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ccb6020d-d5e9-4893-80e3-3322922b3edd tempest-VolumeAndVolumeTypeFromImageTest-1479156633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e60332d-bdd1-4072-b550-f09b4e180dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:59:48 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-ccb6020d-d5e9-4893-80e3-3322922b3edd tempest-VolumeAndVolumeTypeFromImageTest-1479156633 None] Volume fcaf7bb6-e137-4407-a8e2-068ba577a343: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fcaf7bb6-e137-4407-a8e2-068ba577a343', 'volume_size': 1, 'image_id': '5c4ed4f7-366f-4a40-836d-0953ba325130', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5c4ed4f7-366f-4a40-836d-0953ba325130', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b587487bf9d36e0103553ae74adf4be4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '51f7c4eb92ed4c8d8189f0edd11cc5fb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0b93f9a409dbe171a68af6c839fbda52e4631046353f2091a0754ac4cd2767a4585ef5589c63705f8b8542e30dbb53d1483978350ed81776c10fb40a8495dd56', 'id': '5c4ed4f7-366f-4a40-836d-0953ba325130', 'created_at': datetime.datetime(2026, 7, 10, 13, 59, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 13, 59, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5c4ed4f7-366f-4a40-836d-0953ba325130/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 10 15:59:48 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccb6020d-d5e9-4893-80e3-3322922b3edd tempest-VolumeAndVolumeTypeFromImageTest-1479156633 None] Trying to clone fcaf7bb6-e137-4407-a8e2-068ba577a343 from image 5c4ed4f7-366f-4a40-836d-0953ba325130 at location (None, [{'url': 'file:///opt/stack/data/glance/images/5c4ed4f7-366f-4a40-836d-0953ba325130', 'metadata': {}}]). {{(pid=87420) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 10 15:59:48 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-8a5152c4-4f7f-49f7-b6ff-558cebbd6422 tempest-VolumesTransfersV355Test-996250049 None] Lock "cinder-1c2139f9-6a3e-47c3-8f9b-992a77dfc3ee-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:59:48 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-8a5152c4-4f7f-49f7-b6ff-558cebbd6422 tempest-VolumesTransfersV355Test-996250049 None] Acquiring lock "cinder-quobyte-1c2139f9-6a3e-47c3-8f9b-992a77dfc3ee" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:59:48 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-8a5152c4-4f7f-49f7-b6ff-558cebbd6422 tempest-VolumesTransfersV355Test-996250049 None] Lock "cinder-quobyte-1c2139f9-6a3e-47c3-8f9b-992a77dfc3ee" acquired by "delete_volume" :: waited 0.015s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:59:48 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec391e8-1c80-4bd9-bdb6-a133aec07064]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:59:48 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8a5152c4-4f7f-49f7-b6ff-558cebbd6422 tempest-VolumesTransfersV355Test-996250049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1c2139f9-6a3e-47c3-8f9b-992a77dfc3ee {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:59:49 devstack cinder-volume[87420]: DEBUG cinder.image.image_utils [None req-ccb6020d-d5e9-4893-80e3-3322922b3edd tempest-VolumeAndVolumeTypeFromImageTest-1479156633 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5c4ed4f7-366f-4a40-836d-0953ba325130_2t_e_34ddevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87420) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 10 15:59:49 devstack cinder-volume[87420]: INFO cinder.image.image_utils [None req-ccb6020d-d5e9-4893-80e3-3322922b3edd tempest-VolumeAndVolumeTypeFromImageTest-1479156633 None] Image download 0.00 MB at 0.00 MB/s Jul 10 15:59:49 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c432cb6-c5fb-46ec-82bd-04a2bc474252]: (4, 'raw') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:59:49 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ccb6020d-d5e9-4893-80e3-3322922b3edd tempest-VolumeAndVolumeTypeFromImageTest-1479156633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5c4ed4f7-366f-4a40-836d-0953ba325130_2t_e_34ddevstack@QuobyteHD {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:59:49 devstack sudo[98983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1c2139f9-6a3e-47c3-8f9b-992a77dfc3ee Jul 10 15:59:49 devstack sudo[98983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:59:49 devstack sudo[98985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5c4ed4f7-366f-4a40-836d-0953ba325130_2t_e_34ddevstack@QuobyteHD Jul 10 15:59:49 devstack sudo[98985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:59:49 devstack sudo[98983]: pam_unix(sudo:session): session closed for user root Jul 10 15:59:49 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8a5152c4-4f7f-49f7-b6ff-558cebbd6422 tempest-VolumesTransfersV355Test-996250049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1c2139f9-6a3e-47c3-8f9b-992a77dfc3ee" returned: 0 in 0.980s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:59:49 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8a5152c4-4f7f-49f7-b6ff-558cebbd6422 tempest-VolumesTransfersV355Test-996250049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1c2139f9-6a3e-47c3-8f9b-992a77dfc3ee {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:59:49 devstack sudo[98996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1c2139f9-6a3e-47c3-8f9b-992a77dfc3ee Jul 10 15:59:49 devstack sudo[98996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:59:50 devstack sudo[98985]: pam_unix(sudo:session): session closed for user root Jul 10 15:59:50 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ccb6020d-d5e9-4893-80e3-3322922b3edd tempest-VolumeAndVolumeTypeFromImageTest-1479156633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5c4ed4f7-366f-4a40-836d-0953ba325130_2t_e_34ddevstack@QuobyteHD" returned: 0 in 0.930s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:59:50 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ccb6020d-d5e9-4893-80e3-3322922b3edd tempest-VolumeAndVolumeTypeFromImageTest-1479156633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5c4ed4f7-366f-4a40-836d-0953ba325130_2t_e_34ddevstack@QuobyteHD {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:59:50 devstack sudo[98998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5c4ed4f7-366f-4a40-836d-0953ba325130_2t_e_34ddevstack@QuobyteHD Jul 10 15:59:50 devstack sudo[98998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:59:50 devstack sudo[98996]: pam_unix(sudo:session): session closed for user root Jul 10 15:59:50 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8a5152c4-4f7f-49f7-b6ff-558cebbd6422 tempest-VolumesTransfersV355Test-996250049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1c2139f9-6a3e-47c3-8f9b-992a77dfc3ee" returned: 0 in 0.657s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:59:50 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-8a5152c4-4f7f-49f7-b6ff-558cebbd6422 tempest-VolumesTransfersV355Test-996250049 None] Lock "cinder-quobyte-1c2139f9-6a3e-47c3-8f9b-992a77dfc3ee" released by "delete_volume" :: held 1.686s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:59:50 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-8a5152c4-4f7f-49f7-b6ff-558cebbd6422 tempest-VolumesTransfersV355Test-996250049 None] Created reservations ['c6137e75-ad4b-4e64-8c25-ee3d7b29bbda', 'ff09d528-d699-4753-a142-05cd349c5b69', 'feafe2ba-adaa-4c28-8f4e-572d622d90aa', '20eab99b-6238-4380-ae71-f15a85e65688'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 15:59:50 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-8a5152c4-4f7f-49f7-b6ff-558cebbd6422 tempest-VolumesTransfersV355Test-996250049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:59:50 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-8a5152c4-4f7f-49f7-b6ff-558cebbd6422 tempest-VolumesTransfersV355Test-996250049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:59:50 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-8a5152c4-4f7f-49f7-b6ff-558cebbd6422 tempest-VolumesTransfersV355Test-996250049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:59:50 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-8a5152c4-4f7f-49f7-b6ff-558cebbd6422 tempest-VolumesTransfersV355Test-996250049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:59:50 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-8a5152c4-4f7f-49f7-b6ff-558cebbd6422 tempest-VolumesTransfersV355Test-996250049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:59:50 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8a5152c4-4f7f-49f7-b6ff-558cebbd6422 tempest-VolumesTransfersV355Test-996250049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:59:50 devstack sudo[98998]: pam_unix(sudo:session): session closed for user root Jul 10 15:59:50 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ccb6020d-d5e9-4893-80e3-3322922b3edd tempest-VolumeAndVolumeTypeFromImageTest-1479156633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5c4ed4f7-366f-4a40-836d-0953ba325130_2t_e_34ddevstack@QuobyteHD" returned: 1 in 0.746s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:59:50 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ccb6020d-d5e9-4893-80e3-3322922b3edd tempest-VolumeAndVolumeTypeFromImageTest-1479156633 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5c4ed4f7-366f-4a40-836d-0953ba325130_2t_e_34ddevstack@QuobyteHD' failed. Not Retrying. {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 15:59:50 devstack cinder-volume[87420]: DEBUG cinder.image.image_utils [None req-ccb6020d-d5e9-4893-80e3-3322922b3edd tempest-VolumeAndVolumeTypeFromImageTest-1479156633 None] Temporary image 5c4ed4f7-366f-4a40-836d-0953ba325130 is fetched for user 7c3c1d323ca8461bb9dd110d7071da4e. {{(pid=87420) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 10 15:59:50 devstack sudo[99005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 15:59:50 devstack sudo[99005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:59:50 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6ac0852-c908-4242-a6d2-04ebae939b56]: (4, 'raw') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:59:50 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ccb6020d-d5e9-4893-80e3-3322922b3edd tempest-VolumeAndVolumeTypeFromImageTest-1479156633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5c4ed4f7-366f-4a40-836d-0953ba325130_2t_e_34ddevstack@QuobyteHD {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:59:50 devstack sudo[99007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5c4ed4f7-366f-4a40-836d-0953ba325130_2t_e_34ddevstack@QuobyteHD Jul 10 15:59:50 devstack sudo[99007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:59:51 devstack sudo[99005]: pam_unix(sudo:session): session closed for user root Jul 10 15:59:51 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8a5152c4-4f7f-49f7-b6ff-558cebbd6422 tempest-VolumesTransfersV355Test-996250049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.836s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:59:51 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-8a5152c4-4f7f-49f7-b6ff-558cebbd6422 tempest-VolumesTransfersV355Test-996250049 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 15:59:51 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-8a5152c4-4f7f-49f7-b6ff-558cebbd6422 tempest-VolumesTransfersV355Test-996250049 None] Deleted volume successfully. Jul 10 15:59:51 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-8a5152c4-4f7f-49f7-b6ff-558cebbd6422 tempest-VolumesTransfersV355Test-996250049 None] Lock "cinder-1c2139f9-6a3e-47c3-8f9b-992a77dfc3ee-delete_volume" released by "delete_volume" :: held 2.764s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:59:51 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ce0f8a6-6700-46c1-abf6-f125141abee4 tempest-VolumesTransfersV355Test-1053559699 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 15:59:51 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-8ce0f8a6-6700-46c1-abf6-f125141abee4 tempest-VolumesTransfersV355Test-1053559699 None] Flow 'volume_create_manager' (782a7714-165f-4b14-a5ad-0162b02d633f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:59:51 devstack sudo[99007]: pam_unix(sudo:session): session closed for user root Jul 10 15:59:51 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-8ce0f8a6-6700-46c1-abf6-f125141abee4 tempest-VolumesTransfersV355Test-1053559699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5cba0a5-19be-4ff8-874a-e956ce06048f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:59:51 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ccb6020d-d5e9-4893-80e3-3322922b3edd tempest-VolumeAndVolumeTypeFromImageTest-1479156633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5c4ed4f7-366f-4a40-836d-0953ba325130_2t_e_34ddevstack@QuobyteHD" returned: 0 in 0.834s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:59:51 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ccb6020d-d5e9-4893-80e3-3322922b3edd tempest-VolumeAndVolumeTypeFromImageTest-1479156633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5c4ed4f7-366f-4a40-836d-0953ba325130_2t_e_34ddevstack@QuobyteHD {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:59:51 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-8ce0f8a6-6700-46c1-abf6-f125141abee4 tempest-VolumesTransfersV355Test-1053559699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5cba0a5-19be-4ff8-874a-e956ce06048f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:59:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-838784565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36abfddc-7c58-4bde-8008-4914b5e3acf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e478de5441a74bcea81b5afa5c28b6a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:59:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:59:52Z,use_quota=True,user_id='baf5995c4fdd4f3f86379b2be2c6c723',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:59:51 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-8ce0f8a6-6700-46c1-abf6-f125141abee4 tempest-VolumesTransfersV355Test-1053559699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c7534e5-e151-4eb0-92dc-e294d626077e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:59:51 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-8ce0f8a6-6700-46c1-abf6-f125141abee4 tempest-VolumesTransfersV355Test-1053559699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c7534e5-e151-4eb0-92dc-e294d626077e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:59:51 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-8ce0f8a6-6700-46c1-abf6-f125141abee4 tempest-VolumesTransfersV355Test-1053559699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81d9eb9f-9d4a-413e-82ac-6f1c7843ac77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:59:51 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-8ce0f8a6-6700-46c1-abf6-f125141abee4 tempest-VolumesTransfersV355Test-1053559699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81d9eb9f-9d4a-413e-82ac-6f1c7843ac77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36abfddc-7c58-4bde-8008-4914b5e3acf6', 'volume_name': 'volume-36abfddc-7c58-4bde-8008-4914b5e3acf6', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:59:51 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-8ce0f8a6-6700-46c1-abf6-f125141abee4 tempest-VolumesTransfersV355Test-1053559699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c71725c-f6e5-494c-9d89-356f638f4e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:59:51 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-8ce0f8a6-6700-46c1-abf6-f125141abee4 tempest-VolumesTransfersV355Test-1053559699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c71725c-f6e5-494c-9d89-356f638f4e8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:59:51 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-8ce0f8a6-6700-46c1-abf6-f125141abee4 tempest-VolumesTransfersV355Test-1053559699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc0a6b07-6fb5-49fa-94d9-158ca831d1e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:59:51 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-8ce0f8a6-6700-46c1-abf6-f125141abee4 tempest-VolumesTransfersV355Test-1053559699 None] Volume 36abfddc-7c58-4bde-8008-4914b5e3acf6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36abfddc-7c58-4bde-8008-4914b5e3acf6', 'volume_size': 1} Jul 10 15:59:51 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-8ce0f8a6-6700-46c1-abf6-f125141abee4 tempest-VolumesTransfersV355Test-1053559699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:59:51 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-8ce0f8a6-6700-46c1-abf6-f125141abee4 tempest-VolumesTransfersV355Test-1053559699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:59:51 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-8ce0f8a6-6700-46c1-abf6-f125141abee4 tempest-VolumesTransfersV355Test-1053559699 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:59:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-838784565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36abfddc-7c58-4bde-8008-4914b5e3acf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e478de5441a74bcea81b5afa5c28b6a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:59:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:59:52Z,use_quota=True,user_id='baf5995c4fdd4f3f86379b2be2c6c723',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 15:59:51 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-8ce0f8a6-6700-46c1-abf6-f125141abee4 tempest-VolumesTransfersV355Test-1053559699 None] Creating volume 36abfddc-7c58-4bde-8008-4914b5e3acf6 {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 15:59:51 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-8ce0f8a6-6700-46c1-abf6-f125141abee4 tempest-VolumesTransfersV355Test-1053559699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:59:51 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-8ce0f8a6-6700-46c1-abf6-f125141abee4 tempest-VolumesTransfersV355Test-1053559699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:59:51 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-8ce0f8a6-6700-46c1-abf6-f125141abee4 tempest-VolumesTransfersV355Test-1053559699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:59:51 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-8ce0f8a6-6700-46c1-abf6-f125141abee4 tempest-VolumesTransfersV355Test-1053559699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:59:51 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-8ce0f8a6-6700-46c1-abf6-f125141abee4 tempest-VolumesTransfersV355Test-1053559699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:59:51 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-8ce0f8a6-6700-46c1-abf6-f125141abee4 tempest-VolumesTransfersV355Test-1053559699 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 15:59:51 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-8ce0f8a6-6700-46c1-abf6-f125141abee4 tempest-VolumesTransfersV355Test-1053559699 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 15:59:51 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8ce0f8a6-6700-46c1-abf6-f125141abee4 tempest-VolumesTransfersV355Test-1053559699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-36abfddc-7c58-4bde-8008-4914b5e3acf6 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:59:51 devstack sudo[99013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-36abfddc-7c58-4bde-8008-4914b5e3acf6 1073741824 Jul 10 15:59:51 devstack sudo[99013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:59:51 devstack sudo[99012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5c4ed4f7-366f-4a40-836d-0953ba325130_2t_e_34ddevstack@QuobyteHD Jul 10 15:59:51 devstack sudo[99012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:59:52 devstack sudo[99012]: pam_unix(sudo:session): session closed for user root Jul 10 15:59:52 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ccb6020d-d5e9-4893-80e3-3322922b3edd tempest-VolumeAndVolumeTypeFromImageTest-1479156633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5c4ed4f7-366f-4a40-836d-0953ba325130_2t_e_34ddevstack@QuobyteHD" returned: 1 in 0.772s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:59:52 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ccb6020d-d5e9-4893-80e3-3322922b3edd tempest-VolumeAndVolumeTypeFromImageTest-1479156633 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5c4ed4f7-366f-4a40-836d-0953ba325130_2t_e_34ddevstack@QuobyteHD' failed. Not Retrying. {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 15:59:52 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-ccb6020d-d5e9-4893-80e3-3322922b3edd tempest-VolumeAndVolumeTypeFromImageTest-1479156633 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:59:52 devstack sudo[99013]: pam_unix(sudo:session): session closed for user root Jul 10 15:59:52 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8ce0f8a6-6700-46c1-abf6-f125141abee4 tempest-VolumesTransfersV355Test-1053559699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-36abfddc-7c58-4bde-8008-4914b5e3acf6 1073741824" returned: 0 in 0.860s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:59:52 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8ce0f8a6-6700-46c1-abf6-f125141abee4 tempest-VolumesTransfersV355Test-1053559699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-36abfddc-7c58-4bde-8008-4914b5e3acf6 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:59:52 devstack sudo[99023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-36abfddc-7c58-4bde-8008-4914b5e3acf6 Jul 10 15:59:52 devstack sudo[99023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:59:53 devstack sudo[99023]: pam_unix(sudo:session): session closed for user root Jul 10 15:59:53 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8ce0f8a6-6700-46c1-abf6-f125141abee4 tempest-VolumesTransfersV355Test-1053559699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-36abfddc-7c58-4bde-8008-4914b5e3acf6" returned: 0 in 0.661s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:59:53 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-8ce0f8a6-6700-46c1-abf6-f125141abee4 tempest-VolumesTransfersV355Test-1053559699 None] <== create_volume: return (1577ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 15:59:53 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-8ce0f8a6-6700-46c1-abf6-f125141abee4 tempest-VolumesTransfersV355Test-1053559699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.580s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:59:53 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-ccb6020d-d5e9-4893-80e3-3322922b3edd tempest-VolumeAndVolumeTypeFromImageTest-1479156633 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.876s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:59:53 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-ccb6020d-d5e9-4893-80e3-3322922b3edd tempest-VolumeAndVolumeTypeFromImageTest-1479156633 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:59:48Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcaf7bb6-e137-4407-a8e2-068ba577a343,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51f7c4eb92ed4c8d8189f0edd11cc5fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:59:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:59:48Z,use_quota=True,user_id='7c3c1d323ca8461bb9dd110d7071da4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38613d7a-7dbe-4934-9525-ad5c1d84d063),volume_type_id=38613d7a-7dbe-4934-9525-ad5c1d84d063)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 15:59:53 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-ccb6020d-d5e9-4893-80e3-3322922b3edd tempest-VolumeAndVolumeTypeFromImageTest-1479156633 None] Creating volume fcaf7bb6-e137-4407-a8e2-068ba577a343 {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 15:59:53 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-ccb6020d-d5e9-4893-80e3-3322922b3edd tempest-VolumeAndVolumeTypeFromImageTest-1479156633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:59:53 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-ccb6020d-d5e9-4893-80e3-3322922b3edd tempest-VolumeAndVolumeTypeFromImageTest-1479156633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:59:53 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-ccb6020d-d5e9-4893-80e3-3322922b3edd tempest-VolumeAndVolumeTypeFromImageTest-1479156633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:59:53 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-ccb6020d-d5e9-4893-80e3-3322922b3edd tempest-VolumeAndVolumeTypeFromImageTest-1479156633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:59:53 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-ccb6020d-d5e9-4893-80e3-3322922b3edd tempest-VolumeAndVolumeTypeFromImageTest-1479156633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:59:53 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-ccb6020d-d5e9-4893-80e3-3322922b3edd tempest-VolumeAndVolumeTypeFromImageTest-1479156633 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 15:59:53 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-ccb6020d-d5e9-4893-80e3-3322922b3edd tempest-VolumeAndVolumeTypeFromImageTest-1479156633 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 15:59:53 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ccb6020d-d5e9-4893-80e3-3322922b3edd tempest-VolumeAndVolumeTypeFromImageTest-1479156633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-fcaf7bb6-e137-4407-a8e2-068ba577a343 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:59:53 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-8ce0f8a6-6700-46c1-abf6-f125141abee4 tempest-VolumesTransfersV355Test-1053559699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc0a6b07-6fb5-49fa-94d9-158ca831d1e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36abfddc-7c58-4bde-8008-4914b5e3acf6', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:59:53 devstack sudo[99027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-fcaf7bb6-e137-4407-a8e2-068ba577a343 1073741824 Jul 10 15:59:53 devstack sudo[99027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:59:53 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-8ce0f8a6-6700-46c1-abf6-f125141abee4 tempest-VolumesTransfersV355Test-1053559699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a78144d2-d60f-4441-a043-f58a7fd9440b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:59:53 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-8ce0f8a6-6700-46c1-abf6-f125141abee4 tempest-VolumesTransfersV355Test-1053559699 None] Volume volume-36abfddc-7c58-4bde-8008-4914b5e3acf6 (36abfddc-7c58-4bde-8008-4914b5e3acf6): created successfully Jul 10 15:59:53 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-8ce0f8a6-6700-46c1-abf6-f125141abee4 tempest-VolumesTransfersV355Test-1053559699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a78144d2-d60f-4441-a043-f58a7fd9440b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:59:53 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-8ce0f8a6-6700-46c1-abf6-f125141abee4 tempest-VolumesTransfersV355Test-1053559699 None] Flow 'volume_create_manager' (782a7714-165f-4b14-a5ad-0162b02d633f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:59:53 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-8ce0f8a6-6700-46c1-abf6-f125141abee4 tempest-VolumesTransfersV355Test-1053559699 None] Created volume successfully. Jul 10 15:59:54 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-4af1b073-df65-470e-a8a1-9e924c90a4df tempest-VolumesTransfersV355Test-996250049 None] Acquiring lock "cinder-36abfddc-7c58-4bde-8008-4914b5e3acf6-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:59:54 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-4af1b073-df65-470e-a8a1-9e924c90a4df tempest-VolumesTransfersV355Test-996250049 None] Lock "cinder-36abfddc-7c58-4bde-8008-4914b5e3acf6-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:59:54 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-4af1b073-df65-470e-a8a1-9e924c90a4df tempest-VolumesTransfersV355Test-996250049 None] Acquiring lock "cinder-quobyte-36abfddc-7c58-4bde-8008-4914b5e3acf6" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:59:54 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-4af1b073-df65-470e-a8a1-9e924c90a4df tempest-VolumesTransfersV355Test-996250049 None] Lock "cinder-quobyte-36abfddc-7c58-4bde-8008-4914b5e3acf6" acquired by "delete_volume" :: waited 0.018s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:59:54 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[7df93bc5-5225-42ab-b580-72c4c860f8a6]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:59:54 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4af1b073-df65-470e-a8a1-9e924c90a4df tempest-VolumesTransfersV355Test-996250049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-36abfddc-7c58-4bde-8008-4914b5e3acf6 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:59:54 devstack sudo[99027]: pam_unix(sudo:session): session closed for user root Jul 10 15:59:54 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ccb6020d-d5e9-4893-80e3-3322922b3edd tempest-VolumeAndVolumeTypeFromImageTest-1479156633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-fcaf7bb6-e137-4407-a8e2-068ba577a343 1073741824" returned: 0 in 0.906s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:59:54 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ccb6020d-d5e9-4893-80e3-3322922b3edd tempest-VolumeAndVolumeTypeFromImageTest-1479156633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-fcaf7bb6-e137-4407-a8e2-068ba577a343 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:59:54 devstack sudo[99033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-36abfddc-7c58-4bde-8008-4914b5e3acf6 Jul 10 15:59:54 devstack sudo[99033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:59:54 devstack sudo[99035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-fcaf7bb6-e137-4407-a8e2-068ba577a343 Jul 10 15:59:54 devstack sudo[99035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:59:54 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc39b3cb-c980-4cb7-9ae9-628e8bfae6b5 tempest-VolumesActionsTest-462308728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 15:59:54 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-dc39b3cb-c980-4cb7-9ae9-628e8bfae6b5 tempest-VolumesActionsTest-462308728 None] Flow 'volume_create_manager' (3e135b16-1c3d-434a-92be-ea543aebc253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:59:54 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-dc39b3cb-c980-4cb7-9ae9-628e8bfae6b5 tempest-VolumesActionsTest-462308728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30fe7e78-5b8d-49c9-9b6a-7ad677dc984b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:59:54 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-dc39b3cb-c980-4cb7-9ae9-628e8bfae6b5 tempest-VolumesActionsTest-462308728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30fe7e78-5b8d-49c9-9b6a-7ad677dc984b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:59:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2085287701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6687083d-57ed-413f-af55-9bb75c5bc95a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1c36a9c42fa40b78bc74dd9edaf17ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:59:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:59:55Z,use_quota=True,user_id='269a68e2fcc64ca3ae097dcfc9d72e93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:59:54 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-dc39b3cb-c980-4cb7-9ae9-628e8bfae6b5 tempest-VolumesActionsTest-462308728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5caae67e-dad8-4288-8e8c-fb775612a6a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:59:54 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-dc39b3cb-c980-4cb7-9ae9-628e8bfae6b5 tempest-VolumesActionsTest-462308728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5caae67e-dad8-4288-8e8c-fb775612a6a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:59:54 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-dc39b3cb-c980-4cb7-9ae9-628e8bfae6b5 tempest-VolumesActionsTest-462308728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (447faf18-d5f7-431f-8770-5da664b22dd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:59:54 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-dc39b3cb-c980-4cb7-9ae9-628e8bfae6b5 tempest-VolumesActionsTest-462308728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (447faf18-d5f7-431f-8770-5da664b22dd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6687083d-57ed-413f-af55-9bb75c5bc95a', 'volume_name': 'volume-6687083d-57ed-413f-af55-9bb75c5bc95a', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:59:54 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-dc39b3cb-c980-4cb7-9ae9-628e8bfae6b5 tempest-VolumesActionsTest-462308728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a82fa2e2-5ff6-4ed7-ab8f-cc0cb5597fb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:59:54 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-dc39b3cb-c980-4cb7-9ae9-628e8bfae6b5 tempest-VolumesActionsTest-462308728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a82fa2e2-5ff6-4ed7-ab8f-cc0cb5597fb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:59:54 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-dc39b3cb-c980-4cb7-9ae9-628e8bfae6b5 tempest-VolumesActionsTest-462308728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6eb8fe66-b29b-499b-a15f-13755e413f24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:59:54 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-dc39b3cb-c980-4cb7-9ae9-628e8bfae6b5 tempest-VolumesActionsTest-462308728 None] Volume 6687083d-57ed-413f-af55-9bb75c5bc95a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6687083d-57ed-413f-af55-9bb75c5bc95a', 'volume_size': 1} Jul 10 15:59:54 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-dc39b3cb-c980-4cb7-9ae9-628e8bfae6b5 tempest-VolumesActionsTest-462308728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:59:54 devstack sudo[99035]: pam_unix(sudo:session): session closed for user root Jul 10 15:59:54 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ccb6020d-d5e9-4893-80e3-3322922b3edd tempest-VolumeAndVolumeTypeFromImageTest-1479156633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-fcaf7bb6-e137-4407-a8e2-068ba577a343" returned: 0 in 0.690s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:59:54 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-ccb6020d-d5e9-4893-80e3-3322922b3edd tempest-VolumeAndVolumeTypeFromImageTest-1479156633 None] <== create_volume: return (1644ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 15:59:54 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-ccb6020d-d5e9-4893-80e3-3322922b3edd tempest-VolumeAndVolumeTypeFromImageTest-1479156633 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.647s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:59:54 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-dc39b3cb-c980-4cb7-9ae9-628e8bfae6b5 tempest-VolumesActionsTest-462308728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.193s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:59:54 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-dc39b3cb-c980-4cb7-9ae9-628e8bfae6b5 tempest-VolumesActionsTest-462308728 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T13:59:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2085287701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6687083d-57ed-413f-af55-9bb75c5bc95a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1c36a9c42fa40b78bc74dd9edaf17ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T13:59:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T13:59:55Z,use_quota=True,user_id='269a68e2fcc64ca3ae097dcfc9d72e93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 15:59:54 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-dc39b3cb-c980-4cb7-9ae9-628e8bfae6b5 tempest-VolumesActionsTest-462308728 None] Creating volume 6687083d-57ed-413f-af55-9bb75c5bc95a {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 15:59:54 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-dc39b3cb-c980-4cb7-9ae9-628e8bfae6b5 tempest-VolumesActionsTest-462308728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:59:54 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-dc39b3cb-c980-4cb7-9ae9-628e8bfae6b5 tempest-VolumesActionsTest-462308728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:59:54 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-dc39b3cb-c980-4cb7-9ae9-628e8bfae6b5 tempest-VolumesActionsTest-462308728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:59:55 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-dc39b3cb-c980-4cb7-9ae9-628e8bfae6b5 tempest-VolumesActionsTest-462308728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:59:55 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-dc39b3cb-c980-4cb7-9ae9-628e8bfae6b5 tempest-VolumesActionsTest-462308728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:59:55 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-dc39b3cb-c980-4cb7-9ae9-628e8bfae6b5 tempest-VolumesActionsTest-462308728 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 15:59:55 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-dc39b3cb-c980-4cb7-9ae9-628e8bfae6b5 tempest-VolumesActionsTest-462308728 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 15:59:55 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-dc39b3cb-c980-4cb7-9ae9-628e8bfae6b5 tempest-VolumesActionsTest-462308728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6687083d-57ed-413f-af55-9bb75c5bc95a 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:59:55 devstack sudo[99033]: pam_unix(sudo:session): session closed for user root Jul 10 15:59:55 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4af1b073-df65-470e-a8a1-9e924c90a4df tempest-VolumesTransfersV355Test-996250049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-36abfddc-7c58-4bde-8008-4914b5e3acf6" returned: 0 in 0.841s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:59:55 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4af1b073-df65-470e-a8a1-9e924c90a4df tempest-VolumesTransfersV355Test-996250049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-36abfddc-7c58-4bde-8008-4914b5e3acf6 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:59:55 devstack sudo[99041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6687083d-57ed-413f-af55-9bb75c5bc95a 1073741824 Jul 10 15:59:55 devstack sudo[99041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:59:55 devstack sudo[99043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-36abfddc-7c58-4bde-8008-4914b5e3acf6 Jul 10 15:59:55 devstack cinder-volume[87420]: DEBUG cinder.volume.volume_utils [None req-ccb6020d-d5e9-4893-80e3-3322922b3edd tempest-VolumeAndVolumeTypeFromImageTest-1479156633 None] Attempting download of 5c4ed4f7-366f-4a40-836d-0953ba325130 ((None, [{'url': 'file:///opt/stack/data/glance/images/5c4ed4f7-366f-4a40-836d-0953ba325130', 'metadata': {}}])) to volume fcaf7bb6-e137-4407-a8e2-068ba577a343. {{(pid=87420) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 10 15:59:55 devstack sudo[99043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:59:55 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[23c2f969-c368-43f1-932d-c5a1c087d884]: (4, 'raw') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:59:55 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ccb6020d-d5e9-4893-80e3-3322922b3edd tempest-VolumeAndVolumeTypeFromImageTest-1479156633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5c4ed4f7-366f-4a40-836d-0953ba325130__wrgrb3b {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:59:55 devstack sudo[99045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5c4ed4f7-366f-4a40-836d-0953ba325130__wrgrb3b Jul 10 15:59:55 devstack sudo[99045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:59:55 devstack sudo[99043]: pam_unix(sudo:session): session closed for user root Jul 10 15:59:55 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4af1b073-df65-470e-a8a1-9e924c90a4df tempest-VolumesTransfersV355Test-996250049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-36abfddc-7c58-4bde-8008-4914b5e3acf6" returned: 0 in 0.713s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:59:55 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-4af1b073-df65-470e-a8a1-9e924c90a4df tempest-VolumesTransfersV355Test-996250049 None] Lock "cinder-quobyte-36abfddc-7c58-4bde-8008-4914b5e3acf6" released by "delete_volume" :: held 1.619s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:59:55 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-4af1b073-df65-470e-a8a1-9e924c90a4df tempest-VolumesTransfersV355Test-996250049 None] Created reservations ['44b1100d-1b4e-4883-bb63-f6ebde3a189f', '45a407fd-fb2f-4788-9670-02e859949a9f', 'da785041-d574-4233-8c4a-7851bd6e6cd7', '05e46c8e-4060-4a27-9807-c967a63bc139'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 15:59:55 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-4af1b073-df65-470e-a8a1-9e924c90a4df tempest-VolumesTransfersV355Test-996250049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 15:59:55 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-4af1b073-df65-470e-a8a1-9e924c90a4df tempest-VolumesTransfersV355Test-996250049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 15:59:55 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-4af1b073-df65-470e-a8a1-9e924c90a4df tempest-VolumesTransfersV355Test-996250049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 15:59:55 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-4af1b073-df65-470e-a8a1-9e924c90a4df tempest-VolumesTransfersV355Test-996250049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 15:59:55 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-4af1b073-df65-470e-a8a1-9e924c90a4df tempest-VolumesTransfersV355Test-996250049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:59:55 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4af1b073-df65-470e-a8a1-9e924c90a4df tempest-VolumesTransfersV355Test-996250049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:59:55 devstack sudo[99053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 15:59:55 devstack sudo[99053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:59:55 devstack sudo[99045]: pam_unix(sudo:session): session closed for user root Jul 10 15:59:55 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ccb6020d-d5e9-4893-80e3-3322922b3edd tempest-VolumeAndVolumeTypeFromImageTest-1479156633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5c4ed4f7-366f-4a40-836d-0953ba325130__wrgrb3b" returned: 0 in 0.867s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:59:55 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ccb6020d-d5e9-4893-80e3-3322922b3edd tempest-VolumeAndVolumeTypeFromImageTest-1479156633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5c4ed4f7-366f-4a40-836d-0953ba325130__wrgrb3b {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:59:56 devstack sudo[99041]: pam_unix(sudo:session): session closed for user root Jul 10 15:59:56 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-dc39b3cb-c980-4cb7-9ae9-628e8bfae6b5 tempest-VolumesActionsTest-462308728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6687083d-57ed-413f-af55-9bb75c5bc95a 1073741824" returned: 0 in 1.010s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:59:56 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-dc39b3cb-c980-4cb7-9ae9-628e8bfae6b5 tempest-VolumesActionsTest-462308728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6687083d-57ed-413f-af55-9bb75c5bc95a {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:59:56 devstack sudo[99056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6687083d-57ed-413f-af55-9bb75c5bc95a Jul 10 15:59:56 devstack sudo[99056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:59:56 devstack sudo[99055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5c4ed4f7-366f-4a40-836d-0953ba325130__wrgrb3b Jul 10 15:59:56 devstack sudo[99055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:59:56 devstack sudo[99053]: pam_unix(sudo:session): session closed for user root Jul 10 15:59:56 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4af1b073-df65-470e-a8a1-9e924c90a4df tempest-VolumesTransfersV355Test-996250049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.875s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:59:56 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-4af1b073-df65-470e-a8a1-9e924c90a4df tempest-VolumesTransfersV355Test-996250049 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 15:59:56 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-4af1b073-df65-470e-a8a1-9e924c90a4df tempest-VolumesTransfersV355Test-996250049 None] Deleted volume successfully. Jul 10 15:59:56 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-4af1b073-df65-470e-a8a1-9e924c90a4df tempest-VolumesTransfersV355Test-996250049 None] Lock "cinder-36abfddc-7c58-4bde-8008-4914b5e3acf6-delete_volume" released by "delete_volume" :: held 2.772s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 15:59:56 devstack sudo[99056]: pam_unix(sudo:session): session closed for user root Jul 10 15:59:56 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-dc39b3cb-c980-4cb7-9ae9-628e8bfae6b5 tempest-VolumesActionsTest-462308728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6687083d-57ed-413f-af55-9bb75c5bc95a" returned: 0 in 0.905s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:59:56 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-dc39b3cb-c980-4cb7-9ae9-628e8bfae6b5 tempest-VolumesActionsTest-462308728 None] <== create_volume: return (1968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 15:59:56 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-dc39b3cb-c980-4cb7-9ae9-628e8bfae6b5 tempest-VolumesActionsTest-462308728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.971s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 15:59:56 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-dc39b3cb-c980-4cb7-9ae9-628e8bfae6b5 tempest-VolumesActionsTest-462308728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6eb8fe66-b29b-499b-a15f-13755e413f24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6687083d-57ed-413f-af55-9bb75c5bc95a', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:59:56 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-dc39b3cb-c980-4cb7-9ae9-628e8bfae6b5 tempest-VolumesActionsTest-462308728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9271f6e0-85d9-4a92-bdb9-854e0ecb9e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 15:59:56 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-dc39b3cb-c980-4cb7-9ae9-628e8bfae6b5 tempest-VolumesActionsTest-462308728 None] Volume volume-6687083d-57ed-413f-af55-9bb75c5bc95a (6687083d-57ed-413f-af55-9bb75c5bc95a): created successfully Jul 10 15:59:57 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-dc39b3cb-c980-4cb7-9ae9-628e8bfae6b5 tempest-VolumesActionsTest-462308728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9271f6e0-85d9-4a92-bdb9-854e0ecb9e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 15:59:57 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-dc39b3cb-c980-4cb7-9ae9-628e8bfae6b5 tempest-VolumesActionsTest-462308728 None] Flow 'volume_create_manager' (3e135b16-1c3d-434a-92be-ea543aebc253) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 15:59:57 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-dc39b3cb-c980-4cb7-9ae9-628e8bfae6b5 tempest-VolumesActionsTest-462308728 None] Created volume successfully. Jul 10 15:59:57 devstack sudo[99055]: pam_unix(sudo:session): session closed for user root Jul 10 15:59:57 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ccb6020d-d5e9-4893-80e3-3322922b3edd tempest-VolumeAndVolumeTypeFromImageTest-1479156633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5c4ed4f7-366f-4a40-836d-0953ba325130__wrgrb3b" returned: 1 in 1.051s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:59:57 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ccb6020d-d5e9-4893-80e3-3322922b3edd tempest-VolumeAndVolumeTypeFromImageTest-1479156633 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5c4ed4f7-366f-4a40-836d-0953ba325130__wrgrb3b' failed. Not Retrying. {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 15:59:57 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bd074d9-df1e-44ec-87f8-320d186a42ab]: (4, 'raw') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:59:57 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ccb6020d-d5e9-4893-80e3-3322922b3edd tempest-VolumeAndVolumeTypeFromImageTest-1479156633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5c4ed4f7-366f-4a40-836d-0953ba325130_2t_e_34ddevstack@QuobyteHD {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:59:57 devstack sudo[99063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5c4ed4f7-366f-4a40-836d-0953ba325130_2t_e_34ddevstack@QuobyteHD Jul 10 15:59:57 devstack sudo[99063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:59:57 devstack sudo[99063]: pam_unix(sudo:session): session closed for user root Jul 10 15:59:57 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ccb6020d-d5e9-4893-80e3-3322922b3edd tempest-VolumeAndVolumeTypeFromImageTest-1479156633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5c4ed4f7-366f-4a40-836d-0953ba325130_2t_e_34ddevstack@QuobyteHD" returned: 0 in 0.838s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:59:57 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ccb6020d-d5e9-4893-80e3-3322922b3edd tempest-VolumeAndVolumeTypeFromImageTest-1479156633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5c4ed4f7-366f-4a40-836d-0953ba325130_2t_e_34ddevstack@QuobyteHD {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:59:58 devstack sudo[99067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5c4ed4f7-366f-4a40-836d-0953ba325130_2t_e_34ddevstack@QuobyteHD Jul 10 15:59:58 devstack sudo[99067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:59:58 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-64874e22-67a6-4da2-8144-15feded129ab tempest-VolumesActionsTest-306599127 None] Acquiring lock "cinder-6687083d-57ed-413f-af55-9bb75c5bc95a-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:59:58 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-64874e22-67a6-4da2-8144-15feded129ab tempest-VolumesActionsTest-306599127 None] Lock "cinder-6687083d-57ed-413f-af55-9bb75c5bc95a-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:59:58 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-64874e22-67a6-4da2-8144-15feded129ab tempest-VolumesActionsTest-306599127 None] Acquiring lock "cinder-quobyte-6687083d-57ed-413f-af55-9bb75c5bc95a" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 15:59:58 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-64874e22-67a6-4da2-8144-15feded129ab tempest-VolumesActionsTest-306599127 None] Lock "cinder-quobyte-6687083d-57ed-413f-af55-9bb75c5bc95a" acquired by "delete_volume" :: waited 0.015s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 15:59:58 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[b92063be-fac8-411e-86ec-ca344b4c7138]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 15:59:58 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-64874e22-67a6-4da2-8144-15feded129ab tempest-VolumesActionsTest-306599127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6687083d-57ed-413f-af55-9bb75c5bc95a {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:59:58 devstack sudo[99069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6687083d-57ed-413f-af55-9bb75c5bc95a Jul 10 15:59:58 devstack sudo[99069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:59:58 devstack sudo[99067]: pam_unix(sudo:session): session closed for user root Jul 10 15:59:58 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ccb6020d-d5e9-4893-80e3-3322922b3edd tempest-VolumeAndVolumeTypeFromImageTest-1479156633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5c4ed4f7-366f-4a40-836d-0953ba325130_2t_e_34ddevstack@QuobyteHD" returned: 1 in 0.837s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:59:58 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ccb6020d-d5e9-4893-80e3-3322922b3edd tempest-VolumeAndVolumeTypeFromImageTest-1479156633 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5c4ed4f7-366f-4a40-836d-0953ba325130_2t_e_34ddevstack@QuobyteHD' failed. Not Retrying. {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 15:59:58 devstack cinder-volume[87420]: DEBUG cinder.image.image_utils [None req-ccb6020d-d5e9-4893-80e3-3322922b3edd tempest-VolumeAndVolumeTypeFromImageTest-1479156633 None] 5c4ed4f7-366f-4a40-836d-0953ba325130 was raw, converting to raw {{(pid=87420) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 10 15:59:58 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ccb6020d-d5e9-4893-80e3-3322922b3edd tempest-VolumeAndVolumeTypeFromImageTest-1479156633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_5c4ed4f7-366f-4a40-836d-0953ba325130_2t_e_34ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-fcaf7bb6-e137-4407-a8e2-068ba577a343 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:59:58 devstack sudo[99074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_5c4ed4f7-366f-4a40-836d-0953ba325130_2t_e_34ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-fcaf7bb6-e137-4407-a8e2-068ba577a343 Jul 10 15:59:58 devstack sudo[99074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:59:59 devstack sudo[99069]: pam_unix(sudo:session): session closed for user root Jul 10 15:59:59 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-64874e22-67a6-4da2-8144-15feded129ab tempest-VolumesActionsTest-306599127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6687083d-57ed-413f-af55-9bb75c5bc95a" returned: 0 in 1.038s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:59:59 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-64874e22-67a6-4da2-8144-15feded129ab tempest-VolumesActionsTest-306599127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6687083d-57ed-413f-af55-9bb75c5bc95a {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:59:59 devstack sudo[99079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6687083d-57ed-413f-af55-9bb75c5bc95a Jul 10 15:59:59 devstack sudo[99079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 15:59:59 devstack sudo[99074]: pam_unix(sudo:session): session closed for user root Jul 10 15:59:59 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ccb6020d-d5e9-4893-80e3-3322922b3edd tempest-VolumeAndVolumeTypeFromImageTest-1479156633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_5c4ed4f7-366f-4a40-836d-0953ba325130_2t_e_34ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-fcaf7bb6-e137-4407-a8e2-068ba577a343" returned: 0 in 1.093s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 15:59:59 devstack cinder-volume[87420]: DEBUG cinder.image.image_utils [None req-ccb6020d-d5e9-4893-80e3-3322922b3edd tempest-VolumeAndVolumeTypeFromImageTest-1479156633 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5c4ed4f7-366f-4a40-836d-0953ba325130_2t_e_34ddevstack@QuobyteHD, size 0.00 MB, duration 1.09 sec, destination /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-fcaf7bb6-e137-4407-a8e2-068ba577a343 {{(pid=87420) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 15:59:59 devstack cinder-volume[87420]: INFO cinder.image.image_utils [None req-ccb6020d-d5e9-4893-80e3-3322922b3edd tempest-VolumeAndVolumeTypeFromImageTest-1479156633 None] Converted 0.00 MB image at 0.00 MB/s Jul 10 15:59:59 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ccb6020d-d5e9-4893-80e3-3322922b3edd tempest-VolumeAndVolumeTypeFromImageTest-1479156633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-fcaf7bb6-e137-4407-a8e2-068ba577a343 1G {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 15:59:59 devstack sudo[99084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-fcaf7bb6-e137-4407-a8e2-068ba577a343 1G Jul 10 15:59:59 devstack sudo[99084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:00:00 devstack sudo[99079]: pam_unix(sudo:session): session closed for user root Jul 10 16:00:00 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-64874e22-67a6-4da2-8144-15feded129ab tempest-VolumesActionsTest-306599127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6687083d-57ed-413f-af55-9bb75c5bc95a" returned: 0 in 0.803s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:00:00 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-64874e22-67a6-4da2-8144-15feded129ab tempest-VolumesActionsTest-306599127 None] Lock "cinder-quobyte-6687083d-57ed-413f-af55-9bb75c5bc95a" released by "delete_volume" :: held 1.898s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:00:00 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-64874e22-67a6-4da2-8144-15feded129ab tempest-VolumesActionsTest-306599127 None] Created reservations ['cc343f2a-8489-4447-a2b6-d5f607d0d0e6', 'b363c75c-cac0-4cc9-99be-5cf5f2e282cf', '63923ecf-cf33-4656-b870-7ab250b8dc3c', '666df537-6112-4a95-9a06-c725e4b37924'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:00:00 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-64874e22-67a6-4da2-8144-15feded129ab tempest-VolumesActionsTest-306599127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:00:00 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-64874e22-67a6-4da2-8144-15feded129ab tempest-VolumesActionsTest-306599127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:00:00 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-64874e22-67a6-4da2-8144-15feded129ab tempest-VolumesActionsTest-306599127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:00:00 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-64874e22-67a6-4da2-8144-15feded129ab tempest-VolumesActionsTest-306599127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:00:00 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-64874e22-67a6-4da2-8144-15feded129ab tempest-VolumesActionsTest-306599127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:00:00 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-64874e22-67a6-4da2-8144-15feded129ab tempest-VolumesActionsTest-306599127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:00:00 devstack sudo[99090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:00:00 devstack sudo[99090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:00:00 devstack sudo[99084]: pam_unix(sudo:session): session closed for user root Jul 10 16:00:00 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ccb6020d-d5e9-4893-80e3-3322922b3edd tempest-VolumeAndVolumeTypeFromImageTest-1479156633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-fcaf7bb6-e137-4407-a8e2-068ba577a343 1G" returned: 0 in 0.992s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:00:00 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbb96d90-1e14-4fb0-bc9b-abab53de8189]: (4, 'raw') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:00:00 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ccb6020d-d5e9-4893-80e3-3322922b3edd tempest-VolumeAndVolumeTypeFromImageTest-1479156633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-fcaf7bb6-e137-4407-a8e2-068ba577a343 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:00:01 devstack sudo[99092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-fcaf7bb6-e137-4407-a8e2-068ba577a343 Jul 10 16:00:01 devstack sudo[99092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:00:01 devstack sudo[99090]: pam_unix(sudo:session): session closed for user root Jul 10 16:00:01 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-64874e22-67a6-4da2-8144-15feded129ab tempest-VolumesActionsTest-306599127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.982s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:00:01 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-424ebb96-9f7a-482a-9394-b29cee08e3e6 tempest-VolumesActionsTest-462308728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 16:00:01 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-424ebb96-9f7a-482a-9394-b29cee08e3e6 tempest-VolumesActionsTest-462308728 None] Flow 'volume_create_manager' (8c7658ed-7c23-42f2-a72a-ce2e6f0b5f25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:00:01 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-424ebb96-9f7a-482a-9394-b29cee08e3e6 tempest-VolumesActionsTest-462308728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e7317a0-13c1-4765-9c47-7e20261ac920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:00:01 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-64874e22-67a6-4da2-8144-15feded129ab tempest-VolumesActionsTest-306599127 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:00:01 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-64874e22-67a6-4da2-8144-15feded129ab tempest-VolumesActionsTest-306599127 None] Deleted volume successfully. Jul 10 16:00:01 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-424ebb96-9f7a-482a-9394-b29cee08e3e6 tempest-VolumesActionsTest-462308728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e7317a0-13c1-4765-9c47-7e20261ac920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:00:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1708062118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53a03426-4e8d-40b9-9f1a-032d2996b9de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1c36a9c42fa40b78bc74dd9edaf17ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:00:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:00:01Z,use_quota=True,user_id='269a68e2fcc64ca3ae097dcfc9d72e93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:00:01 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-424ebb96-9f7a-482a-9394-b29cee08e3e6 tempest-VolumesActionsTest-462308728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d5c5fb2-6ece-47c0-a953-cc15ed0f84b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:00:01 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-424ebb96-9f7a-482a-9394-b29cee08e3e6 tempest-VolumesActionsTest-462308728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d5c5fb2-6ece-47c0-a953-cc15ed0f84b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:00:01 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-424ebb96-9f7a-482a-9394-b29cee08e3e6 tempest-VolumesActionsTest-462308728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f95b96c0-bc3c-4a80-a127-c02433453d61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:00:01 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-424ebb96-9f7a-482a-9394-b29cee08e3e6 tempest-VolumesActionsTest-462308728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f95b96c0-bc3c-4a80-a127-c02433453d61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53a03426-4e8d-40b9-9f1a-032d2996b9de', 'volume_name': 'volume-53a03426-4e8d-40b9-9f1a-032d2996b9de', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:00:01 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-424ebb96-9f7a-482a-9394-b29cee08e3e6 tempest-VolumesActionsTest-462308728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d9f0bca-1407-41ef-82d8-e626f5576c06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:00:01 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-424ebb96-9f7a-482a-9394-b29cee08e3e6 tempest-VolumesActionsTest-462308728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d9f0bca-1407-41ef-82d8-e626f5576c06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:00:01 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-424ebb96-9f7a-482a-9394-b29cee08e3e6 tempest-VolumesActionsTest-462308728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5904ac34-cbef-4a8a-be68-1f2595880ec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:00:01 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-424ebb96-9f7a-482a-9394-b29cee08e3e6 tempest-VolumesActionsTest-462308728 None] Volume 53a03426-4e8d-40b9-9f1a-032d2996b9de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53a03426-4e8d-40b9-9f1a-032d2996b9de', 'volume_size': 1} Jul 10 16:00:01 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-424ebb96-9f7a-482a-9394-b29cee08e3e6 tempest-VolumesActionsTest-462308728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:00:01 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-424ebb96-9f7a-482a-9394-b29cee08e3e6 tempest-VolumesActionsTest-462308728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:00:01 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-424ebb96-9f7a-482a-9394-b29cee08e3e6 tempest-VolumesActionsTest-462308728 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:00:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1708062118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53a03426-4e8d-40b9-9f1a-032d2996b9de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1c36a9c42fa40b78bc74dd9edaf17ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:00:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:00:01Z,use_quota=True,user_id='269a68e2fcc64ca3ae097dcfc9d72e93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 16:00:01 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-424ebb96-9f7a-482a-9394-b29cee08e3e6 tempest-VolumesActionsTest-462308728 None] Creating volume 53a03426-4e8d-40b9-9f1a-032d2996b9de {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 16:00:01 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-424ebb96-9f7a-482a-9394-b29cee08e3e6 tempest-VolumesActionsTest-462308728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:00:01 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-424ebb96-9f7a-482a-9394-b29cee08e3e6 tempest-VolumesActionsTest-462308728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:00:01 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-424ebb96-9f7a-482a-9394-b29cee08e3e6 tempest-VolumesActionsTest-462308728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:00:01 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-424ebb96-9f7a-482a-9394-b29cee08e3e6 tempest-VolumesActionsTest-462308728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:00:01 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-424ebb96-9f7a-482a-9394-b29cee08e3e6 tempest-VolumesActionsTest-462308728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:00:01 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-424ebb96-9f7a-482a-9394-b29cee08e3e6 tempest-VolumesActionsTest-462308728 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 16:00:01 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-424ebb96-9f7a-482a-9394-b29cee08e3e6 tempest-VolumesActionsTest-462308728 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 16:00:01 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-424ebb96-9f7a-482a-9394-b29cee08e3e6 tempest-VolumesActionsTest-462308728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-53a03426-4e8d-40b9-9f1a-032d2996b9de 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:00:01 devstack sudo[99095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-53a03426-4e8d-40b9-9f1a-032d2996b9de 1073741824 Jul 10 16:00:01 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-64874e22-67a6-4da2-8144-15feded129ab tempest-VolumesActionsTest-306599127 None] Lock "cinder-6687083d-57ed-413f-af55-9bb75c5bc95a-delete_volume" released by "delete_volume" :: held 3.419s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:00:01 devstack sudo[99095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:00:02 devstack sudo[99092]: pam_unix(sudo:session): session closed for user root Jul 10 16:00:02 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ccb6020d-d5e9-4893-80e3-3322922b3edd tempest-VolumeAndVolumeTypeFromImageTest-1479156633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-fcaf7bb6-e137-4407-a8e2-068ba577a343" returned: 0 in 1.135s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:00:02 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ccb6020d-d5e9-4893-80e3-3322922b3edd tempest-VolumeAndVolumeTypeFromImageTest-1479156633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-fcaf7bb6-e137-4407-a8e2-068ba577a343 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:00:02 devstack sudo[99101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-fcaf7bb6-e137-4407-a8e2-068ba577a343 Jul 10 16:00:02 devstack sudo[99101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:00:02 devstack sudo[99095]: pam_unix(sudo:session): session closed for user root Jul 10 16:00:02 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-424ebb96-9f7a-482a-9394-b29cee08e3e6 tempest-VolumesActionsTest-462308728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-53a03426-4e8d-40b9-9f1a-032d2996b9de 1073741824" returned: 0 in 0.980s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:00:02 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-424ebb96-9f7a-482a-9394-b29cee08e3e6 tempest-VolumesActionsTest-462308728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-53a03426-4e8d-40b9-9f1a-032d2996b9de {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:00:02 devstack sudo[99107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-53a03426-4e8d-40b9-9f1a-032d2996b9de Jul 10 16:00:02 devstack sudo[99107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:00:02 devstack sudo[99101]: pam_unix(sudo:session): session closed for user root Jul 10 16:00:02 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ccb6020d-d5e9-4893-80e3-3322922b3edd tempest-VolumeAndVolumeTypeFromImageTest-1479156633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-fcaf7bb6-e137-4407-a8e2-068ba577a343" returned: 1 in 0.840s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:00:02 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ccb6020d-d5e9-4893-80e3-3322922b3edd tempest-VolumeAndVolumeTypeFromImageTest-1479156633 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-fcaf7bb6-e137-4407-a8e2-068ba577a343' failed. Not Retrying. {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 16:00:02 devstack cinder-volume[87420]: DEBUG cinder.volume.volume_utils [None req-ccb6020d-d5e9-4893-80e3-3322922b3edd tempest-VolumeAndVolumeTypeFromImageTest-1479156633 None] Downloaded image 5c4ed4f7-366f-4a40-836d-0953ba325130 ((None, [{'url': 'file:///opt/stack/data/glance/images/5c4ed4f7-366f-4a40-836d-0953ba325130', 'metadata': {}}])) to volume fcaf7bb6-e137-4407-a8e2-068ba577a343 successfully. {{(pid=87420) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 10 16:00:02 devstack cinder-volume[87420]: DEBUG cinder.image.image_utils [None req-ccb6020d-d5e9-4893-80e3-3322922b3edd tempest-VolumeAndVolumeTypeFromImageTest-1479156633 None] Temporary image 5c4ed4f7-366f-4a40-836d-0953ba325130 for user 7c3c1d323ca8461bb9dd110d7071da4e is deleted. {{(pid=87420) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 10 16:00:02 devstack cinder-volume[87420]: DEBUG cinder.volume.volume_utils [None req-ccb6020d-d5e9-4893-80e3-3322922b3edd tempest-VolumeAndVolumeTypeFromImageTest-1479156633 None] Marking volume fcaf7bb6-e137-4407-a8e2-068ba577a343 as bootable. {{(pid=87420) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 10 16:00:02 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccb6020d-d5e9-4893-80e3-3322922b3edd tempest-VolumeAndVolumeTypeFromImageTest-1479156633 None] Copying metadata from image 5c4ed4f7-366f-4a40-836d-0953ba325130 to fcaf7bb6-e137-4407-a8e2-068ba577a343. {{(pid=87420) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 10 16:00:02 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccb6020d-d5e9-4893-80e3-3322922b3edd tempest-VolumeAndVolumeTypeFromImageTest-1479156633 None] Creating volume glance metadata for volume fcaf7bb6-e137-4407-a8e2-068ba577a343 backed by image 5c4ed4f7-366f-4a40-836d-0953ba325130 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '5c4ed4f7-366f-4a40-836d-0953ba325130', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'b587487bf9d36e0103553ae74adf4be4', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87420) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 10 16:00:02 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ccb6020d-d5e9-4893-80e3-3322922b3edd tempest-VolumeAndVolumeTypeFromImageTest-1479156633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e60332d-bdd1-4072-b550-f09b4e180dcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fcaf7bb6-e137-4407-a8e2-068ba577a343', 'volume_size': 1, 'image_id': '5c4ed4f7-366f-4a40-836d-0953ba325130', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5c4ed4f7-366f-4a40-836d-0953ba325130', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b587487bf9d36e0103553ae74adf4be4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '51f7c4eb92ed4c8d8189f0edd11cc5fb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0b93f9a409dbe171a68af6c839fbda52e4631046353f2091a0754ac4cd2767a4585ef5589c63705f8b8542e30dbb53d1483978350ed81776c10fb40a8495dd56', 'id': '5c4ed4f7-366f-4a40-836d-0953ba325130', 'created_at': datetime.datetime(2026, 7, 10, 13, 59, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 13, 59, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5c4ed4f7-366f-4a40-836d-0953ba325130/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:00:02 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ccb6020d-d5e9-4893-80e3-3322922b3edd tempest-VolumeAndVolumeTypeFromImageTest-1479156633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86dfdd15-30e0-4b13-9233-ba26cad0cce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:00:03 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-ccb6020d-d5e9-4893-80e3-3322922b3edd tempest-VolumeAndVolumeTypeFromImageTest-1479156633 None] Volume volume-fcaf7bb6-e137-4407-a8e2-068ba577a343 (fcaf7bb6-e137-4407-a8e2-068ba577a343): created successfully Jul 10 16:00:03 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ccb6020d-d5e9-4893-80e3-3322922b3edd tempest-VolumeAndVolumeTypeFromImageTest-1479156633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86dfdd15-30e0-4b13-9233-ba26cad0cce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:00:03 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ccb6020d-d5e9-4893-80e3-3322922b3edd tempest-VolumeAndVolumeTypeFromImageTest-1479156633 None] Flow 'volume_create_manager' (b3ebacb9-05e6-488b-8c2e-ac004dd7ad16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:00:03 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-ccb6020d-d5e9-4893-80e3-3322922b3edd tempest-VolumeAndVolumeTypeFromImageTest-1479156633 None] Created volume successfully. Jul 10 16:00:03 devstack sudo[99107]: pam_unix(sudo:session): session closed for user root Jul 10 16:00:03 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-424ebb96-9f7a-482a-9394-b29cee08e3e6 tempest-VolumesActionsTest-462308728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-53a03426-4e8d-40b9-9f1a-032d2996b9de" returned: 0 in 0.714s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:00:03 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-424ebb96-9f7a-482a-9394-b29cee08e3e6 tempest-VolumesActionsTest-462308728 None] <== create_volume: return (1745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 16:00:03 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-424ebb96-9f7a-482a-9394-b29cee08e3e6 tempest-VolumesActionsTest-462308728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.747s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:00:03 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-424ebb96-9f7a-482a-9394-b29cee08e3e6 tempest-VolumesActionsTest-462308728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5904ac34-cbef-4a8a-be68-1f2595880ec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53a03426-4e8d-40b9-9f1a-032d2996b9de', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:00:03 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-424ebb96-9f7a-482a-9394-b29cee08e3e6 tempest-VolumesActionsTest-462308728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d46d4060-1f5a-46d8-913b-03b76248af03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:00:03 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-424ebb96-9f7a-482a-9394-b29cee08e3e6 tempest-VolumesActionsTest-462308728 None] Volume volume-53a03426-4e8d-40b9-9f1a-032d2996b9de (53a03426-4e8d-40b9-9f1a-032d2996b9de): created successfully Jul 10 16:00:03 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-424ebb96-9f7a-482a-9394-b29cee08e3e6 tempest-VolumesActionsTest-462308728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d46d4060-1f5a-46d8-913b-03b76248af03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:00:03 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-424ebb96-9f7a-482a-9394-b29cee08e3e6 tempest-VolumesActionsTest-462308728 None] Flow 'volume_create_manager' (8c7658ed-7c23-42f2-a72a-ce2e6f0b5f25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:00:03 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-424ebb96-9f7a-482a-9394-b29cee08e3e6 tempest-VolumesActionsTest-462308728 None] Created volume successfully. Jul 10 16:00:03 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-ff4007ff-0403-4232-a6b3-3c1eeaffd50c tempest-VolumeAndVolumeTypeFromImageTest-1479156633 None] Acquiring lock "cinder-fcaf7bb6-e137-4407-a8e2-068ba577a343-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:00:03 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-ff4007ff-0403-4232-a6b3-3c1eeaffd50c tempest-VolumeAndVolumeTypeFromImageTest-1479156633 None] Lock "cinder-fcaf7bb6-e137-4407-a8e2-068ba577a343-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:00:03 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-ff4007ff-0403-4232-a6b3-3c1eeaffd50c tempest-VolumeAndVolumeTypeFromImageTest-1479156633 None] Acquiring lock "cinder-quobyte-fcaf7bb6-e137-4407-a8e2-068ba577a343" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:00:03 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-ff4007ff-0403-4232-a6b3-3c1eeaffd50c tempest-VolumeAndVolumeTypeFromImageTest-1479156633 None] Lock "cinder-quobyte-fcaf7bb6-e137-4407-a8e2-068ba577a343" acquired by "delete_volume" :: waited 0.018s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:00:03 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[411feaaf-606e-4f52-b059-2230d6be1cfe]: (4, 'raw') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:00:03 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ff4007ff-0403-4232-a6b3-3c1eeaffd50c tempest-VolumeAndVolumeTypeFromImageTest-1479156633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-fcaf7bb6-e137-4407-a8e2-068ba577a343 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:00:03 devstack sudo[99114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-fcaf7bb6-e137-4407-a8e2-068ba577a343 Jul 10 16:00:03 devstack sudo[99114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:00:04 devstack sudo[99114]: pam_unix(sudo:session): session closed for user root Jul 10 16:00:04 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ff4007ff-0403-4232-a6b3-3c1eeaffd50c tempest-VolumeAndVolumeTypeFromImageTest-1479156633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-fcaf7bb6-e137-4407-a8e2-068ba577a343" returned: 0 in 0.792s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:00:04 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ff4007ff-0403-4232-a6b3-3c1eeaffd50c tempest-VolumeAndVolumeTypeFromImageTest-1479156633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-fcaf7bb6-e137-4407-a8e2-068ba577a343 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:00:04 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-b7c18cc6-2582-440d-9a84-4374053318fc tempest-VolumesActionsTest-306599127 None] Acquiring lock "cinder-53a03426-4e8d-40b9-9f1a-032d2996b9de-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:00:04 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-b7c18cc6-2582-440d-9a84-4374053318fc tempest-VolumesActionsTest-306599127 None] Lock "cinder-53a03426-4e8d-40b9-9f1a-032d2996b9de-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:00:04 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-b7c18cc6-2582-440d-9a84-4374053318fc tempest-VolumesActionsTest-306599127 None] Acquiring lock "cinder-quobyte-53a03426-4e8d-40b9-9f1a-032d2996b9de" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:00:04 devstack sudo[99118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-fcaf7bb6-e137-4407-a8e2-068ba577a343 Jul 10 16:00:04 devstack sudo[99118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:00:04 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-b7c18cc6-2582-440d-9a84-4374053318fc tempest-VolumesActionsTest-306599127 None] Lock "cinder-quobyte-53a03426-4e8d-40b9-9f1a-032d2996b9de" acquired by "delete_volume" :: waited 0.034s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:00:04 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[deefa44e-6e58-4e7f-b23d-d540bb5143e5]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:00:04 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-b7c18cc6-2582-440d-9a84-4374053318fc tempest-VolumesActionsTest-306599127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-53a03426-4e8d-40b9-9f1a-032d2996b9de {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:00:04 devstack sudo[99120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-53a03426-4e8d-40b9-9f1a-032d2996b9de Jul 10 16:00:04 devstack sudo[99120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:00:05 devstack sudo[99118]: pam_unix(sudo:session): session closed for user root Jul 10 16:00:05 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ff4007ff-0403-4232-a6b3-3c1eeaffd50c tempest-VolumeAndVolumeTypeFromImageTest-1479156633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-fcaf7bb6-e137-4407-a8e2-068ba577a343" returned: 1 in 0.871s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:00:05 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ff4007ff-0403-4232-a6b3-3c1eeaffd50c tempest-VolumeAndVolumeTypeFromImageTest-1479156633 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-fcaf7bb6-e137-4407-a8e2-068ba577a343' failed. Not Retrying. {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 16:00:05 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ff4007ff-0403-4232-a6b3-3c1eeaffd50c tempest-VolumeAndVolumeTypeFromImageTest-1479156633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-fcaf7bb6-e137-4407-a8e2-068ba577a343 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:00:05 devstack sudo[99125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-fcaf7bb6-e137-4407-a8e2-068ba577a343 Jul 10 16:00:05 devstack sudo[99125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:00:05 devstack sudo[99120]: pam_unix(sudo:session): session closed for user root Jul 10 16:00:05 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-b7c18cc6-2582-440d-9a84-4374053318fc tempest-VolumesActionsTest-306599127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-53a03426-4e8d-40b9-9f1a-032d2996b9de" returned: 0 in 0.852s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:00:05 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-b7c18cc6-2582-440d-9a84-4374053318fc tempest-VolumesActionsTest-306599127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-53a03426-4e8d-40b9-9f1a-032d2996b9de {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:00:05 devstack sudo[99130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-53a03426-4e8d-40b9-9f1a-032d2996b9de Jul 10 16:00:05 devstack sudo[99130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:00:06 devstack sudo[99125]: pam_unix(sudo:session): session closed for user root Jul 10 16:00:06 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ff4007ff-0403-4232-a6b3-3c1eeaffd50c tempest-VolumeAndVolumeTypeFromImageTest-1479156633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-fcaf7bb6-e137-4407-a8e2-068ba577a343" returned: 0 in 0.687s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:00:06 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-ff4007ff-0403-4232-a6b3-3c1eeaffd50c tempest-VolumeAndVolumeTypeFromImageTest-1479156633 None] Lock "cinder-quobyte-fcaf7bb6-e137-4407-a8e2-068ba577a343" released by "delete_volume" :: held 2.414s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:00:06 devstack cinder-volume[87420]: WARNING cinder.quota [None req-ff4007ff-0403-4232-a6b3-3c1eeaffd50c tempest-VolumeAndVolumeTypeFromImageTest-1479156633 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 10 16:00:06 devstack cinder-volume[87420]: WARNING cinder.quota [None req-ff4007ff-0403-4232-a6b3-3c1eeaffd50c tempest-VolumeAndVolumeTypeFromImageTest-1479156633 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 10 16:00:06 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-ff4007ff-0403-4232-a6b3-3c1eeaffd50c tempest-VolumeAndVolumeTypeFromImageTest-1479156633 None] Created reservations ['b833dbb6-f632-48fb-abd6-4a8e3a5f2afe', '286db8d3-9fe3-4a99-80bf-a7a12aa0faee', 'fea06f1b-be4b-46bd-a4b8-aa1261186a66', '77ceec12-9511-43e7-8a9c-bd1097d90c57'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:00:06 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-ff4007ff-0403-4232-a6b3-3c1eeaffd50c tempest-VolumeAndVolumeTypeFromImageTest-1479156633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:00:06 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-ff4007ff-0403-4232-a6b3-3c1eeaffd50c tempest-VolumeAndVolumeTypeFromImageTest-1479156633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:00:06 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-ff4007ff-0403-4232-a6b3-3c1eeaffd50c tempest-VolumeAndVolumeTypeFromImageTest-1479156633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:00:06 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-ff4007ff-0403-4232-a6b3-3c1eeaffd50c tempest-VolumeAndVolumeTypeFromImageTest-1479156633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:00:06 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-ff4007ff-0403-4232-a6b3-3c1eeaffd50c tempest-VolumeAndVolumeTypeFromImageTest-1479156633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:00:06 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ff4007ff-0403-4232-a6b3-3c1eeaffd50c tempest-VolumeAndVolumeTypeFromImageTest-1479156633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:00:06 devstack sudo[99134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:00:06 devstack sudo[99134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:00:06 devstack sudo[99130]: pam_unix(sudo:session): session closed for user root Jul 10 16:00:06 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-b7c18cc6-2582-440d-9a84-4374053318fc tempest-VolumesActionsTest-306599127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-53a03426-4e8d-40b9-9f1a-032d2996b9de" returned: 0 in 0.755s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:00:06 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-b7c18cc6-2582-440d-9a84-4374053318fc tempest-VolumesActionsTest-306599127 None] Lock "cinder-quobyte-53a03426-4e8d-40b9-9f1a-032d2996b9de" released by "delete_volume" :: held 1.666s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:00:06 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-b7c18cc6-2582-440d-9a84-4374053318fc tempest-VolumesActionsTest-306599127 None] Created reservations ['cab4cfc8-fd5b-412f-b417-72bc41f4900c', 'ef52c064-bea0-4b7a-8443-c9648d79416c', 'da0720e7-27e8-4930-9443-8f31cbc30d2e', '6b28b326-291d-42d0-a331-501a1ea51b0e'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:00:06 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-b7c18cc6-2582-440d-9a84-4374053318fc tempest-VolumesActionsTest-306599127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:00:06 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-b7c18cc6-2582-440d-9a84-4374053318fc tempest-VolumesActionsTest-306599127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:00:06 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-b7c18cc6-2582-440d-9a84-4374053318fc tempest-VolumesActionsTest-306599127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:00:06 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-b7c18cc6-2582-440d-9a84-4374053318fc tempest-VolumesActionsTest-306599127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:00:06 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-b7c18cc6-2582-440d-9a84-4374053318fc tempest-VolumesActionsTest-306599127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:00:06 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-b7c18cc6-2582-440d-9a84-4374053318fc tempest-VolumesActionsTest-306599127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:00:06 devstack sudo[99136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:00:06 devstack sudo[99136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:00:07 devstack sudo[99134]: pam_unix(sudo:session): session closed for user root Jul 10 16:00:07 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ff4007ff-0403-4232-a6b3-3c1eeaffd50c tempest-VolumeAndVolumeTypeFromImageTest-1479156633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.770s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:00:07 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-ff4007ff-0403-4232-a6b3-3c1eeaffd50c tempest-VolumeAndVolumeTypeFromImageTest-1479156633 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:00:07 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-ff4007ff-0403-4232-a6b3-3c1eeaffd50c tempest-VolumeAndVolumeTypeFromImageTest-1479156633 None] Deleted volume successfully. Jul 10 16:00:07 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-ff4007ff-0403-4232-a6b3-3c1eeaffd50c tempest-VolumeAndVolumeTypeFromImageTest-1479156633 None] Lock "cinder-fcaf7bb6-e137-4407-a8e2-068ba577a343-delete_volume" released by "delete_volume" :: held 3.454s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:00:07 devstack sudo[99136]: pam_unix(sudo:session): session closed for user root Jul 10 16:00:07 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-b7c18cc6-2582-440d-9a84-4374053318fc tempest-VolumesActionsTest-306599127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.763s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:00:07 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-b7c18cc6-2582-440d-9a84-4374053318fc tempest-VolumesActionsTest-306599127 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:00:07 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-b7c18cc6-2582-440d-9a84-4374053318fc tempest-VolumesActionsTest-306599127 None] Deleted volume successfully. Jul 10 16:00:07 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-b7c18cc6-2582-440d-9a84-4374053318fc tempest-VolumesActionsTest-306599127 None] Lock "cinder-53a03426-4e8d-40b9-9f1a-032d2996b9de-delete_volume" released by "delete_volume" :: held 2.693s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:00:07 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f56bce4-b85a-4966-941f-58769c60a9ca tempest-VolumesActionsTest-462308728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 16:00:07 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-0f56bce4-b85a-4966-941f-58769c60a9ca tempest-VolumesActionsTest-462308728 None] Flow 'volume_create_manager' (2a16ae3c-897c-4adc-b02b-c18cc613c234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:00:07 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-0f56bce4-b85a-4966-941f-58769c60a9ca tempest-VolumesActionsTest-462308728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2b7a56a-f7b4-4c74-8c24-1fa8693c8407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:00:07 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-0f56bce4-b85a-4966-941f-58769c60a9ca tempest-VolumesActionsTest-462308728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2b7a56a-f7b4-4c74-8c24-1fa8693c8407) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:00:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1382028707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b9292ea-f9ec-4f7e-9fba-e34e65b4fe4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1c36a9c42fa40b78bc74dd9edaf17ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:00:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:00:08Z,use_quota=True,user_id='269a68e2fcc64ca3ae097dcfc9d72e93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:00:07 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-0f56bce4-b85a-4966-941f-58769c60a9ca tempest-VolumesActionsTest-462308728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0ba9d83-cf9b-4559-923e-f5efbf3ac3df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:00:07 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-0f56bce4-b85a-4966-941f-58769c60a9ca tempest-VolumesActionsTest-462308728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0ba9d83-cf9b-4559-923e-f5efbf3ac3df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:00:07 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-0f56bce4-b85a-4966-941f-58769c60a9ca tempest-VolumesActionsTest-462308728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e471e2c-c4fa-4665-80fb-69124ad55551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:00:07 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-0f56bce4-b85a-4966-941f-58769c60a9ca tempest-VolumesActionsTest-462308728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e471e2c-c4fa-4665-80fb-69124ad55551) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b9292ea-f9ec-4f7e-9fba-e34e65b4fe4b', 'volume_name': 'volume-0b9292ea-f9ec-4f7e-9fba-e34e65b4fe4b', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:00:07 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-0f56bce4-b85a-4966-941f-58769c60a9ca tempest-VolumesActionsTest-462308728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7c6a89b-9626-4603-94f8-ca5396107c70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:00:07 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-0f56bce4-b85a-4966-941f-58769c60a9ca tempest-VolumesActionsTest-462308728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7c6a89b-9626-4603-94f8-ca5396107c70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:00:07 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-0f56bce4-b85a-4966-941f-58769c60a9ca tempest-VolumesActionsTest-462308728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9630b3cd-26ff-4d2e-ba22-9eea1889feb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:00:07 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-0f56bce4-b85a-4966-941f-58769c60a9ca tempest-VolumesActionsTest-462308728 None] Volume 0b9292ea-f9ec-4f7e-9fba-e34e65b4fe4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b9292ea-f9ec-4f7e-9fba-e34e65b4fe4b', 'volume_size': 1} Jul 10 16:00:07 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-0f56bce4-b85a-4966-941f-58769c60a9ca tempest-VolumesActionsTest-462308728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:00:07 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-0f56bce4-b85a-4966-941f-58769c60a9ca tempest-VolumesActionsTest-462308728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:00:07 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-0f56bce4-b85a-4966-941f-58769c60a9ca tempest-VolumesActionsTest-462308728 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:00:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1382028707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b9292ea-f9ec-4f7e-9fba-e34e65b4fe4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1c36a9c42fa40b78bc74dd9edaf17ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:00:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:00:08Z,use_quota=True,user_id='269a68e2fcc64ca3ae097dcfc9d72e93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 16:00:07 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-0f56bce4-b85a-4966-941f-58769c60a9ca tempest-VolumesActionsTest-462308728 None] Creating volume 0b9292ea-f9ec-4f7e-9fba-e34e65b4fe4b {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 16:00:07 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-0f56bce4-b85a-4966-941f-58769c60a9ca tempest-VolumesActionsTest-462308728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:00:07 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-0f56bce4-b85a-4966-941f-58769c60a9ca tempest-VolumesActionsTest-462308728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:00:07 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-0f56bce4-b85a-4966-941f-58769c60a9ca tempest-VolumesActionsTest-462308728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:00:07 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-0f56bce4-b85a-4966-941f-58769c60a9ca tempest-VolumesActionsTest-462308728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:00:07 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-0f56bce4-b85a-4966-941f-58769c60a9ca tempest-VolumesActionsTest-462308728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:00:07 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-0f56bce4-b85a-4966-941f-58769c60a9ca tempest-VolumesActionsTest-462308728 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 16:00:07 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-0f56bce4-b85a-4966-941f-58769c60a9ca tempest-VolumesActionsTest-462308728 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 16:00:07 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-0f56bce4-b85a-4966-941f-58769c60a9ca tempest-VolumesActionsTest-462308728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-0b9292ea-f9ec-4f7e-9fba-e34e65b4fe4b 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:00:07 devstack sudo[99140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-0b9292ea-f9ec-4f7e-9fba-e34e65b4fe4b 1073741824 Jul 10 16:00:07 devstack sudo[99140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:00:08 devstack sudo[99140]: pam_unix(sudo:session): session closed for user root Jul 10 16:00:08 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-0f56bce4-b85a-4966-941f-58769c60a9ca tempest-VolumesActionsTest-462308728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-0b9292ea-f9ec-4f7e-9fba-e34e65b4fe4b 1073741824" returned: 0 in 1.034s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:00:08 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-0f56bce4-b85a-4966-941f-58769c60a9ca tempest-VolumesActionsTest-462308728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-0b9292ea-f9ec-4f7e-9fba-e34e65b4fe4b {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:00:09 devstack sudo[99146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-0b9292ea-f9ec-4f7e-9fba-e34e65b4fe4b Jul 10 16:00:09 devstack sudo[99146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:00:09 devstack sudo[99146]: pam_unix(sudo:session): session closed for user root Jul 10 16:00:09 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-0f56bce4-b85a-4966-941f-58769c60a9ca tempest-VolumesActionsTest-462308728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-0b9292ea-f9ec-4f7e-9fba-e34e65b4fe4b" returned: 0 in 0.836s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:00:09 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-0f56bce4-b85a-4966-941f-58769c60a9ca tempest-VolumesActionsTest-462308728 None] <== create_volume: return (1922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 16:00:09 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-0f56bce4-b85a-4966-941f-58769c60a9ca tempest-VolumesActionsTest-462308728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.925s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:00:09 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-0f56bce4-b85a-4966-941f-58769c60a9ca tempest-VolumesActionsTest-462308728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9630b3cd-26ff-4d2e-ba22-9eea1889feb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b9292ea-f9ec-4f7e-9fba-e34e65b4fe4b', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:00:09 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-0f56bce4-b85a-4966-941f-58769c60a9ca tempest-VolumesActionsTest-462308728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91f35880-613d-4e66-b483-be44bb6bd483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:00:09 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-0f56bce4-b85a-4966-941f-58769c60a9ca tempest-VolumesActionsTest-462308728 None] Volume volume-0b9292ea-f9ec-4f7e-9fba-e34e65b4fe4b (0b9292ea-f9ec-4f7e-9fba-e34e65b4fe4b): created successfully Jul 10 16:00:09 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-0f56bce4-b85a-4966-941f-58769c60a9ca tempest-VolumesActionsTest-462308728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91f35880-613d-4e66-b483-be44bb6bd483) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:00:09 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-0f56bce4-b85a-4966-941f-58769c60a9ca tempest-VolumesActionsTest-462308728 None] Flow 'volume_create_manager' (2a16ae3c-897c-4adc-b02b-c18cc613c234) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:00:09 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-0f56bce4-b85a-4966-941f-58769c60a9ca tempest-VolumesActionsTest-462308728 None] Created volume successfully. Jul 10 16:00:11 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-b469387c-e44a-4283-b4e1-2ffe6d3f1291 tempest-VolumesActionsTest-306599127 None] Acquiring lock "cinder-0b9292ea-f9ec-4f7e-9fba-e34e65b4fe4b-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:00:11 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-b469387c-e44a-4283-b4e1-2ffe6d3f1291 tempest-VolumesActionsTest-306599127 None] Lock "cinder-0b9292ea-f9ec-4f7e-9fba-e34e65b4fe4b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:00:11 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-b469387c-e44a-4283-b4e1-2ffe6d3f1291 tempest-VolumesActionsTest-306599127 None] Acquiring lock "cinder-quobyte-0b9292ea-f9ec-4f7e-9fba-e34e65b4fe4b" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:00:11 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-b469387c-e44a-4283-b4e1-2ffe6d3f1291 tempest-VolumesActionsTest-306599127 None] Lock "cinder-quobyte-0b9292ea-f9ec-4f7e-9fba-e34e65b4fe4b" acquired by "delete_volume" :: waited 0.018s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:00:11 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[04a6278d-e20d-41cc-ae25-ccc6a0f2ddf1]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:00:11 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-b469387c-e44a-4283-b4e1-2ffe6d3f1291 tempest-VolumesActionsTest-306599127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-0b9292ea-f9ec-4f7e-9fba-e34e65b4fe4b {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:00:11 devstack sudo[99166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-0b9292ea-f9ec-4f7e-9fba-e34e65b4fe4b Jul 10 16:00:11 devstack sudo[99166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:00:12 devstack sudo[99166]: pam_unix(sudo:session): session closed for user root Jul 10 16:00:12 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-b469387c-e44a-4283-b4e1-2ffe6d3f1291 tempest-VolumesActionsTest-306599127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-0b9292ea-f9ec-4f7e-9fba-e34e65b4fe4b" returned: 0 in 1.070s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:00:12 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-b469387c-e44a-4283-b4e1-2ffe6d3f1291 tempest-VolumesActionsTest-306599127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-0b9292ea-f9ec-4f7e-9fba-e34e65b4fe4b {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:00:12 devstack sudo[99180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-0b9292ea-f9ec-4f7e-9fba-e34e65b4fe4b Jul 10 16:00:12 devstack sudo[99180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:00:12 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e10f604-646d-4065-a818-203c84d53088 tempest-CinderUnicodeTest-1864528855 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 16:00:12 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-4e10f604-646d-4065-a818-203c84d53088 tempest-CinderUnicodeTest-1864528855 None] Flow 'volume_create_manager' (13721e58-70c3-4e80-bae1-9741d4b61cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:00:12 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-4e10f604-646d-4065-a818-203c84d53088 tempest-CinderUnicodeTest-1864528855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9452147f-9912-4631-a4c3-4f42ac9c64cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:00:12 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-4e10f604-646d-4065-a818-203c84d53088 tempest-CinderUnicodeTest-1864528855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9452147f-9912-4631-a4c3-4f42ac9c64cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:00:12Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86ff0408-6125-4d25-a37b-322e0e92b033,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cb50fa849af49dcbbbaef54561d55ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:00:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:00:13Z,use_quota=True,user_id='a01898ee7b2a49bf8c71d1b355bdda5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:00:12 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-4e10f604-646d-4065-a818-203c84d53088 tempest-CinderUnicodeTest-1864528855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6ef8c01-c7ed-4601-8762-c90fd4e54615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:00:12 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-4e10f604-646d-4065-a818-203c84d53088 tempest-CinderUnicodeTest-1864528855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6ef8c01-c7ed-4601-8762-c90fd4e54615) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:00:12 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-4e10f604-646d-4065-a818-203c84d53088 tempest-CinderUnicodeTest-1864528855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0293a8a-508c-4ba0-a484-3cb93d5c447c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:00:12 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-4e10f604-646d-4065-a818-203c84d53088 tempest-CinderUnicodeTest-1864528855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0293a8a-508c-4ba0-a484-3cb93d5c447c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86ff0408-6125-4d25-a37b-322e0e92b033', 'volume_name': 'volume-86ff0408-6125-4d25-a37b-322e0e92b033', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:00:12 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-4e10f604-646d-4065-a818-203c84d53088 tempest-CinderUnicodeTest-1864528855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d020363d-01df-47bd-aa28-e983088e0dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:00:12 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-4e10f604-646d-4065-a818-203c84d53088 tempest-CinderUnicodeTest-1864528855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d020363d-01df-47bd-aa28-e983088e0dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:00:12 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-4e10f604-646d-4065-a818-203c84d53088 tempest-CinderUnicodeTest-1864528855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55251d99-783c-4d61-8b85-674bbb496452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:00:12 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-4e10f604-646d-4065-a818-203c84d53088 tempest-CinderUnicodeTest-1864528855 None] Volume 86ff0408-6125-4d25-a37b-322e0e92b033: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86ff0408-6125-4d25-a37b-322e0e92b033', 'volume_size': 1} Jul 10 16:00:12 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-4e10f604-646d-4065-a818-203c84d53088 tempest-CinderUnicodeTest-1864528855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:00:12 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-4e10f604-646d-4065-a818-203c84d53088 tempest-CinderUnicodeTest-1864528855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:00:12 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-4e10f604-646d-4065-a818-203c84d53088 tempest-CinderUnicodeTest-1864528855 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:00:12Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86ff0408-6125-4d25-a37b-322e0e92b033,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cb50fa849af49dcbbbaef54561d55ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:00:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:00:13Z,use_quota=True,user_id='a01898ee7b2a49bf8c71d1b355bdda5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 16:00:12 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-4e10f604-646d-4065-a818-203c84d53088 tempest-CinderUnicodeTest-1864528855 None] Creating volume 86ff0408-6125-4d25-a37b-322e0e92b033 {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 16:00:12 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-4e10f604-646d-4065-a818-203c84d53088 tempest-CinderUnicodeTest-1864528855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:00:12 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-4e10f604-646d-4065-a818-203c84d53088 tempest-CinderUnicodeTest-1864528855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:00:12 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-4e10f604-646d-4065-a818-203c84d53088 tempest-CinderUnicodeTest-1864528855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:00:12 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-4e10f604-646d-4065-a818-203c84d53088 tempest-CinderUnicodeTest-1864528855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:00:12 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-4e10f604-646d-4065-a818-203c84d53088 tempest-CinderUnicodeTest-1864528855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:00:12 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-4e10f604-646d-4065-a818-203c84d53088 tempest-CinderUnicodeTest-1864528855 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 16:00:12 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-4e10f604-646d-4065-a818-203c84d53088 tempest-CinderUnicodeTest-1864528855 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 16:00:12 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4e10f604-646d-4065-a818-203c84d53088 tempest-CinderUnicodeTest-1864528855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-86ff0408-6125-4d25-a37b-322e0e92b033 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:00:12 devstack sudo[99182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-86ff0408-6125-4d25-a37b-322e0e92b033 1073741824 Jul 10 16:00:12 devstack sudo[99182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:00:13 devstack sudo[99180]: pam_unix(sudo:session): session closed for user root Jul 10 16:00:13 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-b469387c-e44a-4283-b4e1-2ffe6d3f1291 tempest-VolumesActionsTest-306599127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-0b9292ea-f9ec-4f7e-9fba-e34e65b4fe4b" returned: 0 in 0.762s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:00:13 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-b469387c-e44a-4283-b4e1-2ffe6d3f1291 tempest-VolumesActionsTest-306599127 None] Lock "cinder-quobyte-0b9292ea-f9ec-4f7e-9fba-e34e65b4fe4b" released by "delete_volume" :: held 1.893s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:00:13 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-b469387c-e44a-4283-b4e1-2ffe6d3f1291 tempest-VolumesActionsTest-306599127 None] Created reservations ['f11c627e-8427-4a80-8cc9-7f9024e197f0', '1bcef29a-ca94-4823-aab8-d29643af7fda', 'f756cfe3-fac1-415f-803d-8ed88c21bd16', '193ee6d8-d7b7-44e9-8aaa-54ed5f4a9af5'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:00:13 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-b469387c-e44a-4283-b4e1-2ffe6d3f1291 tempest-VolumesActionsTest-306599127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:00:13 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-b469387c-e44a-4283-b4e1-2ffe6d3f1291 tempest-VolumesActionsTest-306599127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:00:13 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-b469387c-e44a-4283-b4e1-2ffe6d3f1291 tempest-VolumesActionsTest-306599127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:00:13 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-b469387c-e44a-4283-b4e1-2ffe6d3f1291 tempest-VolumesActionsTest-306599127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:00:13 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-b469387c-e44a-4283-b4e1-2ffe6d3f1291 tempest-VolumesActionsTest-306599127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:00:13 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-b469387c-e44a-4283-b4e1-2ffe6d3f1291 tempest-VolumesActionsTest-306599127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:00:13 devstack sudo[99186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:00:13 devstack sudo[99186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:00:13 devstack sudo[99182]: pam_unix(sudo:session): session closed for user root Jul 10 16:00:13 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4e10f604-646d-4065-a818-203c84d53088 tempest-CinderUnicodeTest-1864528855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-86ff0408-6125-4d25-a37b-322e0e92b033 1073741824" returned: 0 in 1.086s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:00:13 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4e10f604-646d-4065-a818-203c84d53088 tempest-CinderUnicodeTest-1864528855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-86ff0408-6125-4d25-a37b-322e0e92b033 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:00:13 devstack sudo[99194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-86ff0408-6125-4d25-a37b-322e0e92b033 Jul 10 16:00:13 devstack sudo[99194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:00:14 devstack sudo[99186]: pam_unix(sudo:session): session closed for user root Jul 10 16:00:14 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-b469387c-e44a-4283-b4e1-2ffe6d3f1291 tempest-VolumesActionsTest-306599127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.853s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:00:14 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-b469387c-e44a-4283-b4e1-2ffe6d3f1291 tempest-VolumesActionsTest-306599127 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:00:14 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-22862b25-da5b-49c5-848e-d0cb9e38ee01 tempest-VolumesActionsTest-462308728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 16:00:14 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-22862b25-da5b-49c5-848e-d0cb9e38ee01 tempest-VolumesActionsTest-462308728 None] Flow 'volume_create_manager' (912df420-6a14-4529-b7be-30b90a3fbfae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:00:14 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-22862b25-da5b-49c5-848e-d0cb9e38ee01 tempest-VolumesActionsTest-462308728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35bfba35-d34b-4049-ba4e-7269205f3dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:00:14 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-b469387c-e44a-4283-b4e1-2ffe6d3f1291 tempest-VolumesActionsTest-306599127 None] Deleted volume successfully. Jul 10 16:00:14 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-22862b25-da5b-49c5-848e-d0cb9e38ee01 tempest-VolumesActionsTest-462308728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35bfba35-d34b-4049-ba4e-7269205f3dc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:00:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1686490315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f75ebe8b-4019-4269-938c-f93cee180a91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1c36a9c42fa40b78bc74dd9edaf17ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:00:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:00:14Z,use_quota=True,user_id='269a68e2fcc64ca3ae097dcfc9d72e93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:00:14 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-22862b25-da5b-49c5-848e-d0cb9e38ee01 tempest-VolumesActionsTest-462308728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5499644-b4fe-4293-92ac-36d8b5b2638e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:00:14 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-22862b25-da5b-49c5-848e-d0cb9e38ee01 tempest-VolumesActionsTest-462308728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5499644-b4fe-4293-92ac-36d8b5b2638e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:00:14 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-22862b25-da5b-49c5-848e-d0cb9e38ee01 tempest-VolumesActionsTest-462308728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64f1c792-fb93-42df-a33c-fbef9d84dce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:00:14 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-22862b25-da5b-49c5-848e-d0cb9e38ee01 tempest-VolumesActionsTest-462308728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64f1c792-fb93-42df-a33c-fbef9d84dce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f75ebe8b-4019-4269-938c-f93cee180a91', 'volume_name': 'volume-f75ebe8b-4019-4269-938c-f93cee180a91', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:00:14 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-22862b25-da5b-49c5-848e-d0cb9e38ee01 tempest-VolumesActionsTest-462308728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (293ae35f-0278-4130-9824-d9a797b06d44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:00:14 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-22862b25-da5b-49c5-848e-d0cb9e38ee01 tempest-VolumesActionsTest-462308728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (293ae35f-0278-4130-9824-d9a797b06d44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:00:14 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-22862b25-da5b-49c5-848e-d0cb9e38ee01 tempest-VolumesActionsTest-462308728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54223493-de3d-44ba-8f01-270ed4f81e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:00:14 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-22862b25-da5b-49c5-848e-d0cb9e38ee01 tempest-VolumesActionsTest-462308728 None] Volume f75ebe8b-4019-4269-938c-f93cee180a91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f75ebe8b-4019-4269-938c-f93cee180a91', 'volume_size': 1} Jul 10 16:00:14 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-22862b25-da5b-49c5-848e-d0cb9e38ee01 tempest-VolumesActionsTest-462308728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:00:14 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-b469387c-e44a-4283-b4e1-2ffe6d3f1291 tempest-VolumesActionsTest-306599127 None] Lock "cinder-0b9292ea-f9ec-4f7e-9fba-e34e65b4fe4b-delete_volume" released by "delete_volume" :: held 3.129s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:00:14 devstack sudo[99194]: pam_unix(sudo:session): session closed for user root Jul 10 16:00:14 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4e10f604-646d-4065-a818-203c84d53088 tempest-CinderUnicodeTest-1864528855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-86ff0408-6125-4d25-a37b-322e0e92b033" returned: 0 in 0.799s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:00:14 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-4e10f604-646d-4065-a818-203c84d53088 tempest-CinderUnicodeTest-1864528855 None] <== create_volume: return (1961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 16:00:14 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-4e10f604-646d-4065-a818-203c84d53088 tempest-CinderUnicodeTest-1864528855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.965s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:00:14 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-22862b25-da5b-49c5-848e-d0cb9e38ee01 tempest-VolumesActionsTest-462308728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.423s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:00:14 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-22862b25-da5b-49c5-848e-d0cb9e38ee01 tempest-VolumesActionsTest-462308728 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:00:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1686490315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f75ebe8b-4019-4269-938c-f93cee180a91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1c36a9c42fa40b78bc74dd9edaf17ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:00:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:00:14Z,use_quota=True,user_id='269a68e2fcc64ca3ae097dcfc9d72e93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 16:00:14 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-22862b25-da5b-49c5-848e-d0cb9e38ee01 tempest-VolumesActionsTest-462308728 None] Creating volume f75ebe8b-4019-4269-938c-f93cee180a91 {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 16:00:14 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-22862b25-da5b-49c5-848e-d0cb9e38ee01 tempest-VolumesActionsTest-462308728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:00:14 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-22862b25-da5b-49c5-848e-d0cb9e38ee01 tempest-VolumesActionsTest-462308728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:00:14 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-22862b25-da5b-49c5-848e-d0cb9e38ee01 tempest-VolumesActionsTest-462308728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:00:14 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-22862b25-da5b-49c5-848e-d0cb9e38ee01 tempest-VolumesActionsTest-462308728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:00:14 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-22862b25-da5b-49c5-848e-d0cb9e38ee01 tempest-VolumesActionsTest-462308728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:00:14 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-22862b25-da5b-49c5-848e-d0cb9e38ee01 tempest-VolumesActionsTest-462308728 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 16:00:14 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-22862b25-da5b-49c5-848e-d0cb9e38ee01 tempest-VolumesActionsTest-462308728 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 16:00:14 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-22862b25-da5b-49c5-848e-d0cb9e38ee01 tempest-VolumesActionsTest-462308728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f75ebe8b-4019-4269-938c-f93cee180a91 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:00:14 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-4e10f604-646d-4065-a818-203c84d53088 tempest-CinderUnicodeTest-1864528855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55251d99-783c-4d61-8b85-674bbb496452) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86ff0408-6125-4d25-a37b-322e0e92b033', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:00:14 devstack sudo[99199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f75ebe8b-4019-4269-938c-f93cee180a91 1073741824 Jul 10 16:00:14 devstack sudo[99199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:00:14 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-4e10f604-646d-4065-a818-203c84d53088 tempest-CinderUnicodeTest-1864528855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7ddd26e-0a1b-4c71-a94f-0168ab1246ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:00:14 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-4e10f604-646d-4065-a818-203c84d53088 tempest-CinderUnicodeTest-1864528855 None] Volume volume-86ff0408-6125-4d25-a37b-322e0e92b033 (86ff0408-6125-4d25-a37b-322e0e92b033): created successfully Jul 10 16:00:14 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-4e10f604-646d-4065-a818-203c84d53088 tempest-CinderUnicodeTest-1864528855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7ddd26e-0a1b-4c71-a94f-0168ab1246ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:00:14 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-4e10f604-646d-4065-a818-203c84d53088 tempest-CinderUnicodeTest-1864528855 None] Flow 'volume_create_manager' (13721e58-70c3-4e80-bae1-9741d4b61cad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:00:14 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-4e10f604-646d-4065-a818-203c84d53088 tempest-CinderUnicodeTest-1864528855 None] Created volume successfully. Jul 10 16:00:15 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [req-160d7d02-bd5c-4de7-9e81-812787382bb8 req-5d9624cc-0b86-4431-8310-36a9b719779e tempest-TestStampPattern-1127543775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:00:15 devstack sudo[99199]: pam_unix(sudo:session): session closed for user root Jul 10 16:00:15 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-22862b25-da5b-49c5-848e-d0cb9e38ee01 tempest-VolumesActionsTest-462308728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f75ebe8b-4019-4269-938c-f93cee180a91 1073741824" returned: 0 in 0.945s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:00:15 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-22862b25-da5b-49c5-848e-d0cb9e38ee01 tempest-VolumesActionsTest-462308728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f75ebe8b-4019-4269-938c-f93cee180a91 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:00:15 devstack sudo[99213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f75ebe8b-4019-4269-938c-f93cee180a91 Jul 10 16:00:15 devstack sudo[99213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:00:16 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e20f9af-bb80-4a30-b682-80c310c3f9a3 tempest-VolumesActionsTest-9461107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 16:00:16 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-7e20f9af-bb80-4a30-b682-80c310c3f9a3 tempest-VolumesActionsTest-9461107 None] Flow 'volume_create_manager' (3bb2c373-0180-457d-ba39-45d10e543dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:00:16 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-7e20f9af-bb80-4a30-b682-80c310c3f9a3 tempest-VolumesActionsTest-9461107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ac4bfc3-fd56-4aa1-a23d-22fab2046a56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:00:16 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-7e20f9af-bb80-4a30-b682-80c310c3f9a3 tempest-VolumesActionsTest-9461107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ac4bfc3-fd56-4aa1-a23d-22fab2046a56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:00:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1793692492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ffbabb0-4ce4-42a6-a34e-0fd7970b58b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='affa26fe97704725b1b646d4e271a725',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:00:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:00:16Z,use_quota=True,user_id='bd2e62254a29430d9c56bcc89feb1ad5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:00:16 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-7e20f9af-bb80-4a30-b682-80c310c3f9a3 tempest-VolumesActionsTest-9461107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bd2731f-1709-45ab-b1c5-c308cae7ada4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:00:16 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-7e20f9af-bb80-4a30-b682-80c310c3f9a3 tempest-VolumesActionsTest-9461107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bd2731f-1709-45ab-b1c5-c308cae7ada4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:00:16 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-7e20f9af-bb80-4a30-b682-80c310c3f9a3 tempest-VolumesActionsTest-9461107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a001a49-ff98-42eb-b1d5-86d1540b5d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:00:16 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-7e20f9af-bb80-4a30-b682-80c310c3f9a3 tempest-VolumesActionsTest-9461107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a001a49-ff98-42eb-b1d5-86d1540b5d00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ffbabb0-4ce4-42a6-a34e-0fd7970b58b6', 'volume_name': 'volume-3ffbabb0-4ce4-42a6-a34e-0fd7970b58b6', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:00:16 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-7e20f9af-bb80-4a30-b682-80c310c3f9a3 tempest-VolumesActionsTest-9461107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5933c7d0-ba61-40ad-a6ef-c4bb3f96947d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:00:16 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-7e20f9af-bb80-4a30-b682-80c310c3f9a3 tempest-VolumesActionsTest-9461107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5933c7d0-ba61-40ad-a6ef-c4bb3f96947d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:00:16 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-7e20f9af-bb80-4a30-b682-80c310c3f9a3 tempest-VolumesActionsTest-9461107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26f6f1e1-4164-4484-b19d-0e32cfc61da2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:00:16 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-7e20f9af-bb80-4a30-b682-80c310c3f9a3 tempest-VolumesActionsTest-9461107 None] Volume 3ffbabb0-4ce4-42a6-a34e-0fd7970b58b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ffbabb0-4ce4-42a6-a34e-0fd7970b58b6', 'volume_size': 1} Jul 10 16:00:16 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-7e20f9af-bb80-4a30-b682-80c310c3f9a3 tempest-VolumesActionsTest-9461107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:00:16 devstack sudo[99213]: pam_unix(sudo:session): session closed for user root Jul 10 16:00:16 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-22862b25-da5b-49c5-848e-d0cb9e38ee01 tempest-VolumesActionsTest-462308728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f75ebe8b-4019-4269-938c-f93cee180a91" returned: 0 in 0.688s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:00:16 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-22862b25-da5b-49c5-848e-d0cb9e38ee01 tempest-VolumesActionsTest-462308728 None] <== create_volume: return (1679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 16:00:16 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-22862b25-da5b-49c5-848e-d0cb9e38ee01 tempest-VolumesActionsTest-462308728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.682s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:00:16 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [req-160d7d02-bd5c-4de7-9e81-812787382bb8 req-5d9624cc-0b86-4431-8310-36a9b719779e tempest-TestStampPattern-1127543775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.011s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:00:16 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-22862b25-da5b-49c5-848e-d0cb9e38ee01 tempest-VolumesActionsTest-462308728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54223493-de3d-44ba-8f01-270ed4f81e66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f75ebe8b-4019-4269-938c-f93cee180a91', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:00:16 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-22862b25-da5b-49c5-848e-d0cb9e38ee01 tempest-VolumesActionsTest-462308728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9655935-d78b-43be-bf01-277d1ab7e09a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:00:16 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[d63ca2d5-5f18-43e5-a915-fbf7d1ce228d]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:00:16 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [req-160d7d02-bd5c-4de7-9e81-812787382bb8 req-5d9624cc-0b86-4431-8310-36a9b719779e tempest-TestStampPattern-1127543775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-894f402d-cb97-4505-b7f9-5c40607bb703 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:00:16 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-22862b25-da5b-49c5-848e-d0cb9e38ee01 tempest-VolumesActionsTest-462308728 None] Volume volume-f75ebe8b-4019-4269-938c-f93cee180a91 (f75ebe8b-4019-4269-938c-f93cee180a91): created successfully Jul 10 16:00:16 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-22862b25-da5b-49c5-848e-d0cb9e38ee01 tempest-VolumesActionsTest-462308728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9655935-d78b-43be-bf01-277d1ab7e09a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:00:16 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-22862b25-da5b-49c5-848e-d0cb9e38ee01 tempest-VolumesActionsTest-462308728 None] Flow 'volume_create_manager' (912df420-6a14-4529-b7be-30b90a3fbfae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:00:16 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-22862b25-da5b-49c5-848e-d0cb9e38ee01 tempest-VolumesActionsTest-462308728 None] Created volume successfully. Jul 10 16:00:16 devstack sudo[99216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-894f402d-cb97-4505-b7f9-5c40607bb703 Jul 10 16:00:16 devstack sudo[99216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:00:16 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-e04be945-2821-4f9b-97d3-bd2ae7309cc8 tempest-CinderUnicodeTest-1864528855 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 16:00:16 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-e04be945-2821-4f9b-97d3-bd2ae7309cc8 tempest-CinderUnicodeTest-1864528855 None] Flow 'volume_create_manager' (3a4cca1c-29ff-4de7-8f61-c5cb007e808b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:00:16 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-e04be945-2821-4f9b-97d3-bd2ae7309cc8 tempest-CinderUnicodeTest-1864528855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51ce6a99-79b6-4d98-a922-67c76ba48c6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:00:16 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-e04be945-2821-4f9b-97d3-bd2ae7309cc8 tempest-CinderUnicodeTest-1864528855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51ce6a99-79b6-4d98-a922-67c76ba48c6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:00:16Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-808692225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc87cbd2-547b-42c3-8483-25c013932f82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cb50fa849af49dcbbbaef54561d55ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:00:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:00:17Z,use_quota=True,user_id='a01898ee7b2a49bf8c71d1b355bdda5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:00:16 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-e04be945-2821-4f9b-97d3-bd2ae7309cc8 tempest-CinderUnicodeTest-1864528855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7aad5395-125a-4778-a565-cee40db2d723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:00:16 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-e04be945-2821-4f9b-97d3-bd2ae7309cc8 tempest-CinderUnicodeTest-1864528855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7aad5395-125a-4778-a565-cee40db2d723) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:00:16 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-e04be945-2821-4f9b-97d3-bd2ae7309cc8 tempest-CinderUnicodeTest-1864528855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dd720dd-6d1b-4445-bdf2-6b1095b4f6e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:00:16 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-e04be945-2821-4f9b-97d3-bd2ae7309cc8 tempest-CinderUnicodeTest-1864528855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dd720dd-6d1b-4445-bdf2-6b1095b4f6e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc87cbd2-547b-42c3-8483-25c013932f82', 'volume_name': 'volume-dc87cbd2-547b-42c3-8483-25c013932f82', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:00:16 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-e04be945-2821-4f9b-97d3-bd2ae7309cc8 tempest-CinderUnicodeTest-1864528855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2ed7415-5be7-4d49-98b0-1d079e9c8b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:00:16 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-e04be945-2821-4f9b-97d3-bd2ae7309cc8 tempest-CinderUnicodeTest-1864528855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2ed7415-5be7-4d49-98b0-1d079e9c8b31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:00:16 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-e04be945-2821-4f9b-97d3-bd2ae7309cc8 tempest-CinderUnicodeTest-1864528855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be89d852-dd7c-4470-a292-c2b79aa5bd96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:00:16 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-e04be945-2821-4f9b-97d3-bd2ae7309cc8 tempest-CinderUnicodeTest-1864528855 None] Volume dc87cbd2-547b-42c3-8483-25c013932f82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc87cbd2-547b-42c3-8483-25c013932f82', 'volume_size': 1} Jul 10 16:00:16 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-e04be945-2821-4f9b-97d3-bd2ae7309cc8 tempest-CinderUnicodeTest-1864528855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:00:17 devstack sudo[99216]: pam_unix(sudo:session): session closed for user root Jul 10 16:00:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [req-160d7d02-bd5c-4de7-9e81-812787382bb8 req-5d9624cc-0b86-4431-8310-36a9b719779e tempest-TestStampPattern-1127543775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-894f402d-cb97-4505-b7f9-5c40607bb703" returned: 0 in 0.811s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:00:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [req-160d7d02-bd5c-4de7-9e81-812787382bb8 req-5d9624cc-0b86-4431-8310-36a9b719779e tempest-TestStampPattern-1127543775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.837s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:00:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-7e20f9af-bb80-4a30-b682-80c310c3f9a3 tempest-VolumesActionsTest-9461107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.083s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:00:17 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-7e20f9af-bb80-4a30-b682-80c310c3f9a3 tempest-VolumesActionsTest-9461107 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:00:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1793692492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ffbabb0-4ce4-42a6-a34e-0fd7970b58b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='affa26fe97704725b1b646d4e271a725',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:00:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:00:16Z,use_quota=True,user_id='bd2e62254a29430d9c56bcc89feb1ad5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 16:00:17 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-7e20f9af-bb80-4a30-b682-80c310c3f9a3 tempest-VolumesActionsTest-9461107 None] Creating volume 3ffbabb0-4ce4-42a6-a34e-0fd7970b58b6 {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 16:00:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-7e20f9af-bb80-4a30-b682-80c310c3f9a3 tempest-VolumesActionsTest-9461107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:00:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-7e20f9af-bb80-4a30-b682-80c310c3f9a3 tempest-VolumesActionsTest-9461107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:00:17 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-7e20f9af-bb80-4a30-b682-80c310c3f9a3 tempest-VolumesActionsTest-9461107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:00:17 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-7e20f9af-bb80-4a30-b682-80c310c3f9a3 tempest-VolumesActionsTest-9461107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:00:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-7e20f9af-bb80-4a30-b682-80c310c3f9a3 tempest-VolumesActionsTest-9461107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:00:17 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-7e20f9af-bb80-4a30-b682-80c310c3f9a3 tempest-VolumesActionsTest-9461107 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 16:00:17 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-7e20f9af-bb80-4a30-b682-80c310c3f9a3 tempest-VolumesActionsTest-9461107 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 16:00:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-7e20f9af-bb80-4a30-b682-80c310c3f9a3 tempest-VolumesActionsTest-9461107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3ffbabb0-4ce4-42a6-a34e-0fd7970b58b6 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:00:17 devstack sudo[99221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3ffbabb0-4ce4-42a6-a34e-0fd7970b58b6 1073741824 Jul 10 16:00:17 devstack sudo[99221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:00:17 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [req-160d7d02-bd5c-4de7-9e81-812787382bb8 req-5d9624cc-0b86-4431-8310-36a9b719779e tempest-TestStampPattern-1127543775 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80', 'name': 'volume-894f402d-cb97-4505-b7f9-5c40607bb703', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e99bf546-cbda-4217-b35a-a845b2d0d7c6', 'enforce_multipath': True} {{(pid=87420) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 16:00:17 devstack cinder-volume[87420]: INFO cinder.volume.manager [req-160d7d02-bd5c-4de7-9e81-812787382bb8 req-5d9624cc-0b86-4431-8310-36a9b719779e tempest-TestStampPattern-1127543775 None] attachment_update completed successfully. Jul 10 16:00:17 devstack cinder-volume[87420]: DEBUG oslo_service.periodic_task [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87420) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 16:00:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:00:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:00:17 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:00:17 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:00:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:00:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:00:17 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-362b426c-b789-4f55-908f-27971de356be tempest-VolumesActionsTest-306599127 None] Acquiring lock "cinder-f75ebe8b-4019-4269-938c-f93cee180a91-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:00:17 devstack sudo[99224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:00:17 devstack sudo[99224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:00:17 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-362b426c-b789-4f55-908f-27971de356be tempest-VolumesActionsTest-306599127 None] Lock "cinder-f75ebe8b-4019-4269-938c-f93cee180a91-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:00:17 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-362b426c-b789-4f55-908f-27971de356be tempest-VolumesActionsTest-306599127 None] Acquiring lock "cinder-quobyte-f75ebe8b-4019-4269-938c-f93cee180a91" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:00:17 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-362b426c-b789-4f55-908f-27971de356be tempest-VolumesActionsTest-306599127 None] Lock "cinder-quobyte-f75ebe8b-4019-4269-938c-f93cee180a91" acquired by "delete_volume" :: waited 0.020s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:00:17 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[96fe7350-3b16-4e70-bca1-f3189c873cbb]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:00:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-362b426c-b789-4f55-908f-27971de356be tempest-VolumesActionsTest-306599127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f75ebe8b-4019-4269-938c-f93cee180a91 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:00:17 devstack sudo[99271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f75ebe8b-4019-4269-938c-f93cee180a91 Jul 10 16:00:17 devstack sudo[99271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:00:18 devstack sudo[99224]: pam_unix(sudo:session): session closed for user root Jul 10 16:00:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.796s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:00:18 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:00:18 devstack cinder-volume[87420]: DEBUG oslo_service.periodic_task [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Running periodic task VolumeManager._thread_info {{(pid=87420) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 16:00:18 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] thread count: 28 {{(pid=87420) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 16:00:18 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] thread info: [<_MainThread(MainThread, started 133639250378880)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87420) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 16:00:18 devstack sudo[99221]: pam_unix(sudo:session): session closed for user root Jul 10 16:00:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-7e20f9af-bb80-4a30-b682-80c310c3f9a3 tempest-VolumesActionsTest-9461107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3ffbabb0-4ce4-42a6-a34e-0fd7970b58b6 1073741824" returned: 0 in 1.005s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:00:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-7e20f9af-bb80-4a30-b682-80c310c3f9a3 tempest-VolumesActionsTest-9461107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3ffbabb0-4ce4-42a6-a34e-0fd7970b58b6 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:00:18 devstack sudo[99613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3ffbabb0-4ce4-42a6-a34e-0fd7970b58b6 Jul 10 16:00:18 devstack sudo[99613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:00:18 devstack sudo[99271]: pam_unix(sudo:session): session closed for user root Jul 10 16:00:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-362b426c-b789-4f55-908f-27971de356be tempest-VolumesActionsTest-306599127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f75ebe8b-4019-4269-938c-f93cee180a91" returned: 0 in 0.855s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:00:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-362b426c-b789-4f55-908f-27971de356be tempest-VolumesActionsTest-306599127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f75ebe8b-4019-4269-938c-f93cee180a91 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:00:18 devstack sudo[99619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f75ebe8b-4019-4269-938c-f93cee180a91 Jul 10 16:00:18 devstack sudo[99619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:00:18 devstack sudo[99613]: pam_unix(sudo:session): session closed for user root Jul 10 16:00:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-7e20f9af-bb80-4a30-b682-80c310c3f9a3 tempest-VolumesActionsTest-9461107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3ffbabb0-4ce4-42a6-a34e-0fd7970b58b6" returned: 0 in 0.683s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:00:18 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-7e20f9af-bb80-4a30-b682-80c310c3f9a3 tempest-VolumesActionsTest-9461107 None] <== create_volume: return (1730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 16:00:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-7e20f9af-bb80-4a30-b682-80c310c3f9a3 tempest-VolumesActionsTest-9461107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.733s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:00:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-e04be945-2821-4f9b-97d3-bd2ae7309cc8 tempest-CinderUnicodeTest-1864528855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.256s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:00:18 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-e04be945-2821-4f9b-97d3-bd2ae7309cc8 tempest-CinderUnicodeTest-1864528855 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:00:16Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-808692225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc87cbd2-547b-42c3-8483-25c013932f82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cb50fa849af49dcbbbaef54561d55ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:00:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:00:17Z,use_quota=True,user_id='a01898ee7b2a49bf8c71d1b355bdda5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 16:00:18 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-e04be945-2821-4f9b-97d3-bd2ae7309cc8 tempest-CinderUnicodeTest-1864528855 None] Creating volume dc87cbd2-547b-42c3-8483-25c013932f82 {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 16:00:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-e04be945-2821-4f9b-97d3-bd2ae7309cc8 tempest-CinderUnicodeTest-1864528855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:00:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-e04be945-2821-4f9b-97d3-bd2ae7309cc8 tempest-CinderUnicodeTest-1864528855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:00:18 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-e04be945-2821-4f9b-97d3-bd2ae7309cc8 tempest-CinderUnicodeTest-1864528855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:00:18 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-e04be945-2821-4f9b-97d3-bd2ae7309cc8 tempest-CinderUnicodeTest-1864528855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:00:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-e04be945-2821-4f9b-97d3-bd2ae7309cc8 tempest-CinderUnicodeTest-1864528855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:00:18 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-e04be945-2821-4f9b-97d3-bd2ae7309cc8 tempest-CinderUnicodeTest-1864528855 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 16:00:18 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-e04be945-2821-4f9b-97d3-bd2ae7309cc8 tempest-CinderUnicodeTest-1864528855 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 16:00:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-e04be945-2821-4f9b-97d3-bd2ae7309cc8 tempest-CinderUnicodeTest-1864528855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-dc87cbd2-547b-42c3-8483-25c013932f82 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:00:19 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-7e20f9af-bb80-4a30-b682-80c310c3f9a3 tempest-VolumesActionsTest-9461107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26f6f1e1-4164-4484-b19d-0e32cfc61da2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ffbabb0-4ce4-42a6-a34e-0fd7970b58b6', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:00:19 devstack sudo[99622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-dc87cbd2-547b-42c3-8483-25c013932f82 1073741824 Jul 10 16:00:19 devstack sudo[99622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:00:19 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-7e20f9af-bb80-4a30-b682-80c310c3f9a3 tempest-VolumesActionsTest-9461107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb366790-5171-478f-a916-38872ff271ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:00:19 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-7e20f9af-bb80-4a30-b682-80c310c3f9a3 tempest-VolumesActionsTest-9461107 None] Volume volume-3ffbabb0-4ce4-42a6-a34e-0fd7970b58b6 (3ffbabb0-4ce4-42a6-a34e-0fd7970b58b6): created successfully Jul 10 16:00:19 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-7e20f9af-bb80-4a30-b682-80c310c3f9a3 tempest-VolumesActionsTest-9461107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb366790-5171-478f-a916-38872ff271ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:00:19 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-7e20f9af-bb80-4a30-b682-80c310c3f9a3 tempest-VolumesActionsTest-9461107 None] Flow 'volume_create_manager' (3bb2c373-0180-457d-ba39-45d10e543dbd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:00:19 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-7e20f9af-bb80-4a30-b682-80c310c3f9a3 tempest-VolumesActionsTest-9461107 None] Created volume successfully. Jul 10 16:00:19 devstack sudo[99619]: pam_unix(sudo:session): session closed for user root Jul 10 16:00:19 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-362b426c-b789-4f55-908f-27971de356be tempest-VolumesActionsTest-306599127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-f75ebe8b-4019-4269-938c-f93cee180a91" returned: 0 in 0.670s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:00:19 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-362b426c-b789-4f55-908f-27971de356be tempest-VolumesActionsTest-306599127 None] Lock "cinder-quobyte-f75ebe8b-4019-4269-938c-f93cee180a91" released by "delete_volume" :: held 1.611s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:00:19 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-362b426c-b789-4f55-908f-27971de356be tempest-VolumesActionsTest-306599127 None] Created reservations ['45fb68a7-462c-4aa1-8ecf-7fa27d72f393', 'cf218b60-3672-47b8-a15d-ea2aa979761e', '3c1b6d53-5afe-44bc-a69e-40ae0f5e41b1', '0e18fd07-e878-451b-8c25-c07ed7764bda'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:00:19 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-362b426c-b789-4f55-908f-27971de356be tempest-VolumesActionsTest-306599127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:00:19 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-362b426c-b789-4f55-908f-27971de356be tempest-VolumesActionsTest-306599127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:00:19 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-362b426c-b789-4f55-908f-27971de356be tempest-VolumesActionsTest-306599127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:00:19 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-362b426c-b789-4f55-908f-27971de356be tempest-VolumesActionsTest-306599127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:00:19 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-362b426c-b789-4f55-908f-27971de356be tempest-VolumesActionsTest-306599127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:00:19 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-362b426c-b789-4f55-908f-27971de356be tempest-VolumesActionsTest-306599127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:00:19 devstack sudo[99626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:00:19 devstack sudo[99626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:00:20 devstack sudo[99622]: pam_unix(sudo:session): session closed for user root Jul 10 16:00:20 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-e04be945-2821-4f9b-97d3-bd2ae7309cc8 tempest-CinderUnicodeTest-1864528855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-dc87cbd2-547b-42c3-8483-25c013932f82 1073741824" returned: 0 in 1.035s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:00:20 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-e04be945-2821-4f9b-97d3-bd2ae7309cc8 tempest-CinderUnicodeTest-1864528855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-dc87cbd2-547b-42c3-8483-25c013932f82 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:00:20 devstack sudo[99626]: pam_unix(sudo:session): session closed for user root Jul 10 16:00:20 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-362b426c-b789-4f55-908f-27971de356be tempest-VolumesActionsTest-306599127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.770s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:00:20 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-362b426c-b789-4f55-908f-27971de356be tempest-VolumesActionsTest-306599127 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:00:20 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-362b426c-b789-4f55-908f-27971de356be tempest-VolumesActionsTest-306599127 None] Deleted volume successfully. Jul 10 16:00:20 devstack sudo[99633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-dc87cbd2-547b-42c3-8483-25c013932f82 Jul 10 16:00:20 devstack sudo[99633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:00:20 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-362b426c-b789-4f55-908f-27971de356be tempest-VolumesActionsTest-306599127 None] Lock "cinder-f75ebe8b-4019-4269-938c-f93cee180a91-delete_volume" released by "delete_volume" :: held 2.651s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:00:20 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9308b1c-0410-4641-9497-1101d3889066 tempest-VolumesActionsTest-462308728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 16:00:20 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f9308b1c-0410-4641-9497-1101d3889066 tempest-VolumesActionsTest-462308728 None] Flow 'volume_create_manager' (0387e9de-c098-4921-bab7-269a192d56a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:00:20 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f9308b1c-0410-4641-9497-1101d3889066 tempest-VolumesActionsTest-462308728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54f1a03b-5411-47f3-acdb-57f6631ffa0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:00:20 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f9308b1c-0410-4641-9497-1101d3889066 tempest-VolumesActionsTest-462308728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54f1a03b-5411-47f3-acdb-57f6631ffa0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:00:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-177209702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f97161e-b02b-4d74-af28-bf1043ccba64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1c36a9c42fa40b78bc74dd9edaf17ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:00:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:00:20Z,use_quota=True,user_id='269a68e2fcc64ca3ae097dcfc9d72e93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:00:20 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f9308b1c-0410-4641-9497-1101d3889066 tempest-VolumesActionsTest-462308728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34ebc3a6-011a-4511-b3d2-5c8300fe0b7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:00:20 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f9308b1c-0410-4641-9497-1101d3889066 tempest-VolumesActionsTest-462308728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34ebc3a6-011a-4511-b3d2-5c8300fe0b7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:00:20 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f9308b1c-0410-4641-9497-1101d3889066 tempest-VolumesActionsTest-462308728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b8ded74-f24d-4d5d-82e0-ad9e43d003a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:00:20 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f9308b1c-0410-4641-9497-1101d3889066 tempest-VolumesActionsTest-462308728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b8ded74-f24d-4d5d-82e0-ad9e43d003a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f97161e-b02b-4d74-af28-bf1043ccba64', 'volume_name': 'volume-3f97161e-b02b-4d74-af28-bf1043ccba64', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:00:20 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f9308b1c-0410-4641-9497-1101d3889066 tempest-VolumesActionsTest-462308728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9aa0e1f9-719a-4365-98dd-97a4c80db5c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:00:20 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f9308b1c-0410-4641-9497-1101d3889066 tempest-VolumesActionsTest-462308728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9aa0e1f9-719a-4365-98dd-97a4c80db5c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:00:20 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f9308b1c-0410-4641-9497-1101d3889066 tempest-VolumesActionsTest-462308728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57533ab5-e0b9-40f4-9423-2d6e78a96ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:00:20 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-f9308b1c-0410-4641-9497-1101d3889066 tempest-VolumesActionsTest-462308728 None] Volume 3f97161e-b02b-4d74-af28-bf1043ccba64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f97161e-b02b-4d74-af28-bf1043ccba64', 'volume_size': 1} Jul 10 16:00:20 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-f9308b1c-0410-4641-9497-1101d3889066 tempest-VolumesActionsTest-462308728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:00:20 devstack sudo[99633]: pam_unix(sudo:session): session closed for user root Jul 10 16:00:20 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-e04be945-2821-4f9b-97d3-bd2ae7309cc8 tempest-CinderUnicodeTest-1864528855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-dc87cbd2-547b-42c3-8483-25c013932f82" returned: 0 in 0.736s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:00:20 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-e04be945-2821-4f9b-97d3-bd2ae7309cc8 tempest-CinderUnicodeTest-1864528855 None] <== create_volume: return (1821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 16:00:20 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-e04be945-2821-4f9b-97d3-bd2ae7309cc8 tempest-CinderUnicodeTest-1864528855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.823s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:00:20 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-f9308b1c-0410-4641-9497-1101d3889066 tempest-VolumesActionsTest-462308728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.235s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:00:20 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-f9308b1c-0410-4641-9497-1101d3889066 tempest-VolumesActionsTest-462308728 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:00:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-177209702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f97161e-b02b-4d74-af28-bf1043ccba64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1c36a9c42fa40b78bc74dd9edaf17ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:00:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:00:20Z,use_quota=True,user_id='269a68e2fcc64ca3ae097dcfc9d72e93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 16:00:20 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-f9308b1c-0410-4641-9497-1101d3889066 tempest-VolumesActionsTest-462308728 None] Creating volume 3f97161e-b02b-4d74-af28-bf1043ccba64 {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 16:00:20 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-f9308b1c-0410-4641-9497-1101d3889066 tempest-VolumesActionsTest-462308728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:00:20 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-f9308b1c-0410-4641-9497-1101d3889066 tempest-VolumesActionsTest-462308728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:00:20 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-f9308b1c-0410-4641-9497-1101d3889066 tempest-VolumesActionsTest-462308728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:00:20 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-f9308b1c-0410-4641-9497-1101d3889066 tempest-VolumesActionsTest-462308728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:00:20 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-f9308b1c-0410-4641-9497-1101d3889066 tempest-VolumesActionsTest-462308728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:00:20 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-f9308b1c-0410-4641-9497-1101d3889066 tempest-VolumesActionsTest-462308728 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 16:00:20 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-f9308b1c-0410-4641-9497-1101d3889066 tempest-VolumesActionsTest-462308728 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 16:00:20 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f9308b1c-0410-4641-9497-1101d3889066 tempest-VolumesActionsTest-462308728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3f97161e-b02b-4d74-af28-bf1043ccba64 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:00:20 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-e04be945-2821-4f9b-97d3-bd2ae7309cc8 tempest-CinderUnicodeTest-1864528855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be89d852-dd7c-4470-a292-c2b79aa5bd96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc87cbd2-547b-42c3-8483-25c013932f82', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:00:20 devstack sudo[99639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3f97161e-b02b-4d74-af28-bf1043ccba64 1073741824 Jul 10 16:00:20 devstack sudo[99639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:00:20 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-e04be945-2821-4f9b-97d3-bd2ae7309cc8 tempest-CinderUnicodeTest-1864528855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37b36482-fca3-45af-a769-f7f5b49cb018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:00:20 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-e04be945-2821-4f9b-97d3-bd2ae7309cc8 tempest-CinderUnicodeTest-1864528855 None] Volume volume-dc87cbd2-547b-42c3-8483-25c013932f82 (dc87cbd2-547b-42c3-8483-25c013932f82): created successfully Jul 10 16:00:20 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-e04be945-2821-4f9b-97d3-bd2ae7309cc8 tempest-CinderUnicodeTest-1864528855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37b36482-fca3-45af-a769-f7f5b49cb018) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:00:20 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-e04be945-2821-4f9b-97d3-bd2ae7309cc8 tempest-CinderUnicodeTest-1864528855 None] Flow 'volume_create_manager' (3a4cca1c-29ff-4de7-8f61-c5cb007e808b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:00:20 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-e04be945-2821-4f9b-97d3-bd2ae7309cc8 tempest-CinderUnicodeTest-1864528855 None] Created volume successfully. Jul 10 16:00:21 devstack sudo[99639]: pam_unix(sudo:session): session closed for user root Jul 10 16:00:21 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f9308b1c-0410-4641-9497-1101d3889066 tempest-VolumesActionsTest-462308728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3f97161e-b02b-4d74-af28-bf1043ccba64 1073741824" returned: 0 in 0.907s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:00:21 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f9308b1c-0410-4641-9497-1101d3889066 tempest-VolumesActionsTest-462308728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3f97161e-b02b-4d74-af28-bf1043ccba64 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:00:21 devstack sudo[99651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3f97161e-b02b-4d74-af28-bf1043ccba64 Jul 10 16:00:21 devstack sudo[99651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:00:22 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-b425435c-446b-4b35-a7fa-192170297525 tempest-CinderUnicodeTest-1864528855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:00:22 devstack sudo[99651]: pam_unix(sudo:session): session closed for user root Jul 10 16:00:22 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f9308b1c-0410-4641-9497-1101d3889066 tempest-VolumesActionsTest-462308728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3f97161e-b02b-4d74-af28-bf1043ccba64" returned: 0 in 0.721s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:00:22 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-f9308b1c-0410-4641-9497-1101d3889066 tempest-VolumesActionsTest-462308728 None] <== create_volume: return (1674ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 16:00:22 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-f9308b1c-0410-4641-9497-1101d3889066 tempest-VolumesActionsTest-462308728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.677s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:00:22 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-b425435c-446b-4b35-a7fa-192170297525 tempest-CinderUnicodeTest-1864528855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.185s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:00:22 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f9308b1c-0410-4641-9497-1101d3889066 tempest-VolumesActionsTest-462308728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57533ab5-e0b9-40f4-9423-2d6e78a96ac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f97161e-b02b-4d74-af28-bf1043ccba64', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:00:22 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f9308b1c-0410-4641-9497-1101d3889066 tempest-VolumesActionsTest-462308728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43e9c386-45b3-46d7-a792-36bba9714a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:00:22 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-b425435c-446b-4b35-a7fa-192170297525 tempest-CinderUnicodeTest-1864528855 None] Creating offline snapshot e9a27ed7-70d6-4d98-9104-eb344e8f8666 of volume dc87cbd2-547b-42c3-8483-25c013932f82 {{(pid=87420) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 16:00:22 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-f9308b1c-0410-4641-9497-1101d3889066 tempest-VolumesActionsTest-462308728 None] Volume volume-3f97161e-b02b-4d74-af28-bf1043ccba64 (3f97161e-b02b-4d74-af28-bf1043ccba64): created successfully Jul 10 16:00:22 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f9308b1c-0410-4641-9497-1101d3889066 tempest-VolumesActionsTest-462308728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43e9c386-45b3-46d7-a792-36bba9714a62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:00:22 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f9308b1c-0410-4641-9497-1101d3889066 tempest-VolumesActionsTest-462308728 None] Flow 'volume_create_manager' (0387e9de-c098-4921-bab7-269a192d56a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:00:22 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[963269c3-8ace-4afa-aa8c-01ba5d6e1ae9]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:00:22 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-b425435c-446b-4b35-a7fa-192170297525 tempest-CinderUnicodeTest-1864528855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-dc87cbd2-547b-42c3-8483-25c013932f82 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:00:22 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-f9308b1c-0410-4641-9497-1101d3889066 tempest-VolumesActionsTest-462308728 None] Created volume successfully. Jul 10 16:00:22 devstack sudo[99665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-dc87cbd2-547b-42c3-8483-25c013932f82 Jul 10 16:00:22 devstack sudo[99665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:00:23 devstack sudo[99665]: pam_unix(sudo:session): session closed for user root Jul 10 16:00:23 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-b425435c-446b-4b35-a7fa-192170297525 tempest-CinderUnicodeTest-1864528855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-dc87cbd2-547b-42c3-8483-25c013932f82" returned: 0 in 0.790s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:00:23 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-b425435c-446b-4b35-a7fa-192170297525 tempest-CinderUnicodeTest-1864528855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-dc87cbd2-547b-42c3-8483-25c013932f82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-dc87cbd2-547b-42c3-8483-25c013932f82.e9a27ed7-70d6-4d98-9104-eb344e8f8666 1G {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:00:23 devstack sudo[99671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-dc87cbd2-547b-42c3-8483-25c013932f82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-dc87cbd2-547b-42c3-8483-25c013932f82.e9a27ed7-70d6-4d98-9104-eb344e8f8666 1G Jul 10 16:00:23 devstack sudo[99671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:00:24 devstack cinder-volume[87420]: INFO cinder.volume.manager [req-92aa9c9b-1391-4ae3-a59a-a5062e011ae4 req-598406df-58d1-468c-8005-cf7fca259256 tempest-TestStampPattern-1127543775 None] Terminate volume connection completed successfully. Jul 10 16:00:24 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [req-92aa9c9b-1391-4ae3-a59a-a5062e011ae4 req-598406df-58d1-468c-8005-cf7fca259256 tempest-TestStampPattern-1127543775 None] Deleting attachment e99bf546-cbda-4217-b35a-a845b2d0d7c6. {{(pid=87420) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 16:00:24 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-ed17a596-76aa-499c-9f11-aec8c91a109a tempest-VolumesActionsTest-462308728 None] Acquiring lock "cinder-3f97161e-b02b-4d74-af28-bf1043ccba64-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:00:24 devstack sudo[99671]: pam_unix(sudo:session): session closed for user root Jul 10 16:00:24 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-b425435c-446b-4b35-a7fa-192170297525 tempest-CinderUnicodeTest-1864528855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-dc87cbd2-547b-42c3-8483-25c013932f82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-dc87cbd2-547b-42c3-8483-25c013932f82.e9a27ed7-70d6-4d98-9104-eb344e8f8666 1G" returned: 0 in 0.969s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:00:24 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-b425435c-446b-4b35-a7fa-192170297525 tempest-CinderUnicodeTest-1864528855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc87cbd2-547b-42c3-8483-25c013932f82 -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-dc87cbd2-547b-42c3-8483-25c013932f82.e9a27ed7-70d6-4d98-9104-eb344e8f8666 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:00:24 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-ed17a596-76aa-499c-9f11-aec8c91a109a tempest-VolumesActionsTest-462308728 None] Lock "cinder-3f97161e-b02b-4d74-af28-bf1043ccba64-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:00:24 devstack sudo[99705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc87cbd2-547b-42c3-8483-25c013932f82 -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-dc87cbd2-547b-42c3-8483-25c013932f82.e9a27ed7-70d6-4d98-9104-eb344e8f8666 Jul 10 16:00:24 devstack sudo[99705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:00:24 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-ed17a596-76aa-499c-9f11-aec8c91a109a tempest-VolumesActionsTest-462308728 None] Acquiring lock "cinder-quobyte-3f97161e-b02b-4d74-af28-bf1043ccba64" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:00:24 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-ed17a596-76aa-499c-9f11-aec8c91a109a tempest-VolumesActionsTest-462308728 None] Lock "cinder-quobyte-3f97161e-b02b-4d74-af28-bf1043ccba64" acquired by "delete_volume" :: waited 0.016s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:00:24 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac277cf4-74c8-4388-964b-56eda8eb2f84]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:00:24 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ed17a596-76aa-499c-9f11-aec8c91a109a tempest-VolumesActionsTest-462308728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3f97161e-b02b-4d74-af28-bf1043ccba64 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:00:24 devstack sudo[99709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3f97161e-b02b-4d74-af28-bf1043ccba64 Jul 10 16:00:24 devstack sudo[99709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:00:25 devstack sudo[99705]: pam_unix(sudo:session): session closed for user root Jul 10 16:00:25 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-b425435c-446b-4b35-a7fa-192170297525 tempest-CinderUnicodeTest-1864528855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc87cbd2-547b-42c3-8483-25c013932f82 -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-dc87cbd2-547b-42c3-8483-25c013932f82.e9a27ed7-70d6-4d98-9104-eb344e8f8666" returned: 0 in 0.812s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:00:25 devstack cinder-volume[87420]: WARNING cinder.volume.drivers.remotefs [None req-b425435c-446b-4b35-a7fa-192170297525 tempest-CinderUnicodeTest-1864528855 None] /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-dc87cbd2-547b-42c3-8483-25c013932f82.e9a27ed7-70d6-4d98-9104-eb344e8f8666 is being set with open permissions: ugo+rw Jul 10 16:00:25 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-b425435c-446b-4b35-a7fa-192170297525 tempest-CinderUnicodeTest-1864528855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-dc87cbd2-547b-42c3-8483-25c013932f82.e9a27ed7-70d6-4d98-9104-eb344e8f8666 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:00:25 devstack sudo[99717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-dc87cbd2-547b-42c3-8483-25c013932f82.e9a27ed7-70d6-4d98-9104-eb344e8f8666 Jul 10 16:00:25 devstack sudo[99717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:00:25 devstack sudo[99709]: pam_unix(sudo:session): session closed for user root Jul 10 16:00:25 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ed17a596-76aa-499c-9f11-aec8c91a109a tempest-VolumesActionsTest-462308728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3f97161e-b02b-4d74-af28-bf1043ccba64" returned: 0 in 0.904s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:00:25 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ed17a596-76aa-499c-9f11-aec8c91a109a tempest-VolumesActionsTest-462308728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3f97161e-b02b-4d74-af28-bf1043ccba64 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:00:25 devstack sudo[99720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3f97161e-b02b-4d74-af28-bf1043ccba64 Jul 10 16:00:25 devstack sudo[99720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:00:25 devstack sudo[99717]: pam_unix(sudo:session): session closed for user root Jul 10 16:00:25 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-b425435c-446b-4b35-a7fa-192170297525 tempest-CinderUnicodeTest-1864528855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-dc87cbd2-547b-42c3-8483-25c013932f82.e9a27ed7-70d6-4d98-9104-eb344e8f8666" returned: 0 in 0.809s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:00:25 devstack cinder-volume[87420]: DEBUG dbcounter [-] [87420] Writing DB stats cinder:UPDATE=139,cinder:SELECT=111,cinder:INSERT=36,cinder:DELETE=10 {{(pid=87420) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 16:00:25 devstack cinder-volume[87420]: DEBUG dbcounter [-] [87420] Writing DB stats cinder:SELECT=105,cinder:INSERT=37,cinder:UPDATE=134,cinder:DELETE=13 {{(pid=87420) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 16:00:26 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-b425435c-446b-4b35-a7fa-192170297525 tempest-CinderUnicodeTest-1864528855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-dc87cbd2-547b-42c3-8483-25c013932f82.info {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:00:26 devstack sudo[99723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-dc87cbd2-547b-42c3-8483-25c013932f82.info Jul 10 16:00:26 devstack sudo[99723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:00:26 devstack sudo[99720]: pam_unix(sudo:session): session closed for user root Jul 10 16:00:26 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ed17a596-76aa-499c-9f11-aec8c91a109a tempest-VolumesActionsTest-462308728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3f97161e-b02b-4d74-af28-bf1043ccba64" returned: 0 in 0.916s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:00:26 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-ed17a596-76aa-499c-9f11-aec8c91a109a tempest-VolumesActionsTest-462308728 None] Lock "cinder-quobyte-3f97161e-b02b-4d74-af28-bf1043ccba64" released by "delete_volume" :: held 1.872s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:00:26 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-ed17a596-76aa-499c-9f11-aec8c91a109a tempest-VolumesActionsTest-462308728 None] Created reservations ['d6764ff6-55ca-4916-87ad-51510671ae51', 'b133614d-aade-4a11-9fad-51345152e0dd', '62f484d6-fa60-40f5-864e-ec79e389c62c', '4055a6f6-9669-4577-8ec6-af0039ec78c6'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:00:26 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-ed17a596-76aa-499c-9f11-aec8c91a109a tempest-VolumesActionsTest-462308728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:00:26 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-ed17a596-76aa-499c-9f11-aec8c91a109a tempest-VolumesActionsTest-462308728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:00:26 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-ed17a596-76aa-499c-9f11-aec8c91a109a tempest-VolumesActionsTest-462308728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:00:26 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-ed17a596-76aa-499c-9f11-aec8c91a109a tempest-VolumesActionsTest-462308728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:00:26 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-ed17a596-76aa-499c-9f11-aec8c91a109a tempest-VolumesActionsTest-462308728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:00:26 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ed17a596-76aa-499c-9f11-aec8c91a109a tempest-VolumesActionsTest-462308728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:00:26 devstack sudo[99726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:00:26 devstack sudo[99726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:00:26 devstack sudo[99723]: pam_unix(sudo:session): session closed for user root Jul 10 16:00:26 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-b425435c-446b-4b35-a7fa-192170297525 tempest-CinderUnicodeTest-1864528855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-dc87cbd2-547b-42c3-8483-25c013932f82.info" returned: 0 in 0.940s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:00:26 devstack cinder-volume[87420]: WARNING cinder.volume.drivers.remotefs [None req-b425435c-446b-4b35-a7fa-192170297525 tempest-CinderUnicodeTest-1864528855 None] /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-dc87cbd2-547b-42c3-8483-25c013932f82.info is being set with open permissions: ugo+rw Jul 10 16:00:26 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-b425435c-446b-4b35-a7fa-192170297525 tempest-CinderUnicodeTest-1864528855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-dc87cbd2-547b-42c3-8483-25c013932f82.info {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:00:27 devstack sudo[99731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-dc87cbd2-547b-42c3-8483-25c013932f82.info Jul 10 16:00:27 devstack sudo[99731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:00:27 devstack sudo[99726]: pam_unix(sudo:session): session closed for user root Jul 10 16:00:27 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ed17a596-76aa-499c-9f11-aec8c91a109a tempest-VolumesActionsTest-462308728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 1.161s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:00:27 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-ed17a596-76aa-499c-9f11-aec8c91a109a tempest-VolumesActionsTest-462308728 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:00:27 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-ed17a596-76aa-499c-9f11-aec8c91a109a tempest-VolumesActionsTest-462308728 None] Deleted volume successfully. Jul 10 16:00:27 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-ed17a596-76aa-499c-9f11-aec8c91a109a tempest-VolumesActionsTest-462308728 None] Lock "cinder-3f97161e-b02b-4d74-af28-bf1043ccba64-delete_volume" released by "delete_volume" :: held 3.364s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:00:28 devstack sudo[99731]: pam_unix(sudo:session): session closed for user root Jul 10 16:00:28 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-b425435c-446b-4b35-a7fa-192170297525 tempest-CinderUnicodeTest-1864528855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-dc87cbd2-547b-42c3-8483-25c013932f82.info" returned: 0 in 1.158s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:00:28 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-b425435c-446b-4b35-a7fa-192170297525 tempest-CinderUnicodeTest-1864528855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.664s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:00:28 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-b425435c-446b-4b35-a7fa-192170297525 tempest-CinderUnicodeTest-1864528855 None] Create snapshot completed successfully Jul 10 16:00:28 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-6993a81f-565c-4731-a89d-ebca2f952217 tempest-CinderUnicodeTest-1864528855 None] Acquiring lock "cinder-e9a27ed7-70d6-4d98-9104-eb344e8f8666-delete_snapshot" by "delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:00:28 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-6993a81f-565c-4731-a89d-ebca2f952217 tempest-CinderUnicodeTest-1864528855 None] Lock "cinder-e9a27ed7-70d6-4d98-9104-eb344e8f8666-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:00:28 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-6993a81f-565c-4731-a89d-ebca2f952217 tempest-CinderUnicodeTest-1864528855 None] Acquiring lock "cinder-quobyte-dc87cbd2-547b-42c3-8483-25c013932f82" by "delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:00:28 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-6993a81f-565c-4731-a89d-ebca2f952217 tempest-CinderUnicodeTest-1864528855 None] Lock "cinder-quobyte-dc87cbd2-547b-42c3-8483-25c013932f82" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:00:28 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-6993a81f-565c-4731-a89d-ebca2f952217 tempest-CinderUnicodeTest-1864528855 None] Acquiring lock "cinder-quobyte-e9a27ed7-70d6-4d98-9104-eb344e8f8666" by "_delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:00:28 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-6993a81f-565c-4731-a89d-ebca2f952217 tempest-CinderUnicodeTest-1864528855 None] Lock "cinder-quobyte-e9a27ed7-70d6-4d98-9104-eb344e8f8666" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:00:28 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-6993a81f-565c-4731-a89d-ebca2f952217 tempest-CinderUnicodeTest-1864528855 None] Deleting offline snapshot e9a27ed7-70d6-4d98-9104-eb344e8f8666 of volume dc87cbd2-547b-42c3-8483-25c013932f82 {{(pid=87420) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 16:00:28 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-6993a81f-565c-4731-a89d-ebca2f952217 tempest-CinderUnicodeTest-1864528855 None] snapshot_file for this snap is: volume-dc87cbd2-547b-42c3-8483-25c013932f82.e9a27ed7-70d6-4d98-9104-eb344e8f8666 {{(pid=87420) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 16:00:28 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[496d3d34-9711-40f5-b4e4-d995ffe09d4d]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:00:28 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6993a81f-565c-4731-a89d-ebca2f952217 tempest-CinderUnicodeTest-1864528855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-dc87cbd2-547b-42c3-8483-25c013932f82.e9a27ed7-70d6-4d98-9104-eb344e8f8666 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:00:28 devstack sudo[99757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-dc87cbd2-547b-42c3-8483-25c013932f82.e9a27ed7-70d6-4d98-9104-eb344e8f8666 Jul 10 16:00:28 devstack sudo[99757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:00:29 devstack sudo[99757]: pam_unix(sudo:session): session closed for user root Jul 10 16:00:29 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6993a81f-565c-4731-a89d-ebca2f952217 tempest-CinderUnicodeTest-1864528855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-dc87cbd2-547b-42c3-8483-25c013932f82.e9a27ed7-70d6-4d98-9104-eb344e8f8666" returned: 0 in 1.163s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:00:29 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-6993a81f-565c-4731-a89d-ebca2f952217 tempest-CinderUnicodeTest-1864528855 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dc87cbd2-547b-42c3-8483-25c013932f82(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87420) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 16:00:29 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[0091d3ca-1579-4cd3-8e61-8f0cda00450f]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:00:29 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6993a81f-565c-4731-a89d-ebca2f952217 tempest-CinderUnicodeTest-1864528855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-dc87cbd2-547b-42c3-8483-25c013932f82 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:00:30 devstack sudo[99783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-dc87cbd2-547b-42c3-8483-25c013932f82 Jul 10 16:00:30 devstack sudo[99783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:00:31 devstack sudo[99783]: pam_unix(sudo:session): session closed for user root Jul 10 16:00:31 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6993a81f-565c-4731-a89d-ebca2f952217 tempest-CinderUnicodeTest-1864528855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-dc87cbd2-547b-42c3-8483-25c013932f82" returned: 0 in 1.025s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:00:31 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6993a81f-565c-4731-a89d-ebca2f952217 tempest-CinderUnicodeTest-1864528855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-dc87cbd2-547b-42c3-8483-25c013932f82.e9a27ed7-70d6-4d98-9104-eb344e8f8666 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:00:31 devstack sudo[99789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-dc87cbd2-547b-42c3-8483-25c013932f82.e9a27ed7-70d6-4d98-9104-eb344e8f8666 Jul 10 16:00:31 devstack sudo[99789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:00:32 devstack sudo[99789]: pam_unix(sudo:session): session closed for user root Jul 10 16:00:32 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6993a81f-565c-4731-a89d-ebca2f952217 tempest-CinderUnicodeTest-1864528855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-dc87cbd2-547b-42c3-8483-25c013932f82.e9a27ed7-70d6-4d98-9104-eb344e8f8666" returned: 0 in 1.145s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:00:32 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6993a81f-565c-4731-a89d-ebca2f952217 tempest-CinderUnicodeTest-1864528855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-dc87cbd2-547b-42c3-8483-25c013932f82.e9a27ed7-70d6-4d98-9104-eb344e8f8666 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:00:32 devstack sudo[99824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-dc87cbd2-547b-42c3-8483-25c013932f82.e9a27ed7-70d6-4d98-9104-eb344e8f8666 Jul 10 16:00:32 devstack sudo[99824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:00:33 devstack sudo[99824]: pam_unix(sudo:session): session closed for user root Jul 10 16:00:33 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6993a81f-565c-4731-a89d-ebca2f952217 tempest-CinderUnicodeTest-1864528855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-dc87cbd2-547b-42c3-8483-25c013932f82.e9a27ed7-70d6-4d98-9104-eb344e8f8666" returned: 0 in 1.056s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:00:33 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-6993a81f-565c-4731-a89d-ebca2f952217 tempest-CinderUnicodeTest-1864528855 None] Lock "cinder-quobyte-e9a27ed7-70d6-4d98-9104-eb344e8f8666" released by "_delete_snapshot" :: held 4.528s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:00:33 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-6993a81f-565c-4731-a89d-ebca2f952217 tempest-CinderUnicodeTest-1864528855 None] Lock "cinder-quobyte-dc87cbd2-547b-42c3-8483-25c013932f82" released by "delete_snapshot" :: held 4.557s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:00:33 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-6993a81f-565c-4731-a89d-ebca2f952217 tempest-CinderUnicodeTest-1864528855 None] Created reservations ['a1986f07-7d78-43da-aa36-6b30c1cc0b22', '9462afc0-2b8c-49ac-a241-b03505d0640d', '4d9032b6-8c7e-4536-92d9-dbe07d76829d', 'e5b8c59b-c77c-4b69-a9a8-2493b78c44d9'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:00:33 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-6993a81f-565c-4731-a89d-ebca2f952217 tempest-CinderUnicodeTest-1864528855 None] Delete snapshot completed successfully. Jul 10 16:00:33 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-6993a81f-565c-4731-a89d-ebca2f952217 tempest-CinderUnicodeTest-1864528855 None] Lock "cinder-e9a27ed7-70d6-4d98-9104-eb344e8f8666-delete_snapshot" released by "delete_snapshot" :: held 4.707s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:00:34 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-5e495204-cb69-4176-a0ec-5d35d9deadb8 tempest-CinderUnicodeTest-1864528855 None] Acquiring lock "cinder-dc87cbd2-547b-42c3-8483-25c013932f82-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:00:34 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-5e495204-cb69-4176-a0ec-5d35d9deadb8 tempest-CinderUnicodeTest-1864528855 None] Lock "cinder-dc87cbd2-547b-42c3-8483-25c013932f82-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:00:34 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-5e495204-cb69-4176-a0ec-5d35d9deadb8 tempest-CinderUnicodeTest-1864528855 None] Acquiring lock "cinder-quobyte-dc87cbd2-547b-42c3-8483-25c013932f82" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:00:34 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-5e495204-cb69-4176-a0ec-5d35d9deadb8 tempest-CinderUnicodeTest-1864528855 None] Lock "cinder-quobyte-dc87cbd2-547b-42c3-8483-25c013932f82" acquired by "delete_volume" :: waited 0.025s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:00:34 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[e75eae63-98a9-4fcc-8204-6a54cdb3f887]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:00:34 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-5e495204-cb69-4176-a0ec-5d35d9deadb8 tempest-CinderUnicodeTest-1864528855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-dc87cbd2-547b-42c3-8483-25c013932f82 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:00:34 devstack sudo[99900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-dc87cbd2-547b-42c3-8483-25c013932f82 Jul 10 16:00:34 devstack sudo[99900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:00:35 devstack sudo[99900]: pam_unix(sudo:session): session closed for user root Jul 10 16:00:35 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-5e495204-cb69-4176-a0ec-5d35d9deadb8 tempest-CinderUnicodeTest-1864528855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-dc87cbd2-547b-42c3-8483-25c013932f82" returned: 0 in 1.065s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:00:35 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-5e495204-cb69-4176-a0ec-5d35d9deadb8 tempest-CinderUnicodeTest-1864528855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-dc87cbd2-547b-42c3-8483-25c013932f82 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:00:35 devstack sudo[99908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-dc87cbd2-547b-42c3-8483-25c013932f82 Jul 10 16:00:35 devstack sudo[99908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:00:36 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-8406834e-26f0-435b-bc06-0d4e66e320c1 tempest-TestStampPattern-1127543775 None] Acquiring lock "cinder-894f402d-cb97-4505-b7f9-5c40607bb703-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:00:36 devstack sudo[99908]: pam_unix(sudo:session): session closed for user root Jul 10 16:00:36 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-5e495204-cb69-4176-a0ec-5d35d9deadb8 tempest-CinderUnicodeTest-1864528855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-dc87cbd2-547b-42c3-8483-25c013932f82" returned: 0 in 0.903s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:00:36 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-8406834e-26f0-435b-bc06-0d4e66e320c1 tempest-TestStampPattern-1127543775 None] Lock "cinder-894f402d-cb97-4505-b7f9-5c40607bb703-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:00:36 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-5e495204-cb69-4176-a0ec-5d35d9deadb8 tempest-CinderUnicodeTest-1864528855 None] Lock "cinder-quobyte-dc87cbd2-547b-42c3-8483-25c013932f82" released by "delete_volume" :: held 2.069s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:00:36 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-8406834e-26f0-435b-bc06-0d4e66e320c1 tempest-TestStampPattern-1127543775 None] Acquiring lock "cinder-quobyte-894f402d-cb97-4505-b7f9-5c40607bb703" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:00:36 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-8406834e-26f0-435b-bc06-0d4e66e320c1 tempest-TestStampPattern-1127543775 None] Lock "cinder-quobyte-894f402d-cb97-4505-b7f9-5c40607bb703" acquired by "delete_volume" :: waited 0.030s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:00:36 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[b03665db-38ed-48b3-9aa3-7fbee138b2a5]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:00:36 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8406834e-26f0-435b-bc06-0d4e66e320c1 tempest-TestStampPattern-1127543775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-894f402d-cb97-4505-b7f9-5c40607bb703 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:00:36 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-5e495204-cb69-4176-a0ec-5d35d9deadb8 tempest-CinderUnicodeTest-1864528855 None] Created reservations ['7dce2930-f680-471a-84b1-5edc0250b69b', 'f85e1f7b-35a6-46ad-bb75-cbd1f2809426', '6a223bf2-39ce-4f39-9396-59d7f5bf04e0', 'b4abf4c9-f5be-4310-a2b9-4ba887529660'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:00:36 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-5e495204-cb69-4176-a0ec-5d35d9deadb8 tempest-CinderUnicodeTest-1864528855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:00:36 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-5e495204-cb69-4176-a0ec-5d35d9deadb8 tempest-CinderUnicodeTest-1864528855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:00:36 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-5e495204-cb69-4176-a0ec-5d35d9deadb8 tempest-CinderUnicodeTest-1864528855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:00:36 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-5e495204-cb69-4176-a0ec-5d35d9deadb8 tempest-CinderUnicodeTest-1864528855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:00:36 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-5e495204-cb69-4176-a0ec-5d35d9deadb8 tempest-CinderUnicodeTest-1864528855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:00:36 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-5e495204-cb69-4176-a0ec-5d35d9deadb8 tempest-CinderUnicodeTest-1864528855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:00:36 devstack sudo[99912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:00:36 devstack sudo[99912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:00:36 devstack sudo[99911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-894f402d-cb97-4505-b7f9-5c40607bb703 Jul 10 16:00:36 devstack sudo[99911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:00:37 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-1c7a6ae4-4947-4a75-8102-8f16ccac1080 tempest-VolumesActionsTest-9461107 None] Acquiring lock "cinder-3ffbabb0-4ce4-42a6-a34e-0fd7970b58b6" by "attach_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:00:37 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-1c7a6ae4-4947-4a75-8102-8f16ccac1080 tempest-VolumesActionsTest-9461107 None] Lock "cinder-3ffbabb0-4ce4-42a6-a34e-0fd7970b58b6" acquired by "attach_volume" :: waited 0.073s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:00:37 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-65765ce5-b598-465d-8d38-8a0b054990e3 tempest-CinderUnicodeTest-1864528855 None] Acquiring lock "cinder-86ff0408-6125-4d25-a37b-322e0e92b033-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:00:37 devstack sudo[99911]: pam_unix(sudo:session): session closed for user root Jul 10 16:00:37 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8406834e-26f0-435b-bc06-0d4e66e320c1 tempest-TestStampPattern-1127543775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-894f402d-cb97-4505-b7f9-5c40607bb703" returned: 0 in 1.383s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:00:37 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8406834e-26f0-435b-bc06-0d4e66e320c1 tempest-TestStampPattern-1127543775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-894f402d-cb97-4505-b7f9-5c40607bb703 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:00:37 devstack sudo[99920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-894f402d-cb97-4505-b7f9-5c40607bb703 Jul 10 16:00:37 devstack sudo[99920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:00:37 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-65765ce5-b598-465d-8d38-8a0b054990e3 tempest-CinderUnicodeTest-1864528855 None] Lock "cinder-86ff0408-6125-4d25-a37b-322e0e92b033-delete_volume" acquired by "delete_volume" :: waited 0.130s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:00:37 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-1c7a6ae4-4947-4a75-8102-8f16ccac1080 tempest-VolumesActionsTest-9461107 None] Attaching volume 3ffbabb0-4ce4-42a6-a34e-0fd7970b58b6 to instance 0c9fc946-e6bf-48f4-818f-bcdb4545025a at mountpoint /dev/vdb on host None. Jul 10 16:00:38 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-65765ce5-b598-465d-8d38-8a0b054990e3 tempest-CinderUnicodeTest-1864528855 None] Acquiring lock "cinder-quobyte-86ff0408-6125-4d25-a37b-322e0e92b033" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:00:38 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-1c7a6ae4-4947-4a75-8102-8f16ccac1080 tempest-VolumesActionsTest-9461107 None] Attach volume completed successfully. Jul 10 16:00:38 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-65765ce5-b598-465d-8d38-8a0b054990e3 tempest-CinderUnicodeTest-1864528855 None] Lock "cinder-quobyte-86ff0408-6125-4d25-a37b-322e0e92b033" acquired by "delete_volume" :: waited 0.041s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:00:38 devstack sudo[99912]: pam_unix(sudo:session): session closed for user root Jul 10 16:00:38 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-5e495204-cb69-4176-a0ec-5d35d9deadb8 tempest-CinderUnicodeTest-1864528855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 1.533s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:00:38 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-5e495204-cb69-4176-a0ec-5d35d9deadb8 tempest-CinderUnicodeTest-1864528855 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:00:38 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-1c7a6ae4-4947-4a75-8102-8f16ccac1080 tempest-VolumesActionsTest-9461107 None] Lock "cinder-3ffbabb0-4ce4-42a6-a34e-0fd7970b58b6" released by "attach_volume" :: held 0.505s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:00:38 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7a8ae5c-e959-48c3-bcbf-ae4cf49aa905]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:00:38 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-5e495204-cb69-4176-a0ec-5d35d9deadb8 tempest-CinderUnicodeTest-1864528855 None] Deleted volume successfully. Jul 10 16:00:38 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-65765ce5-b598-465d-8d38-8a0b054990e3 tempest-CinderUnicodeTest-1864528855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-86ff0408-6125-4d25-a37b-322e0e92b033 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:00:38 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-5e495204-cb69-4176-a0ec-5d35d9deadb8 tempest-CinderUnicodeTest-1864528855 None] Lock "cinder-dc87cbd2-547b-42c3-8483-25c013932f82-delete_volume" released by "delete_volume" :: held 4.062s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:00:38 devstack sudo[99922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-86ff0408-6125-4d25-a37b-322e0e92b033 Jul 10 16:00:38 devstack sudo[99922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:00:38 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-bff7ac61-3002-43ce-869b-a251ec5b9d82 tempest-VolumesActionsTest-9461107 None] Acquiring lock "cinder-3ffbabb0-4ce4-42a6-a34e-0fd7970b58b6-detach_volume" by "detach_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:00:38 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-bff7ac61-3002-43ce-869b-a251ec5b9d82 tempest-VolumesActionsTest-9461107 None] Lock "cinder-3ffbabb0-4ce4-42a6-a34e-0fd7970b58b6-detach_volume" acquired by "detach_volume" :: waited 0.029s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:00:38 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-bff7ac61-3002-43ce-869b-a251ec5b9d82 tempest-VolumesActionsTest-9461107 None] Detaching volume 3ffbabb0-4ce4-42a6-a34e-0fd7970b58b6 from instance 0c9fc946-e6bf-48f4-818f-bcdb4545025a. Jul 10 16:00:38 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-bff7ac61-3002-43ce-869b-a251ec5b9d82 tempest-VolumesActionsTest-9461107 None] Detach volume completed successfully. Jul 10 16:00:38 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-bff7ac61-3002-43ce-869b-a251ec5b9d82 tempest-VolumesActionsTest-9461107 None] Lock "cinder-3ffbabb0-4ce4-42a6-a34e-0fd7970b58b6-detach_volume" released by "detach_volume" :: held 0.073s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:00:38 devstack sudo[99920]: pam_unix(sudo:session): session closed for user root Jul 10 16:00:38 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8406834e-26f0-435b-bc06-0d4e66e320c1 tempest-TestStampPattern-1127543775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-894f402d-cb97-4505-b7f9-5c40607bb703" returned: 0 in 0.996s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:00:38 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-8406834e-26f0-435b-bc06-0d4e66e320c1 tempest-TestStampPattern-1127543775 None] Lock "cinder-quobyte-894f402d-cb97-4505-b7f9-5c40607bb703" released by "delete_volume" :: held 2.491s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:00:38 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-8406834e-26f0-435b-bc06-0d4e66e320c1 tempest-TestStampPattern-1127543775 None] Created reservations ['c7c057a1-c066-4483-a8eb-c72c4215283b', 'f17282f1-cca9-438c-88bb-c7bcdb25e513', '1252c21f-5162-4999-8ab3-f250ad4204f8', '3d257d88-9c6a-4a4e-9f6f-34d2cd6213cc'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:00:39 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-8406834e-26f0-435b-bc06-0d4e66e320c1 tempest-TestStampPattern-1127543775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:00:39 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-8406834e-26f0-435b-bc06-0d4e66e320c1 tempest-TestStampPattern-1127543775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:00:39 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-8406834e-26f0-435b-bc06-0d4e66e320c1 tempest-TestStampPattern-1127543775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:00:39 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-8406834e-26f0-435b-bc06-0d4e66e320c1 tempest-TestStampPattern-1127543775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:00:39 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-8406834e-26f0-435b-bc06-0d4e66e320c1 tempest-TestStampPattern-1127543775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:00:39 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8406834e-26f0-435b-bc06-0d4e66e320c1 tempest-TestStampPattern-1127543775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:00:39 devstack sudo[99926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:00:39 devstack sudo[99926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:00:39 devstack sudo[99922]: pam_unix(sudo:session): session closed for user root Jul 10 16:00:39 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-65765ce5-b598-465d-8d38-8a0b054990e3 tempest-CinderUnicodeTest-1864528855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-86ff0408-6125-4d25-a37b-322e0e92b033" returned: 0 in 1.285s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:00:39 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-65765ce5-b598-465d-8d38-8a0b054990e3 tempest-CinderUnicodeTest-1864528855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-86ff0408-6125-4d25-a37b-322e0e92b033 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:00:39 devstack sudo[99931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-86ff0408-6125-4d25-a37b-322e0e92b033 Jul 10 16:00:39 devstack sudo[99931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:00:40 devstack sudo[99926]: pam_unix(sudo:session): session closed for user root Jul 10 16:00:40 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8406834e-26f0-435b-bc06-0d4e66e320c1 tempest-TestStampPattern-1127543775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 1.035s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:00:40 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-8406834e-26f0-435b-bc06-0d4e66e320c1 tempest-TestStampPattern-1127543775 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:00:40 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-8406834e-26f0-435b-bc06-0d4e66e320c1 tempest-TestStampPattern-1127543775 None] Deleted volume successfully. Jul 10 16:00:40 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-8406834e-26f0-435b-bc06-0d4e66e320c1 tempest-TestStampPattern-1127543775 None] Lock "cinder-894f402d-cb97-4505-b7f9-5c40607bb703-delete_volume" released by "delete_volume" :: held 3.936s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:00:40 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-07931c70-ce5b-4e64-9e2d-f1a68cb687a2 tempest-TestStampPattern-1127543775 None] Acquiring lock "cinder-a9699ac7-4a2e-4683-be0d-ec67ec8cdf63-delete_snapshot" by "delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:00:40 devstack sudo[99931]: pam_unix(sudo:session): session closed for user root Jul 10 16:00:40 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-65765ce5-b598-465d-8d38-8a0b054990e3 tempest-CinderUnicodeTest-1864528855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-86ff0408-6125-4d25-a37b-322e0e92b033" returned: 0 in 1.124s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:00:40 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-07931c70-ce5b-4e64-9e2d-f1a68cb687a2 tempest-TestStampPattern-1127543775 None] Lock "cinder-a9699ac7-4a2e-4683-be0d-ec67ec8cdf63-delete_snapshot" acquired by "delete_snapshot" :: waited 0.058s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:00:40 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-07931c70-ce5b-4e64-9e2d-f1a68cb687a2 tempest-TestStampPattern-1127543775 None] Acquiring lock "cinder-quobyte-4ff68687-c9f5-4d47-a2bb-8312436fc4b7" by "delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:00:40 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-65765ce5-b598-465d-8d38-8a0b054990e3 tempest-CinderUnicodeTest-1864528855 None] Lock "cinder-quobyte-86ff0408-6125-4d25-a37b-322e0e92b033" released by "delete_volume" :: held 2.508s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:00:40 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-07931c70-ce5b-4e64-9e2d-f1a68cb687a2 tempest-TestStampPattern-1127543775 None] Lock "cinder-quobyte-4ff68687-c9f5-4d47-a2bb-8312436fc4b7" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:00:40 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-07931c70-ce5b-4e64-9e2d-f1a68cb687a2 tempest-TestStampPattern-1127543775 None] Acquiring lock "cinder-quobyte-a9699ac7-4a2e-4683-be0d-ec67ec8cdf63" by "_delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:00:40 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-07931c70-ce5b-4e64-9e2d-f1a68cb687a2 tempest-TestStampPattern-1127543775 None] Lock "cinder-quobyte-a9699ac7-4a2e-4683-be0d-ec67ec8cdf63" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:00:40 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-07931c70-ce5b-4e64-9e2d-f1a68cb687a2 tempest-TestStampPattern-1127543775 None] Deleting offline snapshot a9699ac7-4a2e-4683-be0d-ec67ec8cdf63 of volume 4ff68687-c9f5-4d47-a2bb-8312436fc4b7 {{(pid=87420) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 16:00:40 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-07931c70-ce5b-4e64-9e2d-f1a68cb687a2 tempest-TestStampPattern-1127543775 None] snapshot_file for this snap is: volume-4ff68687-c9f5-4d47-a2bb-8312436fc4b7.a9699ac7-4a2e-4683-be0d-ec67ec8cdf63 {{(pid=87420) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 16:00:40 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec725d69-595e-4f85-a531-cbdae123c613]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:00:40 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-07931c70-ce5b-4e64-9e2d-f1a68cb687a2 tempest-TestStampPattern-1127543775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4ff68687-c9f5-4d47-a2bb-8312436fc4b7.a9699ac7-4a2e-4683-be0d-ec67ec8cdf63 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:00:40 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-65765ce5-b598-465d-8d38-8a0b054990e3 tempest-CinderUnicodeTest-1864528855 None] Created reservations ['7ba90748-1774-4e30-b29b-ce4b06d1980d', '853c9ee2-c3c9-4cf6-83fe-81ee290e6d7a', 'bc9bbf58-7d33-4ce7-b964-b7babbac2a3f', '5427f69a-bbd4-4900-b90b-0be396a28a31'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:00:40 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-65765ce5-b598-465d-8d38-8a0b054990e3 tempest-CinderUnicodeTest-1864528855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:00:40 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-65765ce5-b598-465d-8d38-8a0b054990e3 tempest-CinderUnicodeTest-1864528855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:00:40 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-65765ce5-b598-465d-8d38-8a0b054990e3 tempest-CinderUnicodeTest-1864528855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:00:40 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-65765ce5-b598-465d-8d38-8a0b054990e3 tempest-CinderUnicodeTest-1864528855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:00:40 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-65765ce5-b598-465d-8d38-8a0b054990e3 tempest-CinderUnicodeTest-1864528855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:00:40 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-65765ce5-b598-465d-8d38-8a0b054990e3 tempest-CinderUnicodeTest-1864528855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:00:40 devstack sudo[99936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4ff68687-c9f5-4d47-a2bb-8312436fc4b7.a9699ac7-4a2e-4683-be0d-ec67ec8cdf63 Jul 10 16:00:40 devstack sudo[99936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:00:40 devstack sudo[99938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:00:40 devstack sudo[99938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:00:41 devstack sudo[99936]: pam_unix(sudo:session): session closed for user root Jul 10 16:00:41 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-07931c70-ce5b-4e64-9e2d-f1a68cb687a2 tempest-TestStampPattern-1127543775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4ff68687-c9f5-4d47-a2bb-8312436fc4b7.a9699ac7-4a2e-4683-be0d-ec67ec8cdf63" returned: 0 in 1.137s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:00:41 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-07931c70-ce5b-4e64-9e2d-f1a68cb687a2 tempest-TestStampPattern-1127543775 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ff68687-c9f5-4d47-a2bb-8312436fc4b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87420) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 16:00:41 devstack sudo[99938]: pam_unix(sudo:session): session closed for user root Jul 10 16:00:41 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-65765ce5-b598-465d-8d38-8a0b054990e3 tempest-CinderUnicodeTest-1864528855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 1.058s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:00:41 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-65765ce5-b598-465d-8d38-8a0b054990e3 tempest-CinderUnicodeTest-1864528855 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:00:41 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[246910e1-cc93-4c7f-94b9-0012c713c722]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:00:41 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-07931c70-ce5b-4e64-9e2d-f1a68cb687a2 tempest-TestStampPattern-1127543775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4ff68687-c9f5-4d47-a2bb-8312436fc4b7 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:00:41 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-65765ce5-b598-465d-8d38-8a0b054990e3 tempest-CinderUnicodeTest-1864528855 None] Deleted volume successfully. Jul 10 16:00:41 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-65765ce5-b598-465d-8d38-8a0b054990e3 tempest-CinderUnicodeTest-1864528855 None] Lock "cinder-86ff0408-6125-4d25-a37b-322e0e92b033-delete_volume" released by "delete_volume" :: held 4.039s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:00:42 devstack sudo[99963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4ff68687-c9f5-4d47-a2bb-8312436fc4b7 Jul 10 16:00:42 devstack sudo[99963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:00:43 devstack sudo[99963]: pam_unix(sudo:session): session closed for user root Jul 10 16:00:43 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-07931c70-ce5b-4e64-9e2d-f1a68cb687a2 tempest-TestStampPattern-1127543775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4ff68687-c9f5-4d47-a2bb-8312436fc4b7" returned: 0 in 1.140s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:00:43 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-07931c70-ce5b-4e64-9e2d-f1a68cb687a2 tempest-TestStampPattern-1127543775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4ff68687-c9f5-4d47-a2bb-8312436fc4b7.a9699ac7-4a2e-4683-be0d-ec67ec8cdf63 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:00:43 devstack sudo[99972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4ff68687-c9f5-4d47-a2bb-8312436fc4b7.a9699ac7-4a2e-4683-be0d-ec67ec8cdf63 Jul 10 16:00:43 devstack sudo[99972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:00:43 devstack sudo[99972]: pam_unix(sudo:session): session closed for user root Jul 10 16:00:43 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-07931c70-ce5b-4e64-9e2d-f1a68cb687a2 tempest-TestStampPattern-1127543775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4ff68687-c9f5-4d47-a2bb-8312436fc4b7.a9699ac7-4a2e-4683-be0d-ec67ec8cdf63" returned: 0 in 0.891s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:00:43 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-07931c70-ce5b-4e64-9e2d-f1a68cb687a2 tempest-TestStampPattern-1127543775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4ff68687-c9f5-4d47-a2bb-8312436fc4b7.a9699ac7-4a2e-4683-be0d-ec67ec8cdf63 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:00:43 devstack sudo[99979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4ff68687-c9f5-4d47-a2bb-8312436fc4b7.a9699ac7-4a2e-4683-be0d-ec67ec8cdf63 Jul 10 16:00:43 devstack sudo[99979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:00:44 devstack sudo[99979]: pam_unix(sudo:session): session closed for user root Jul 10 16:00:44 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-07931c70-ce5b-4e64-9e2d-f1a68cb687a2 tempest-TestStampPattern-1127543775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4ff68687-c9f5-4d47-a2bb-8312436fc4b7.a9699ac7-4a2e-4683-be0d-ec67ec8cdf63" returned: 0 in 0.696s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:00:44 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-07931c70-ce5b-4e64-9e2d-f1a68cb687a2 tempest-TestStampPattern-1127543775 None] Lock "cinder-quobyte-a9699ac7-4a2e-4683-be0d-ec67ec8cdf63" released by "_delete_snapshot" :: held 4.056s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:00:44 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-07931c70-ce5b-4e64-9e2d-f1a68cb687a2 tempest-TestStampPattern-1127543775 None] Lock "cinder-quobyte-4ff68687-c9f5-4d47-a2bb-8312436fc4b7" released by "delete_snapshot" :: held 4.089s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:00:44 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-07931c70-ce5b-4e64-9e2d-f1a68cb687a2 tempest-TestStampPattern-1127543775 None] Created reservations ['2c0a3ca8-adb3-46ab-861b-37788d891962', '789aceb1-b222-4019-8521-b916eb649df9', '0ae6b0db-e600-446b-88aa-aeb32eb8565f', '4eea7d11-a1e2-47a8-aa65-de8be9abf742'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:00:44 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-07931c70-ce5b-4e64-9e2d-f1a68cb687a2 tempest-TestStampPattern-1127543775 None] Delete snapshot completed successfully. Jul 10 16:00:44 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-07931c70-ce5b-4e64-9e2d-f1a68cb687a2 tempest-TestStampPattern-1127543775 None] Lock "cinder-a9699ac7-4a2e-4683-be0d-ec67ec8cdf63-delete_snapshot" released by "delete_snapshot" :: held 4.261s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:00:46 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-b943c3ee-0960-4abe-a139-9adae0fc29d3 tempest-VolumesListTestJSON-472358660 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 16:00:46 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b943c3ee-0960-4abe-a139-9adae0fc29d3 tempest-VolumesListTestJSON-472358660 None] Flow 'volume_create_manager' (51434fb7-3b44-48c3-a263-1702cf1fd2ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:00:46 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b943c3ee-0960-4abe-a139-9adae0fc29d3 tempest-VolumesListTestJSON-472358660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56dd5266-e99e-46ae-9dfa-2318016302be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:00:46 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b943c3ee-0960-4abe-a139-9adae0fc29d3 tempest-VolumesListTestJSON-472358660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56dd5266-e99e-46ae-9dfa-2318016302be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:00:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1961542144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d914361-aad4-4da6-af8a-a673f7bb58f4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ee343c66acf64b66a43afe07f67b501a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:00:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:00:46Z,use_quota=True,user_id='b7b3c290cad04dcdaaeecbb7d0150fac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:00:46 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b943c3ee-0960-4abe-a139-9adae0fc29d3 tempest-VolumesListTestJSON-472358660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6149c270-c2d3-4ff3-be36-94e2c3984e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:00:46 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b943c3ee-0960-4abe-a139-9adae0fc29d3 tempest-VolumesListTestJSON-472358660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6149c270-c2d3-4ff3-be36-94e2c3984e93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:00:46 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b943c3ee-0960-4abe-a139-9adae0fc29d3 tempest-VolumesListTestJSON-472358660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab2dff4c-087f-44cc-973c-a644e27a5d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:00:46 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b943c3ee-0960-4abe-a139-9adae0fc29d3 tempest-VolumesListTestJSON-472358660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab2dff4c-087f-44cc-973c-a644e27a5d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d914361-aad4-4da6-af8a-a673f7bb58f4', 'volume_name': 'volume-7d914361-aad4-4da6-af8a-a673f7bb58f4', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:00:46 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b943c3ee-0960-4abe-a139-9adae0fc29d3 tempest-VolumesListTestJSON-472358660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acd299a3-027b-4877-b44a-0257bc9f8d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:00:46 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b943c3ee-0960-4abe-a139-9adae0fc29d3 tempest-VolumesListTestJSON-472358660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acd299a3-027b-4877-b44a-0257bc9f8d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:00:46 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b943c3ee-0960-4abe-a139-9adae0fc29d3 tempest-VolumesListTestJSON-472358660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f97e009-0264-4b28-ba40-05697db53a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:00:46 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-b943c3ee-0960-4abe-a139-9adae0fc29d3 tempest-VolumesListTestJSON-472358660 None] Volume 7d914361-aad4-4da6-af8a-a673f7bb58f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d914361-aad4-4da6-af8a-a673f7bb58f4', 'volume_size': 1} Jul 10 16:00:46 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-b943c3ee-0960-4abe-a139-9adae0fc29d3 tempest-VolumesListTestJSON-472358660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:00:46 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-b943c3ee-0960-4abe-a139-9adae0fc29d3 tempest-VolumesListTestJSON-472358660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:00:46 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-b943c3ee-0960-4abe-a139-9adae0fc29d3 tempest-VolumesListTestJSON-472358660 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:00:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1961542144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d914361-aad4-4da6-af8a-a673f7bb58f4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ee343c66acf64b66a43afe07f67b501a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:00:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:00:46Z,use_quota=True,user_id='b7b3c290cad04dcdaaeecbb7d0150fac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 16:00:46 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-b943c3ee-0960-4abe-a139-9adae0fc29d3 tempest-VolumesListTestJSON-472358660 None] Creating volume 7d914361-aad4-4da6-af8a-a673f7bb58f4 {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 16:00:46 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-b943c3ee-0960-4abe-a139-9adae0fc29d3 tempest-VolumesListTestJSON-472358660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:00:46 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-b943c3ee-0960-4abe-a139-9adae0fc29d3 tempest-VolumesListTestJSON-472358660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:00:46 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-b943c3ee-0960-4abe-a139-9adae0fc29d3 tempest-VolumesListTestJSON-472358660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:00:46 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-b943c3ee-0960-4abe-a139-9adae0fc29d3 tempest-VolumesListTestJSON-472358660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:00:46 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-b943c3ee-0960-4abe-a139-9adae0fc29d3 tempest-VolumesListTestJSON-472358660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:00:46 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-b943c3ee-0960-4abe-a139-9adae0fc29d3 tempest-VolumesListTestJSON-472358660 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 16:00:46 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-b943c3ee-0960-4abe-a139-9adae0fc29d3 tempest-VolumesListTestJSON-472358660 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 16:00:46 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-b943c3ee-0960-4abe-a139-9adae0fc29d3 tempest-VolumesListTestJSON-472358660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7d914361-aad4-4da6-af8a-a673f7bb58f4 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:00:46 devstack sudo[99990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7d914361-aad4-4da6-af8a-a673f7bb58f4 1073741824 Jul 10 16:00:46 devstack sudo[99990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:00:47 devstack sudo[99990]: pam_unix(sudo:session): session closed for user root Jul 10 16:00:47 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-b943c3ee-0960-4abe-a139-9adae0fc29d3 tempest-VolumesListTestJSON-472358660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7d914361-aad4-4da6-af8a-a673f7bb58f4 1073741824" returned: 0 in 1.003s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:00:47 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-b943c3ee-0960-4abe-a139-9adae0fc29d3 tempest-VolumesListTestJSON-472358660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7d914361-aad4-4da6-af8a-a673f7bb58f4 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:00:47 devstack sudo[100005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7d914361-aad4-4da6-af8a-a673f7bb58f4 Jul 10 16:00:47 devstack sudo[100005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:00:48 devstack sudo[100005]: pam_unix(sudo:session): session closed for user root Jul 10 16:00:48 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-b943c3ee-0960-4abe-a139-9adae0fc29d3 tempest-VolumesListTestJSON-472358660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7d914361-aad4-4da6-af8a-a673f7bb58f4" returned: 0 in 0.880s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:00:48 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-b943c3ee-0960-4abe-a139-9adae0fc29d3 tempest-VolumesListTestJSON-472358660 None] <== create_volume: return (1939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 16:00:48 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-b943c3ee-0960-4abe-a139-9adae0fc29d3 tempest-VolumesListTestJSON-472358660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.945s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:00:48 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b943c3ee-0960-4abe-a139-9adae0fc29d3 tempest-VolumesListTestJSON-472358660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f97e009-0264-4b28-ba40-05697db53a52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d914361-aad4-4da6-af8a-a673f7bb58f4', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:00:48 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b943c3ee-0960-4abe-a139-9adae0fc29d3 tempest-VolumesListTestJSON-472358660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8e65317-7a3e-4622-bb45-f7878cf90df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:00:48 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-b943c3ee-0960-4abe-a139-9adae0fc29d3 tempest-VolumesListTestJSON-472358660 None] Volume volume-7d914361-aad4-4da6-af8a-a673f7bb58f4 (7d914361-aad4-4da6-af8a-a673f7bb58f4): created successfully Jul 10 16:00:48 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b943c3ee-0960-4abe-a139-9adae0fc29d3 tempest-VolumesListTestJSON-472358660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8e65317-7a3e-4622-bb45-f7878cf90df5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:00:48 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b943c3ee-0960-4abe-a139-9adae0fc29d3 tempest-VolumesListTestJSON-472358660 None] Flow 'volume_create_manager' (51434fb7-3b44-48c3-a263-1702cf1fd2ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:00:48 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-b943c3ee-0960-4abe-a139-9adae0fc29d3 tempest-VolumesListTestJSON-472358660 None] Created volume successfully. Jul 10 16:00:50 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-c38982b0-5eec-4678-aa75-4601e287c75a tempest-VolumesListTestJSON-472358660 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 16:00:50 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c38982b0-5eec-4678-aa75-4601e287c75a tempest-VolumesListTestJSON-472358660 None] Flow 'volume_create_manager' (9e028079-b160-4c07-b307-e8d6958b4841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:00:50 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c38982b0-5eec-4678-aa75-4601e287c75a tempest-VolumesListTestJSON-472358660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b5f1970-1c47-4b8d-82e2-b1ddec78a57d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:00:50 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c38982b0-5eec-4678-aa75-4601e287c75a tempest-VolumesListTestJSON-472358660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b5f1970-1c47-4b8d-82e2-b1ddec78a57d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:00:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1954596353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a10e3eff-437e-4434-9fa1-e99ceda61d8c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ee343c66acf64b66a43afe07f67b501a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:00:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:00:50Z,use_quota=True,user_id='b7b3c290cad04dcdaaeecbb7d0150fac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:00:50 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c38982b0-5eec-4678-aa75-4601e287c75a tempest-VolumesListTestJSON-472358660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30f30fad-b95e-4c46-9455-7d0073701403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:00:50 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c38982b0-5eec-4678-aa75-4601e287c75a tempest-VolumesListTestJSON-472358660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30f30fad-b95e-4c46-9455-7d0073701403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:00:50 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c38982b0-5eec-4678-aa75-4601e287c75a tempest-VolumesListTestJSON-472358660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41df51be-7726-47f9-896e-7a3bcfbfabfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:00:50 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c38982b0-5eec-4678-aa75-4601e287c75a tempest-VolumesListTestJSON-472358660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41df51be-7726-47f9-896e-7a3bcfbfabfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a10e3eff-437e-4434-9fa1-e99ceda61d8c', 'volume_name': 'volume-a10e3eff-437e-4434-9fa1-e99ceda61d8c', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:00:50 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c38982b0-5eec-4678-aa75-4601e287c75a tempest-VolumesListTestJSON-472358660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2c1859a-ceb7-4091-8b2b-ddb8fe82be58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:00:50 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c38982b0-5eec-4678-aa75-4601e287c75a tempest-VolumesListTestJSON-472358660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2c1859a-ceb7-4091-8b2b-ddb8fe82be58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:00:50 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c38982b0-5eec-4678-aa75-4601e287c75a tempest-VolumesListTestJSON-472358660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f8b34c4-f0bc-41c7-a11b-a4074251ffd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:00:50 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-c38982b0-5eec-4678-aa75-4601e287c75a tempest-VolumesListTestJSON-472358660 None] Volume a10e3eff-437e-4434-9fa1-e99ceda61d8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a10e3eff-437e-4434-9fa1-e99ceda61d8c', 'volume_size': 1} Jul 10 16:00:50 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-c38982b0-5eec-4678-aa75-4601e287c75a tempest-VolumesListTestJSON-472358660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:00:50 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-c38982b0-5eec-4678-aa75-4601e287c75a tempest-VolumesListTestJSON-472358660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:00:50 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-c38982b0-5eec-4678-aa75-4601e287c75a tempest-VolumesListTestJSON-472358660 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:00:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1954596353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a10e3eff-437e-4434-9fa1-e99ceda61d8c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ee343c66acf64b66a43afe07f67b501a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:00:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:00:50Z,use_quota=True,user_id='b7b3c290cad04dcdaaeecbb7d0150fac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 16:00:50 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-c38982b0-5eec-4678-aa75-4601e287c75a tempest-VolumesListTestJSON-472358660 None] Creating volume a10e3eff-437e-4434-9fa1-e99ceda61d8c {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 16:00:50 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-c38982b0-5eec-4678-aa75-4601e287c75a tempest-VolumesListTestJSON-472358660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:00:50 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-c38982b0-5eec-4678-aa75-4601e287c75a tempest-VolumesListTestJSON-472358660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:00:50 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-c38982b0-5eec-4678-aa75-4601e287c75a tempest-VolumesListTestJSON-472358660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:00:50 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-c38982b0-5eec-4678-aa75-4601e287c75a tempest-VolumesListTestJSON-472358660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:00:50 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-c38982b0-5eec-4678-aa75-4601e287c75a tempest-VolumesListTestJSON-472358660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:00:50 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-c38982b0-5eec-4678-aa75-4601e287c75a tempest-VolumesListTestJSON-472358660 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 16:00:50 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-c38982b0-5eec-4678-aa75-4601e287c75a tempest-VolumesListTestJSON-472358660 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 16:00:50 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c38982b0-5eec-4678-aa75-4601e287c75a tempest-VolumesListTestJSON-472358660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a10e3eff-437e-4434-9fa1-e99ceda61d8c 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:00:50 devstack sudo[100027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a10e3eff-437e-4434-9fa1-e99ceda61d8c 1073741824 Jul 10 16:00:50 devstack sudo[100027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:00:51 devstack sudo[100027]: pam_unix(sudo:session): session closed for user root Jul 10 16:00:51 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c38982b0-5eec-4678-aa75-4601e287c75a tempest-VolumesListTestJSON-472358660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a10e3eff-437e-4434-9fa1-e99ceda61d8c 1073741824" returned: 0 in 0.822s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:00:51 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c38982b0-5eec-4678-aa75-4601e287c75a tempest-VolumesListTestJSON-472358660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a10e3eff-437e-4434-9fa1-e99ceda61d8c {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:00:51 devstack sudo[100033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a10e3eff-437e-4434-9fa1-e99ceda61d8c Jul 10 16:00:51 devstack sudo[100033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:00:51 devstack sudo[100033]: pam_unix(sudo:session): session closed for user root Jul 10 16:00:51 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c38982b0-5eec-4678-aa75-4601e287c75a tempest-VolumesListTestJSON-472358660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a10e3eff-437e-4434-9fa1-e99ceda61d8c" returned: 0 in 0.640s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:00:51 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-c38982b0-5eec-4678-aa75-4601e287c75a tempest-VolumesListTestJSON-472358660 None] <== create_volume: return (1505ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 16:00:51 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-c38982b0-5eec-4678-aa75-4601e287c75a tempest-VolumesListTestJSON-472358660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.507s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:00:51 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c38982b0-5eec-4678-aa75-4601e287c75a tempest-VolumesListTestJSON-472358660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f8b34c4-f0bc-41c7-a11b-a4074251ffd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a10e3eff-437e-4434-9fa1-e99ceda61d8c', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:00:51 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c38982b0-5eec-4678-aa75-4601e287c75a tempest-VolumesListTestJSON-472358660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cd6ae18-cefa-47e9-af14-6474d403f7b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:00:51 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-c38982b0-5eec-4678-aa75-4601e287c75a tempest-VolumesListTestJSON-472358660 None] Volume volume-a10e3eff-437e-4434-9fa1-e99ceda61d8c (a10e3eff-437e-4434-9fa1-e99ceda61d8c): created successfully Jul 10 16:00:51 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c38982b0-5eec-4678-aa75-4601e287c75a tempest-VolumesListTestJSON-472358660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cd6ae18-cefa-47e9-af14-6474d403f7b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:00:51 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c38982b0-5eec-4678-aa75-4601e287c75a tempest-VolumesListTestJSON-472358660 None] Flow 'volume_create_manager' (9e028079-b160-4c07-b307-e8d6958b4841) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:00:51 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-c38982b0-5eec-4678-aa75-4601e287c75a tempest-VolumesListTestJSON-472358660 None] Created volume successfully. Jul 10 16:00:53 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f367f62-673f-41a5-bdba-862f51e0e4c2 tempest-VolumesListTestJSON-472358660 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 16:00:53 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6f367f62-673f-41a5-bdba-862f51e0e4c2 tempest-VolumesListTestJSON-472358660 None] Flow 'volume_create_manager' (8d13a188-e6d7-4157-8478-3f931f1e6f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:00:53 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6f367f62-673f-41a5-bdba-862f51e0e4c2 tempest-VolumesListTestJSON-472358660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab566d11-a6a2-46f4-94d3-f2b4c333d2f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:00:53 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6f367f62-673f-41a5-bdba-862f51e0e4c2 tempest-VolumesListTestJSON-472358660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab566d11-a6a2-46f4-94d3-f2b4c333d2f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:00:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-932063417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eae3c40e-e8ed-4741-bc91-5897655a15ba,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ee343c66acf64b66a43afe07f67b501a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:00:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:00:53Z,use_quota=True,user_id='b7b3c290cad04dcdaaeecbb7d0150fac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:00:53 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6f367f62-673f-41a5-bdba-862f51e0e4c2 tempest-VolumesListTestJSON-472358660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5f1f3c0-f476-4d51-a839-a333baba184a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:00:53 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6f367f62-673f-41a5-bdba-862f51e0e4c2 tempest-VolumesListTestJSON-472358660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5f1f3c0-f476-4d51-a839-a333baba184a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:00:53 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6f367f62-673f-41a5-bdba-862f51e0e4c2 tempest-VolumesListTestJSON-472358660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39841e8b-6c7a-4df8-8182-a409f8fac336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:00:53 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6f367f62-673f-41a5-bdba-862f51e0e4c2 tempest-VolumesListTestJSON-472358660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39841e8b-6c7a-4df8-8182-a409f8fac336) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eae3c40e-e8ed-4741-bc91-5897655a15ba', 'volume_name': 'volume-eae3c40e-e8ed-4741-bc91-5897655a15ba', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:00:53 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6f367f62-673f-41a5-bdba-862f51e0e4c2 tempest-VolumesListTestJSON-472358660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09fddb5e-757d-47a8-a36c-fcd9a32230bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:00:53 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6f367f62-673f-41a5-bdba-862f51e0e4c2 tempest-VolumesListTestJSON-472358660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09fddb5e-757d-47a8-a36c-fcd9a32230bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:00:53 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6f367f62-673f-41a5-bdba-862f51e0e4c2 tempest-VolumesListTestJSON-472358660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59395415-a407-441c-ae7f-43a5f96acbe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:00:53 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-6f367f62-673f-41a5-bdba-862f51e0e4c2 tempest-VolumesListTestJSON-472358660 None] Volume eae3c40e-e8ed-4741-bc91-5897655a15ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eae3c40e-e8ed-4741-bc91-5897655a15ba', 'volume_size': 1} Jul 10 16:00:53 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-6f367f62-673f-41a5-bdba-862f51e0e4c2 tempest-VolumesListTestJSON-472358660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:00:53 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-6f367f62-673f-41a5-bdba-862f51e0e4c2 tempest-VolumesListTestJSON-472358660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:00:53 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-6f367f62-673f-41a5-bdba-862f51e0e4c2 tempest-VolumesListTestJSON-472358660 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:00:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-932063417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eae3c40e-e8ed-4741-bc91-5897655a15ba,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ee343c66acf64b66a43afe07f67b501a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:00:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:00:53Z,use_quota=True,user_id='b7b3c290cad04dcdaaeecbb7d0150fac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 16:00:53 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-6f367f62-673f-41a5-bdba-862f51e0e4c2 tempest-VolumesListTestJSON-472358660 None] Creating volume eae3c40e-e8ed-4741-bc91-5897655a15ba {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 16:00:53 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-6f367f62-673f-41a5-bdba-862f51e0e4c2 tempest-VolumesListTestJSON-472358660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:00:53 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-6f367f62-673f-41a5-bdba-862f51e0e4c2 tempest-VolumesListTestJSON-472358660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:00:53 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-6f367f62-673f-41a5-bdba-862f51e0e4c2 tempest-VolumesListTestJSON-472358660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:00:53 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-6f367f62-673f-41a5-bdba-862f51e0e4c2 tempest-VolumesListTestJSON-472358660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:00:53 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-6f367f62-673f-41a5-bdba-862f51e0e4c2 tempest-VolumesListTestJSON-472358660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:00:53 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-6f367f62-673f-41a5-bdba-862f51e0e4c2 tempest-VolumesListTestJSON-472358660 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 16:00:53 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-6f367f62-673f-41a5-bdba-862f51e0e4c2 tempest-VolumesListTestJSON-472358660 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 16:00:53 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6f367f62-673f-41a5-bdba-862f51e0e4c2 tempest-VolumesListTestJSON-472358660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-eae3c40e-e8ed-4741-bc91-5897655a15ba 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:00:53 devstack sudo[100037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-eae3c40e-e8ed-4741-bc91-5897655a15ba 1073741824 Jul 10 16:00:53 devstack sudo[100037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:00:53 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-41d7f622-9efb-459c-a1ec-c59b9ba52fe8 tempest-TestStampPattern-1127543775 None] Acquiring lock "cinder-4ff68687-c9f5-4d47-a2bb-8312436fc4b7-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:00:53 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-41d7f622-9efb-459c-a1ec-c59b9ba52fe8 tempest-TestStampPattern-1127543775 None] Lock "cinder-4ff68687-c9f5-4d47-a2bb-8312436fc4b7-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:00:53 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-41d7f622-9efb-459c-a1ec-c59b9ba52fe8 tempest-TestStampPattern-1127543775 None] Acquiring lock "cinder-quobyte-4ff68687-c9f5-4d47-a2bb-8312436fc4b7" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:00:53 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-41d7f622-9efb-459c-a1ec-c59b9ba52fe8 tempest-TestStampPattern-1127543775 None] Lock "cinder-quobyte-4ff68687-c9f5-4d47-a2bb-8312436fc4b7" acquired by "delete_volume" :: waited 0.023s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:00:53 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bf47dae-ca45-4282-bcbd-28516ef8998e]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:00:53 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-41d7f622-9efb-459c-a1ec-c59b9ba52fe8 tempest-TestStampPattern-1127543775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4ff68687-c9f5-4d47-a2bb-8312436fc4b7 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:00:53 devstack sudo[100039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4ff68687-c9f5-4d47-a2bb-8312436fc4b7 Jul 10 16:00:53 devstack sudo[100039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:00:54 devstack sudo[100037]: pam_unix(sudo:session): session closed for user root Jul 10 16:00:54 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6f367f62-673f-41a5-bdba-862f51e0e4c2 tempest-VolumesListTestJSON-472358660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-eae3c40e-e8ed-4741-bc91-5897655a15ba 1073741824" returned: 0 in 0.994s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:00:54 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6f367f62-673f-41a5-bdba-862f51e0e4c2 tempest-VolumesListTestJSON-472358660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-eae3c40e-e8ed-4741-bc91-5897655a15ba {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:00:54 devstack sudo[100051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-eae3c40e-e8ed-4741-bc91-5897655a15ba Jul 10 16:00:54 devstack sudo[100051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:00:54 devstack sudo[100039]: pam_unix(sudo:session): session closed for user root Jul 10 16:00:54 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-41d7f622-9efb-459c-a1ec-c59b9ba52fe8 tempest-TestStampPattern-1127543775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4ff68687-c9f5-4d47-a2bb-8312436fc4b7" returned: 0 in 0.890s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:00:54 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-41d7f622-9efb-459c-a1ec-c59b9ba52fe8 tempest-TestStampPattern-1127543775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4ff68687-c9f5-4d47-a2bb-8312436fc4b7 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:00:54 devstack sudo[100065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4ff68687-c9f5-4d47-a2bb-8312436fc4b7 Jul 10 16:00:54 devstack sudo[100065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:00:54 devstack sudo[100051]: pam_unix(sudo:session): session closed for user root Jul 10 16:00:54 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6f367f62-673f-41a5-bdba-862f51e0e4c2 tempest-VolumesListTestJSON-472358660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-eae3c40e-e8ed-4741-bc91-5897655a15ba" returned: 0 in 0.750s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:00:54 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-6f367f62-673f-41a5-bdba-862f51e0e4c2 tempest-VolumesListTestJSON-472358660 None] <== create_volume: return (1795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 16:00:54 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-6f367f62-673f-41a5-bdba-862f51e0e4c2 tempest-VolumesListTestJSON-472358660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.797s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:00:54 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6f367f62-673f-41a5-bdba-862f51e0e4c2 tempest-VolumesListTestJSON-472358660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59395415-a407-441c-ae7f-43a5f96acbe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eae3c40e-e8ed-4741-bc91-5897655a15ba', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:00:54 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6f367f62-673f-41a5-bdba-862f51e0e4c2 tempest-VolumesListTestJSON-472358660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a720f24-83cf-4139-b1b5-931038ddb9cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:00:54 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-6f367f62-673f-41a5-bdba-862f51e0e4c2 tempest-VolumesListTestJSON-472358660 None] Volume volume-eae3c40e-e8ed-4741-bc91-5897655a15ba (eae3c40e-e8ed-4741-bc91-5897655a15ba): created successfully Jul 10 16:00:54 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6f367f62-673f-41a5-bdba-862f51e0e4c2 tempest-VolumesListTestJSON-472358660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a720f24-83cf-4139-b1b5-931038ddb9cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:00:54 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6f367f62-673f-41a5-bdba-862f51e0e4c2 tempest-VolumesListTestJSON-472358660 None] Flow 'volume_create_manager' (8d13a188-e6d7-4157-8478-3f931f1e6f78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:00:54 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-6f367f62-673f-41a5-bdba-862f51e0e4c2 tempest-VolumesListTestJSON-472358660 None] Created volume successfully. Jul 10 16:00:55 devstack sudo[100065]: pam_unix(sudo:session): session closed for user root Jul 10 16:00:55 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-41d7f622-9efb-459c-a1ec-c59b9ba52fe8 tempest-TestStampPattern-1127543775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4ff68687-c9f5-4d47-a2bb-8312436fc4b7" returned: 0 in 0.773s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:00:55 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-41d7f622-9efb-459c-a1ec-c59b9ba52fe8 tempest-TestStampPattern-1127543775 None] Lock "cinder-quobyte-4ff68687-c9f5-4d47-a2bb-8312436fc4b7" released by "delete_volume" :: held 1.741s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:00:55 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-41d7f622-9efb-459c-a1ec-c59b9ba52fe8 tempest-TestStampPattern-1127543775 None] Created reservations ['54eb3079-b342-49c5-b442-0c78533c0ed3', '52ccc350-b84e-4920-ac3d-50cf154d2d0d', '13c9e8ea-8f52-4356-a007-3c92ad0036e2', '8c9f9303-b159-449e-b94b-24f2ad79c115'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:00:55 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-41d7f622-9efb-459c-a1ec-c59b9ba52fe8 tempest-TestStampPattern-1127543775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:00:55 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-41d7f622-9efb-459c-a1ec-c59b9ba52fe8 tempest-TestStampPattern-1127543775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:00:55 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-41d7f622-9efb-459c-a1ec-c59b9ba52fe8 tempest-TestStampPattern-1127543775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:00:55 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-41d7f622-9efb-459c-a1ec-c59b9ba52fe8 tempest-TestStampPattern-1127543775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:00:55 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-41d7f622-9efb-459c-a1ec-c59b9ba52fe8 tempest-TestStampPattern-1127543775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:00:55 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-41d7f622-9efb-459c-a1ec-c59b9ba52fe8 tempest-TestStampPattern-1127543775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:00:55 devstack sudo[100071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:00:55 devstack sudo[100071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:00:56 devstack sudo[100071]: pam_unix(sudo:session): session closed for user root Jul 10 16:00:56 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-41d7f622-9efb-459c-a1ec-c59b9ba52fe8 tempest-TestStampPattern-1127543775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.808s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:00:56 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-41d7f622-9efb-459c-a1ec-c59b9ba52fe8 tempest-TestStampPattern-1127543775 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:00:56 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-41d7f622-9efb-459c-a1ec-c59b9ba52fe8 tempest-TestStampPattern-1127543775 None] Deleted volume successfully. Jul 10 16:00:56 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-41d7f622-9efb-459c-a1ec-c59b9ba52fe8 tempest-TestStampPattern-1127543775 None] Lock "cinder-4ff68687-c9f5-4d47-a2bb-8312436fc4b7-delete_volume" released by "delete_volume" :: held 2.793s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:00:57 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-4746864c-5414-4c59-b905-8f96b93f37f1 tempest-VolumesListTestJSON-472358660 None] Acquiring lock "cinder-eae3c40e-e8ed-4741-bc91-5897655a15ba-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:00:57 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-4746864c-5414-4c59-b905-8f96b93f37f1 tempest-VolumesListTestJSON-472358660 None] Lock "cinder-eae3c40e-e8ed-4741-bc91-5897655a15ba-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:00:57 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-4746864c-5414-4c59-b905-8f96b93f37f1 tempest-VolumesListTestJSON-472358660 None] Acquiring lock "cinder-quobyte-eae3c40e-e8ed-4741-bc91-5897655a15ba" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:00:57 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-4746864c-5414-4c59-b905-8f96b93f37f1 tempest-VolumesListTestJSON-472358660 None] Lock "cinder-quobyte-eae3c40e-e8ed-4741-bc91-5897655a15ba" acquired by "delete_volume" :: waited 0.016s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:00:57 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e365945-8acf-41fa-b3c9-a9fd615da561]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:00:57 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4746864c-5414-4c59-b905-8f96b93f37f1 tempest-VolumesListTestJSON-472358660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-eae3c40e-e8ed-4741-bc91-5897655a15ba {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:00:57 devstack sudo[100074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-eae3c40e-e8ed-4741-bc91-5897655a15ba Jul 10 16:00:57 devstack sudo[100074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:00:58 devstack sudo[100074]: pam_unix(sudo:session): session closed for user root Jul 10 16:00:58 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4746864c-5414-4c59-b905-8f96b93f37f1 tempest-VolumesListTestJSON-472358660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-eae3c40e-e8ed-4741-bc91-5897655a15ba" returned: 0 in 1.288s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:00:58 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4746864c-5414-4c59-b905-8f96b93f37f1 tempest-VolumesListTestJSON-472358660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-eae3c40e-e8ed-4741-bc91-5897655a15ba {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:00:58 devstack sudo[100127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-eae3c40e-e8ed-4741-bc91-5897655a15ba Jul 10 16:00:58 devstack sudo[100127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:00:59 devstack sudo[100127]: pam_unix(sudo:session): session closed for user root Jul 10 16:00:59 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4746864c-5414-4c59-b905-8f96b93f37f1 tempest-VolumesListTestJSON-472358660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-eae3c40e-e8ed-4741-bc91-5897655a15ba" returned: 0 in 0.773s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:00:59 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-4746864c-5414-4c59-b905-8f96b93f37f1 tempest-VolumesListTestJSON-472358660 None] Lock "cinder-quobyte-eae3c40e-e8ed-4741-bc91-5897655a15ba" released by "delete_volume" :: held 2.128s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:00:59 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-4746864c-5414-4c59-b905-8f96b93f37f1 tempest-VolumesListTestJSON-472358660 None] Created reservations ['307089a9-631e-4394-be39-8a17cdc26ebf', '0d0e0352-dbaa-4069-82e5-55254ea6b7f4', '5838b762-2fd0-4d7c-b047-7fbed058a32e', '2d914778-3c49-44d6-8638-4dbf10cf0ab4'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:00:59 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-4746864c-5414-4c59-b905-8f96b93f37f1 tempest-VolumesListTestJSON-472358660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:00:59 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-4746864c-5414-4c59-b905-8f96b93f37f1 tempest-VolumesListTestJSON-472358660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:00:59 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-4746864c-5414-4c59-b905-8f96b93f37f1 tempest-VolumesListTestJSON-472358660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:00:59 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-4746864c-5414-4c59-b905-8f96b93f37f1 tempest-VolumesListTestJSON-472358660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:00:59 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-4746864c-5414-4c59-b905-8f96b93f37f1 tempest-VolumesListTestJSON-472358660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:00:59 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4746864c-5414-4c59-b905-8f96b93f37f1 tempest-VolumesListTestJSON-472358660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:00:59 devstack sudo[100149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:00:59 devstack sudo[100149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:01:00 devstack sudo[100149]: pam_unix(sudo:session): session closed for user root Jul 10 16:01:00 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4746864c-5414-4c59-b905-8f96b93f37f1 tempest-VolumesListTestJSON-472358660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.774s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:01:00 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-4746864c-5414-4c59-b905-8f96b93f37f1 tempest-VolumesListTestJSON-472358660 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:01:00 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-4746864c-5414-4c59-b905-8f96b93f37f1 tempest-VolumesListTestJSON-472358660 None] Deleted volume successfully. Jul 10 16:01:00 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-4746864c-5414-4c59-b905-8f96b93f37f1 tempest-VolumesListTestJSON-472358660 None] Lock "cinder-eae3c40e-e8ed-4741-bc91-5897655a15ba-delete_volume" released by "delete_volume" :: held 3.195s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:01:00 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-ee8e9ea9-3601-4c97-98eb-daaa0f11d9d8 tempest-VolumesListTestJSON-472358660 None] Acquiring lock "cinder-a10e3eff-437e-4434-9fa1-e99ceda61d8c-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:01:00 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-ee8e9ea9-3601-4c97-98eb-daaa0f11d9d8 tempest-VolumesListTestJSON-472358660 None] Lock "cinder-a10e3eff-437e-4434-9fa1-e99ceda61d8c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:01:00 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-ee8e9ea9-3601-4c97-98eb-daaa0f11d9d8 tempest-VolumesListTestJSON-472358660 None] Acquiring lock "cinder-quobyte-a10e3eff-437e-4434-9fa1-e99ceda61d8c" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:01:00 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-ee8e9ea9-3601-4c97-98eb-daaa0f11d9d8 tempest-VolumesListTestJSON-472358660 None] Lock "cinder-quobyte-a10e3eff-437e-4434-9fa1-e99ceda61d8c" acquired by "delete_volume" :: waited 0.021s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:01:01 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b44aa10-5a80-4548-be15-c18e1e9b411c]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:01:01 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ee8e9ea9-3601-4c97-98eb-daaa0f11d9d8 tempest-VolumesListTestJSON-472358660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a10e3eff-437e-4434-9fa1-e99ceda61d8c {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:01:01 devstack sudo[100155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a10e3eff-437e-4434-9fa1-e99ceda61d8c Jul 10 16:01:01 devstack sudo[100155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:01:02 devstack sudo[100155]: pam_unix(sudo:session): session closed for user root Jul 10 16:01:02 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ee8e9ea9-3601-4c97-98eb-daaa0f11d9d8 tempest-VolumesListTestJSON-472358660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a10e3eff-437e-4434-9fa1-e99ceda61d8c" returned: 0 in 1.091s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:01:02 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ee8e9ea9-3601-4c97-98eb-daaa0f11d9d8 tempest-VolumesListTestJSON-472358660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a10e3eff-437e-4434-9fa1-e99ceda61d8c {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:01:02 devstack sudo[100160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a10e3eff-437e-4434-9fa1-e99ceda61d8c Jul 10 16:01:02 devstack sudo[100160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:01:02 devstack sudo[100160]: pam_unix(sudo:session): session closed for user root Jul 10 16:01:02 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ee8e9ea9-3601-4c97-98eb-daaa0f11d9d8 tempest-VolumesListTestJSON-472358660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a10e3eff-437e-4434-9fa1-e99ceda61d8c" returned: 0 in 0.849s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:01:02 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-ee8e9ea9-3601-4c97-98eb-daaa0f11d9d8 tempest-VolumesListTestJSON-472358660 None] Lock "cinder-quobyte-a10e3eff-437e-4434-9fa1-e99ceda61d8c" released by "delete_volume" :: held 1.995s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:01:03 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-ee8e9ea9-3601-4c97-98eb-daaa0f11d9d8 tempest-VolumesListTestJSON-472358660 None] Created reservations ['f7797673-8bec-4107-b913-7641ca0b191d', '72311a5c-9dd1-44ac-835b-1fc66f91a746', '16a39850-f60e-4942-b068-82ae1302f327', '7c4a6669-486a-40a1-bdae-83baa0973f6b'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:01:03 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-bdb68608-721c-45c1-bc66-5728ee0e3148 tempest-VolumesActionsTest-9461107 None] Acquiring lock "cinder-3ffbabb0-4ce4-42a6-a34e-0fd7970b58b6" by "attach_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:01:03 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-bdb68608-721c-45c1-bc66-5728ee0e3148 tempest-VolumesActionsTest-9461107 None] Lock "cinder-3ffbabb0-4ce4-42a6-a34e-0fd7970b58b6" acquired by "attach_volume" :: waited 0.058s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:01:03 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-ee8e9ea9-3601-4c97-98eb-daaa0f11d9d8 tempest-VolumesListTestJSON-472358660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:01:03 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-ee8e9ea9-3601-4c97-98eb-daaa0f11d9d8 tempest-VolumesListTestJSON-472358660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:01:03 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-ee8e9ea9-3601-4c97-98eb-daaa0f11d9d8 tempest-VolumesListTestJSON-472358660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:01:03 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-ee8e9ea9-3601-4c97-98eb-daaa0f11d9d8 tempest-VolumesListTestJSON-472358660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:01:03 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-ee8e9ea9-3601-4c97-98eb-daaa0f11d9d8 tempest-VolumesListTestJSON-472358660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:01:03 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ee8e9ea9-3601-4c97-98eb-daaa0f11d9d8 tempest-VolumesListTestJSON-472358660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:01:03 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-bdb68608-721c-45c1-bc66-5728ee0e3148 tempest-VolumesActionsTest-9461107 None] Attaching volume 3ffbabb0-4ce4-42a6-a34e-0fd7970b58b6 to instance 2cda9462-982c-422c-8afc-f4a46a04ce8a at mountpoint /dev/vdb on host None. Jul 10 16:01:03 devstack sudo[100165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:01:03 devstack sudo[100165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:01:03 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-bdb68608-721c-45c1-bc66-5728ee0e3148 tempest-VolumesActionsTest-9461107 None] Attach volume completed successfully. Jul 10 16:01:03 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-bdb68608-721c-45c1-bc66-5728ee0e3148 tempest-VolumesActionsTest-9461107 None] Lock "cinder-3ffbabb0-4ce4-42a6-a34e-0fd7970b58b6" released by "attach_volume" :: held 0.167s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:01:03 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-eba42413-ba39-4871-9b9f-fdcac5abf060 tempest-VolumesActionsTest-9461107 None] Acquiring lock "cinder-3ffbabb0-4ce4-42a6-a34e-0fd7970b58b6-detach_volume" by "detach_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:01:03 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-eba42413-ba39-4871-9b9f-fdcac5abf060 tempest-VolumesActionsTest-9461107 None] Lock "cinder-3ffbabb0-4ce4-42a6-a34e-0fd7970b58b6-detach_volume" acquired by "detach_volume" :: waited 0.023s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:01:03 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-eba42413-ba39-4871-9b9f-fdcac5abf060 tempest-VolumesActionsTest-9461107 None] Detaching volume 3ffbabb0-4ce4-42a6-a34e-0fd7970b58b6 from instance 2cda9462-982c-422c-8afc-f4a46a04ce8a. Jul 10 16:01:03 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-eba42413-ba39-4871-9b9f-fdcac5abf060 tempest-VolumesActionsTest-9461107 None] Detach volume completed successfully. Jul 10 16:01:03 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-eba42413-ba39-4871-9b9f-fdcac5abf060 tempest-VolumesActionsTest-9461107 None] Lock "cinder-3ffbabb0-4ce4-42a6-a34e-0fd7970b58b6-detach_volume" released by "detach_volume" :: held 0.081s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:01:04 devstack sudo[100165]: pam_unix(sudo:session): session closed for user root Jul 10 16:01:04 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ee8e9ea9-3601-4c97-98eb-daaa0f11d9d8 tempest-VolumesListTestJSON-472358660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.973s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:01:04 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-ee8e9ea9-3601-4c97-98eb-daaa0f11d9d8 tempest-VolumesListTestJSON-472358660 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:01:04 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-ee8e9ea9-3601-4c97-98eb-daaa0f11d9d8 tempest-VolumesListTestJSON-472358660 None] Deleted volume successfully. Jul 10 16:01:04 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-ee8e9ea9-3601-4c97-98eb-daaa0f11d9d8 tempest-VolumesListTestJSON-472358660 None] Lock "cinder-a10e3eff-437e-4434-9fa1-e99ceda61d8c-delete_volume" released by "delete_volume" :: held 3.318s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:01:04 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-be83d263-863d-4376-8bea-de2e5854e186 tempest-VolumesListTestJSON-472358660 None] Acquiring lock "cinder-7d914361-aad4-4da6-af8a-a673f7bb58f4-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:01:04 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-be83d263-863d-4376-8bea-de2e5854e186 tempest-VolumesListTestJSON-472358660 None] Lock "cinder-7d914361-aad4-4da6-af8a-a673f7bb58f4-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:01:04 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-be83d263-863d-4376-8bea-de2e5854e186 tempest-VolumesListTestJSON-472358660 None] Acquiring lock "cinder-quobyte-7d914361-aad4-4da6-af8a-a673f7bb58f4" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:01:04 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-be83d263-863d-4376-8bea-de2e5854e186 tempest-VolumesListTestJSON-472358660 None] Lock "cinder-quobyte-7d914361-aad4-4da6-af8a-a673f7bb58f4" acquired by "delete_volume" :: waited 0.020s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:01:04 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc4a0733-4d3a-47d9-90cb-ae133f272af6]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:01:04 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-be83d263-863d-4376-8bea-de2e5854e186 tempest-VolumesListTestJSON-472358660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7d914361-aad4-4da6-af8a-a673f7bb58f4 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:01:04 devstack sudo[100168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7d914361-aad4-4da6-af8a-a673f7bb58f4 Jul 10 16:01:04 devstack sudo[100168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:01:05 devstack sudo[100168]: pam_unix(sudo:session): session closed for user root Jul 10 16:01:05 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-be83d263-863d-4376-8bea-de2e5854e186 tempest-VolumesListTestJSON-472358660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7d914361-aad4-4da6-af8a-a673f7bb58f4" returned: 0 in 1.025s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:01:05 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-be83d263-863d-4376-8bea-de2e5854e186 tempest-VolumesListTestJSON-472358660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7d914361-aad4-4da6-af8a-a673f7bb58f4 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:01:05 devstack sudo[100174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7d914361-aad4-4da6-af8a-a673f7bb58f4 Jul 10 16:01:05 devstack sudo[100174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:01:06 devstack sudo[100174]: pam_unix(sudo:session): session closed for user root Jul 10 16:01:06 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-be83d263-863d-4376-8bea-de2e5854e186 tempest-VolumesListTestJSON-472358660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7d914361-aad4-4da6-af8a-a673f7bb58f4" returned: 0 in 0.744s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:01:06 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-be83d263-863d-4376-8bea-de2e5854e186 tempest-VolumesListTestJSON-472358660 None] Lock "cinder-quobyte-7d914361-aad4-4da6-af8a-a673f7bb58f4" released by "delete_volume" :: held 1.840s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:01:06 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-be83d263-863d-4376-8bea-de2e5854e186 tempest-VolumesListTestJSON-472358660 None] Created reservations ['c8ed95b3-4157-4be2-b55d-d4050f4dfc5c', '567b5213-1118-44e3-b634-c07ac02a2fa5', 'c4bd6c93-84c9-4317-b330-455029280686', '4de68477-303b-4379-9654-6431710f676c'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:01:06 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-be83d263-863d-4376-8bea-de2e5854e186 tempest-VolumesListTestJSON-472358660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:01:06 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-be83d263-863d-4376-8bea-de2e5854e186 tempest-VolumesListTestJSON-472358660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:01:06 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-be83d263-863d-4376-8bea-de2e5854e186 tempest-VolumesListTestJSON-472358660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:01:06 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-be83d263-863d-4376-8bea-de2e5854e186 tempest-VolumesListTestJSON-472358660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:01:06 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-be83d263-863d-4376-8bea-de2e5854e186 tempest-VolumesListTestJSON-472358660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:01:06 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-be83d263-863d-4376-8bea-de2e5854e186 tempest-VolumesListTestJSON-472358660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:01:06 devstack sudo[100187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:01:06 devstack sudo[100187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:01:07 devstack sudo[100187]: pam_unix(sudo:session): session closed for user root Jul 10 16:01:07 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-be83d263-863d-4376-8bea-de2e5854e186 tempest-VolumesListTestJSON-472358660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.874s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:01:07 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-be83d263-863d-4376-8bea-de2e5854e186 tempest-VolumesListTestJSON-472358660 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:01:07 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-be83d263-863d-4376-8bea-de2e5854e186 tempest-VolumesListTestJSON-472358660 None] Deleted volume successfully. Jul 10 16:01:07 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-be83d263-863d-4376-8bea-de2e5854e186 tempest-VolumesListTestJSON-472358660 None] Lock "cinder-7d914361-aad4-4da6-af8a-a673f7bb58f4-delete_volume" released by "delete_volume" :: held 2.962s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:01:09 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e2804e0-d0df-4363-a2b6-c0a823f3911e tempest-VolumeDependencyTests-1953610052 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 16:01:09 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-7e2804e0-d0df-4363-a2b6-c0a823f3911e tempest-VolumeDependencyTests-1953610052 None] Flow 'volume_create_manager' (e92c2f8e-933b-4852-8c27-69e5ae7b6a1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:01:09 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-7e2804e0-d0df-4363-a2b6-c0a823f3911e tempest-VolumeDependencyTests-1953610052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e0150e7-e858-4d1b-aed9-65ab3d2a5f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:01:09 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-7e2804e0-d0df-4363-a2b6-c0a823f3911e tempest-VolumeDependencyTests-1953610052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e0150e7-e858-4d1b-aed9-65ab3d2a5f82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:01:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-368018527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d073b26e-28c5-4864-85c6-c3419a19426b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04ae81aa08bc4ad2b44cb7434fd50afb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:01:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:01:09Z,use_quota=True,user_id='4f557b08067046a78212ad5a9126f96c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:01:09 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-7e2804e0-d0df-4363-a2b6-c0a823f3911e tempest-VolumeDependencyTests-1953610052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a0fe373-a486-442b-ad85-55d7d5d43496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:01:09 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-7e2804e0-d0df-4363-a2b6-c0a823f3911e tempest-VolumeDependencyTests-1953610052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a0fe373-a486-442b-ad85-55d7d5d43496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:01:09 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-7e2804e0-d0df-4363-a2b6-c0a823f3911e tempest-VolumeDependencyTests-1953610052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (801019e7-48f8-4b02-b2ae-9480e8e4d715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:01:09 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-7e2804e0-d0df-4363-a2b6-c0a823f3911e tempest-VolumeDependencyTests-1953610052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (801019e7-48f8-4b02-b2ae-9480e8e4d715) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd073b26e-28c5-4864-85c6-c3419a19426b', 'volume_name': 'volume-d073b26e-28c5-4864-85c6-c3419a19426b', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:01:09 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-7e2804e0-d0df-4363-a2b6-c0a823f3911e tempest-VolumeDependencyTests-1953610052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7731af0-49da-4f25-959e-2af03017e3f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:01:09 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-7e2804e0-d0df-4363-a2b6-c0a823f3911e tempest-VolumeDependencyTests-1953610052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7731af0-49da-4f25-959e-2af03017e3f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:01:09 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-7e2804e0-d0df-4363-a2b6-c0a823f3911e tempest-VolumeDependencyTests-1953610052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb77f281-b07d-46ac-923a-475d88c2b38d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:01:09 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-7e2804e0-d0df-4363-a2b6-c0a823f3911e tempest-VolumeDependencyTests-1953610052 None] Volume d073b26e-28c5-4864-85c6-c3419a19426b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d073b26e-28c5-4864-85c6-c3419a19426b', 'volume_size': 1} Jul 10 16:01:09 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-7e2804e0-d0df-4363-a2b6-c0a823f3911e tempest-VolumeDependencyTests-1953610052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:01:09 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-7e2804e0-d0df-4363-a2b6-c0a823f3911e tempest-VolumeDependencyTests-1953610052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:01:09 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-7e2804e0-d0df-4363-a2b6-c0a823f3911e tempest-VolumeDependencyTests-1953610052 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:01:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-368018527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d073b26e-28c5-4864-85c6-c3419a19426b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04ae81aa08bc4ad2b44cb7434fd50afb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:01:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:01:09Z,use_quota=True,user_id='4f557b08067046a78212ad5a9126f96c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 16:01:09 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-7e2804e0-d0df-4363-a2b6-c0a823f3911e tempest-VolumeDependencyTests-1953610052 None] Creating volume d073b26e-28c5-4864-85c6-c3419a19426b {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 16:01:09 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-7e2804e0-d0df-4363-a2b6-c0a823f3911e tempest-VolumeDependencyTests-1953610052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:01:09 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-7e2804e0-d0df-4363-a2b6-c0a823f3911e tempest-VolumeDependencyTests-1953610052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:01:09 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-7e2804e0-d0df-4363-a2b6-c0a823f3911e tempest-VolumeDependencyTests-1953610052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:01:09 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-7e2804e0-d0df-4363-a2b6-c0a823f3911e tempest-VolumeDependencyTests-1953610052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:01:09 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-7e2804e0-d0df-4363-a2b6-c0a823f3911e tempest-VolumeDependencyTests-1953610052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:01:09 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-7e2804e0-d0df-4363-a2b6-c0a823f3911e tempest-VolumeDependencyTests-1953610052 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 16:01:09 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-7e2804e0-d0df-4363-a2b6-c0a823f3911e tempest-VolumeDependencyTests-1953610052 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 16:01:09 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-7e2804e0-d0df-4363-a2b6-c0a823f3911e tempest-VolumeDependencyTests-1953610052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d073b26e-28c5-4864-85c6-c3419a19426b 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:01:09 devstack sudo[100203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d073b26e-28c5-4864-85c6-c3419a19426b 1073741824 Jul 10 16:01:09 devstack sudo[100203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:01:10 devstack sudo[100203]: pam_unix(sudo:session): session closed for user root Jul 10 16:01:10 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-7e2804e0-d0df-4363-a2b6-c0a823f3911e tempest-VolumeDependencyTests-1953610052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d073b26e-28c5-4864-85c6-c3419a19426b 1073741824" returned: 0 in 0.877s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:01:10 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-7e2804e0-d0df-4363-a2b6-c0a823f3911e tempest-VolumeDependencyTests-1953610052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d073b26e-28c5-4864-85c6-c3419a19426b {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:01:10 devstack sudo[100211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d073b26e-28c5-4864-85c6-c3419a19426b Jul 10 16:01:10 devstack sudo[100211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:01:10 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d20955b-95ed-4de5-9f9a-2e09cd54f2d5 tempest-VolumesNegativeTest-603605191 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 16:01:10 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-4d20955b-95ed-4de5-9f9a-2e09cd54f2d5 tempest-VolumesNegativeTest-603605191 None] Flow 'volume_create_manager' (9ec62b03-ec77-449f-b582-a40d93f15656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:01:10 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-4d20955b-95ed-4de5-9f9a-2e09cd54f2d5 tempest-VolumesNegativeTest-603605191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (826238cc-950b-422e-a03a-ff877d1f15c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:01:10 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-4d20955b-95ed-4de5-9f9a-2e09cd54f2d5 tempest-VolumesNegativeTest-603605191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (826238cc-950b-422e-a03a-ff877d1f15c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:01:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-33723122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5076d7f-901d-45bd-8518-73794ca684db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44502e6fd4574ec6a7ffb368dc8196da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:01:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:01:10Z,use_quota=True,user_id='f067a08699f74e919d15a253fee9dd9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:01:10 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-4d20955b-95ed-4de5-9f9a-2e09cd54f2d5 tempest-VolumesNegativeTest-603605191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f01f0aba-e8bf-420f-b741-4e3aba4532c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:01:10 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-4d20955b-95ed-4de5-9f9a-2e09cd54f2d5 tempest-VolumesNegativeTest-603605191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f01f0aba-e8bf-420f-b741-4e3aba4532c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:01:10 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-4d20955b-95ed-4de5-9f9a-2e09cd54f2d5 tempest-VolumesNegativeTest-603605191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11ce0429-845b-4513-b94f-a2b28623070b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:01:10 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-4d20955b-95ed-4de5-9f9a-2e09cd54f2d5 tempest-VolumesNegativeTest-603605191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11ce0429-845b-4513-b94f-a2b28623070b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5076d7f-901d-45bd-8518-73794ca684db', 'volume_name': 'volume-a5076d7f-901d-45bd-8518-73794ca684db', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:01:10 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-4d20955b-95ed-4de5-9f9a-2e09cd54f2d5 tempest-VolumesNegativeTest-603605191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa857f20-a863-41bd-8306-ac9af5996eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:01:10 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-4d20955b-95ed-4de5-9f9a-2e09cd54f2d5 tempest-VolumesNegativeTest-603605191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa857f20-a863-41bd-8306-ac9af5996eb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:01:10 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-4d20955b-95ed-4de5-9f9a-2e09cd54f2d5 tempest-VolumesNegativeTest-603605191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8273d68d-eb41-4d17-833a-3cf5e12801e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:01:10 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-4d20955b-95ed-4de5-9f9a-2e09cd54f2d5 tempest-VolumesNegativeTest-603605191 None] Volume a5076d7f-901d-45bd-8518-73794ca684db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5076d7f-901d-45bd-8518-73794ca684db', 'volume_size': 1} Jul 10 16:01:10 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-4d20955b-95ed-4de5-9f9a-2e09cd54f2d5 tempest-VolumesNegativeTest-603605191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:01:10 devstack sudo[100211]: pam_unix(sudo:session): session closed for user root Jul 10 16:01:10 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-7e2804e0-d0df-4363-a2b6-c0a823f3911e tempest-VolumeDependencyTests-1953610052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d073b26e-28c5-4864-85c6-c3419a19426b" returned: 0 in 0.690s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:01:10 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-7e2804e0-d0df-4363-a2b6-c0a823f3911e tempest-VolumeDependencyTests-1953610052 None] <== create_volume: return (1623ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 16:01:10 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-7e2804e0-d0df-4363-a2b6-c0a823f3911e tempest-VolumeDependencyTests-1953610052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.626s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:01:10 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-4d20955b-95ed-4de5-9f9a-2e09cd54f2d5 tempest-VolumesNegativeTest-603605191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.491s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:01:10 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-4d20955b-95ed-4de5-9f9a-2e09cd54f2d5 tempest-VolumesNegativeTest-603605191 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:01:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-33723122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5076d7f-901d-45bd-8518-73794ca684db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44502e6fd4574ec6a7ffb368dc8196da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:01:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:01:10Z,use_quota=True,user_id='f067a08699f74e919d15a253fee9dd9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 16:01:10 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-4d20955b-95ed-4de5-9f9a-2e09cd54f2d5 tempest-VolumesNegativeTest-603605191 None] Creating volume a5076d7f-901d-45bd-8518-73794ca684db {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 16:01:10 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-4d20955b-95ed-4de5-9f9a-2e09cd54f2d5 tempest-VolumesNegativeTest-603605191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:01:10 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-4d20955b-95ed-4de5-9f9a-2e09cd54f2d5 tempest-VolumesNegativeTest-603605191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:01:10 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-4d20955b-95ed-4de5-9f9a-2e09cd54f2d5 tempest-VolumesNegativeTest-603605191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:01:10 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-4d20955b-95ed-4de5-9f9a-2e09cd54f2d5 tempest-VolumesNegativeTest-603605191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:01:10 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-4d20955b-95ed-4de5-9f9a-2e09cd54f2d5 tempest-VolumesNegativeTest-603605191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:01:10 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-4d20955b-95ed-4de5-9f9a-2e09cd54f2d5 tempest-VolumesNegativeTest-603605191 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 16:01:10 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-4d20955b-95ed-4de5-9f9a-2e09cd54f2d5 tempest-VolumesNegativeTest-603605191 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 16:01:10 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4d20955b-95ed-4de5-9f9a-2e09cd54f2d5 tempest-VolumesNegativeTest-603605191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a5076d7f-901d-45bd-8518-73794ca684db 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:01:10 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-7e2804e0-d0df-4363-a2b6-c0a823f3911e tempest-VolumeDependencyTests-1953610052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb77f281-b07d-46ac-923a-475d88c2b38d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d073b26e-28c5-4864-85c6-c3419a19426b', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:01:10 devstack sudo[100214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a5076d7f-901d-45bd-8518-73794ca684db 1073741824 Jul 10 16:01:10 devstack sudo[100214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:01:10 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-7e2804e0-d0df-4363-a2b6-c0a823f3911e tempest-VolumeDependencyTests-1953610052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33f1d059-78c5-4a77-ae96-014e57f1d0e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:01:11 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-7e2804e0-d0df-4363-a2b6-c0a823f3911e tempest-VolumeDependencyTests-1953610052 None] Volume volume-d073b26e-28c5-4864-85c6-c3419a19426b (d073b26e-28c5-4864-85c6-c3419a19426b): created successfully Jul 10 16:01:11 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-7e2804e0-d0df-4363-a2b6-c0a823f3911e tempest-VolumeDependencyTests-1953610052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33f1d059-78c5-4a77-ae96-014e57f1d0e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:01:11 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-7e2804e0-d0df-4363-a2b6-c0a823f3911e tempest-VolumeDependencyTests-1953610052 None] Flow 'volume_create_manager' (e92c2f8e-933b-4852-8c27-69e5ae7b6a1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:01:11 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-7e2804e0-d0df-4363-a2b6-c0a823f3911e tempest-VolumeDependencyTests-1953610052 None] Created volume successfully. Jul 10 16:01:11 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-2d87eb14-9821-471b-886c-a38debfaaabc tempest-VolumeDependencyTests-1953610052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:01:11 devstack sudo[100214]: pam_unix(sudo:session): session closed for user root Jul 10 16:01:11 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4d20955b-95ed-4de5-9f9a-2e09cd54f2d5 tempest-VolumesNegativeTest-603605191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a5076d7f-901d-45bd-8518-73794ca684db 1073741824" returned: 0 in 0.949s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:01:11 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4d20955b-95ed-4de5-9f9a-2e09cd54f2d5 tempest-VolumesNegativeTest-603605191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a5076d7f-901d-45bd-8518-73794ca684db {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:01:11 devstack sudo[100220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a5076d7f-901d-45bd-8518-73794ca684db Jul 10 16:01:11 devstack sudo[100220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:01:12 devstack sudo[100220]: pam_unix(sudo:session): session closed for user root Jul 10 16:01:12 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4d20955b-95ed-4de5-9f9a-2e09cd54f2d5 tempest-VolumesNegativeTest-603605191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a5076d7f-901d-45bd-8518-73794ca684db" returned: 0 in 0.665s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:01:12 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-4d20955b-95ed-4de5-9f9a-2e09cd54f2d5 tempest-VolumesNegativeTest-603605191 None] <== create_volume: return (1661ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 16:01:12 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-4d20955b-95ed-4de5-9f9a-2e09cd54f2d5 tempest-VolumesNegativeTest-603605191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.664s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:01:12 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-2d87eb14-9821-471b-886c-a38debfaaabc tempest-VolumeDependencyTests-1953610052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.026s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:01:12 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-2d87eb14-9821-471b-886c-a38debfaaabc tempest-VolumeDependencyTests-1953610052 None] Creating offline snapshot 28cb86fa-b673-4ad4-a099-480fb230f4ac of volume d073b26e-28c5-4864-85c6-c3419a19426b {{(pid=87420) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 16:01:12 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-4d20955b-95ed-4de5-9f9a-2e09cd54f2d5 tempest-VolumesNegativeTest-603605191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8273d68d-eb41-4d17-833a-3cf5e12801e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5076d7f-901d-45bd-8518-73794ca684db', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:01:12 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-4d20955b-95ed-4de5-9f9a-2e09cd54f2d5 tempest-VolumesNegativeTest-603605191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ffb1b93-681e-4be5-9321-32662ec6f1f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:01:12 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1da76d8-b33e-4c99-b686-79ae8979f125]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:01:12 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-2d87eb14-9821-471b-886c-a38debfaaabc tempest-VolumeDependencyTests-1953610052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d073b26e-28c5-4864-85c6-c3419a19426b {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:01:12 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-4d20955b-95ed-4de5-9f9a-2e09cd54f2d5 tempest-VolumesNegativeTest-603605191 None] Volume volume-a5076d7f-901d-45bd-8518-73794ca684db (a5076d7f-901d-45bd-8518-73794ca684db): created successfully Jul 10 16:01:12 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-4d20955b-95ed-4de5-9f9a-2e09cd54f2d5 tempest-VolumesNegativeTest-603605191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ffb1b93-681e-4be5-9321-32662ec6f1f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:01:12 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-4d20955b-95ed-4de5-9f9a-2e09cd54f2d5 tempest-VolumesNegativeTest-603605191 None] Flow 'volume_create_manager' (9ec62b03-ec77-449f-b582-a40d93f15656) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:01:12 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-4d20955b-95ed-4de5-9f9a-2e09cd54f2d5 tempest-VolumesNegativeTest-603605191 None] Created volume successfully. Jul 10 16:01:12 devstack sudo[100223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d073b26e-28c5-4864-85c6-c3419a19426b Jul 10 16:01:12 devstack sudo[100223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:01:13 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-370b0552-d973-4a70-9753-1121eecf4487 tempest-VolumesActionsTest-9461107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:01:13 devstack sudo[100223]: pam_unix(sudo:session): session closed for user root Jul 10 16:01:13 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-2d87eb14-9821-471b-886c-a38debfaaabc tempest-VolumeDependencyTests-1953610052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d073b26e-28c5-4864-85c6-c3419a19426b" returned: 0 in 0.778s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:01:13 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-2d87eb14-9821-471b-886c-a38debfaaabc tempest-VolumeDependencyTests-1953610052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d073b26e-28c5-4864-85c6-c3419a19426b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d073b26e-28c5-4864-85c6-c3419a19426b.28cb86fa-b673-4ad4-a099-480fb230f4ac 1G {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:01:13 devstack sudo[100229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d073b26e-28c5-4864-85c6-c3419a19426b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d073b26e-28c5-4864-85c6-c3419a19426b.28cb86fa-b673-4ad4-a099-480fb230f4ac 1G Jul 10 16:01:13 devstack sudo[100229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:01:14 devstack sudo[100229]: pam_unix(sudo:session): session closed for user root Jul 10 16:01:14 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-2d87eb14-9821-471b-886c-a38debfaaabc tempest-VolumeDependencyTests-1953610052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d073b26e-28c5-4864-85c6-c3419a19426b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d073b26e-28c5-4864-85c6-c3419a19426b.28cb86fa-b673-4ad4-a099-480fb230f4ac 1G" returned: 0 in 0.846s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:01:14 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-2d87eb14-9821-471b-886c-a38debfaaabc tempest-VolumeDependencyTests-1953610052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d073b26e-28c5-4864-85c6-c3419a19426b -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d073b26e-28c5-4864-85c6-c3419a19426b.28cb86fa-b673-4ad4-a099-480fb230f4ac {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:01:14 devstack sudo[100239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d073b26e-28c5-4864-85c6-c3419a19426b -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d073b26e-28c5-4864-85c6-c3419a19426b.28cb86fa-b673-4ad4-a099-480fb230f4ac Jul 10 16:01:14 devstack sudo[100239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:01:14 devstack sudo[100239]: pam_unix(sudo:session): session closed for user root Jul 10 16:01:14 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-2d87eb14-9821-471b-886c-a38debfaaabc tempest-VolumeDependencyTests-1953610052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d073b26e-28c5-4864-85c6-c3419a19426b -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d073b26e-28c5-4864-85c6-c3419a19426b.28cb86fa-b673-4ad4-a099-480fb230f4ac" returned: 0 in 0.714s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:01:14 devstack cinder-volume[87420]: WARNING cinder.volume.drivers.remotefs [None req-2d87eb14-9821-471b-886c-a38debfaaabc tempest-VolumeDependencyTests-1953610052 None] /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d073b26e-28c5-4864-85c6-c3419a19426b.28cb86fa-b673-4ad4-a099-480fb230f4ac is being set with open permissions: ugo+rw Jul 10 16:01:14 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-2d87eb14-9821-471b-886c-a38debfaaabc tempest-VolumeDependencyTests-1953610052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d073b26e-28c5-4864-85c6-c3419a19426b.28cb86fa-b673-4ad4-a099-480fb230f4ac {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:01:15 devstack sudo[100246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d073b26e-28c5-4864-85c6-c3419a19426b.28cb86fa-b673-4ad4-a099-480fb230f4ac Jul 10 16:01:15 devstack sudo[100246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:01:15 devstack sudo[100246]: pam_unix(sudo:session): session closed for user root Jul 10 16:01:15 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-2d87eb14-9821-471b-886c-a38debfaaabc tempest-VolumeDependencyTests-1953610052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d073b26e-28c5-4864-85c6-c3419a19426b.28cb86fa-b673-4ad4-a099-480fb230f4ac" returned: 0 in 0.639s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:01:15 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-2d87eb14-9821-471b-886c-a38debfaaabc tempest-VolumeDependencyTests-1953610052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d073b26e-28c5-4864-85c6-c3419a19426b.info {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:01:15 devstack sudo[100249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d073b26e-28c5-4864-85c6-c3419a19426b.info Jul 10 16:01:15 devstack sudo[100249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:01:16 devstack sudo[100249]: pam_unix(sudo:session): session closed for user root Jul 10 16:01:16 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-2d87eb14-9821-471b-886c-a38debfaaabc tempest-VolumeDependencyTests-1953610052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d073b26e-28c5-4864-85c6-c3419a19426b.info" returned: 0 in 0.664s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:01:16 devstack cinder-volume[87420]: WARNING cinder.volume.drivers.remotefs [None req-2d87eb14-9821-471b-886c-a38debfaaabc tempest-VolumeDependencyTests-1953610052 None] /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d073b26e-28c5-4864-85c6-c3419a19426b.info is being set with open permissions: ugo+rw Jul 10 16:01:16 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-2d87eb14-9821-471b-886c-a38debfaaabc tempest-VolumeDependencyTests-1953610052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d073b26e-28c5-4864-85c6-c3419a19426b.info {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:01:16 devstack sudo[100252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d073b26e-28c5-4864-85c6-c3419a19426b.info Jul 10 16:01:16 devstack sudo[100252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:01:17 devstack sudo[100252]: pam_unix(sudo:session): session closed for user root Jul 10 16:01:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-2d87eb14-9821-471b-886c-a38debfaaabc tempest-VolumeDependencyTests-1953610052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d073b26e-28c5-4864-85c6-c3419a19426b.info" returned: 0 in 0.662s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:01:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-2d87eb14-9821-471b-886c-a38debfaaabc tempest-VolumeDependencyTests-1953610052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.453s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:01:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-370b0552-d973-4a70-9753-1121eecf4487 tempest-VolumesActionsTest-9461107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 3.871s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:01:17 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[566e7370-f15d-405e-9ae9-fa99ff0394a7]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:01:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-370b0552-d973-4a70-9753-1121eecf4487 tempest-VolumesActionsTest-9461107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3ffbabb0-4ce4-42a6-a34e-0fd7970b58b6 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:01:17 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-2d87eb14-9821-471b-886c-a38debfaaabc tempest-VolumeDependencyTests-1953610052 None] Create snapshot completed successfully Jul 10 16:01:17 devstack sudo[100255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3ffbabb0-4ce4-42a6-a34e-0fd7970b58b6 Jul 10 16:01:17 devstack sudo[100255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:01:17 devstack cinder-volume[87420]: DEBUG oslo_service.periodic_task [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87420) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 16:01:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:01:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:01:17 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:01:17 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:01:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:01:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:01:17 devstack sudo[100257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:01:17 devstack sudo[100257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:01:17 devstack sudo[100255]: pam_unix(sudo:session): session closed for user root Jul 10 16:01:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-370b0552-d973-4a70-9753-1121eecf4487 tempest-VolumesActionsTest-9461107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3ffbabb0-4ce4-42a6-a34e-0fd7970b58b6" returned: 0 in 0.797s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:01:17 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ebc7937-141e-4a0b-a454-06e4032a9961]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:01:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-370b0552-d973-4a70-9753-1121eecf4487 tempest-VolumesActionsTest-9461107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3ffbabb0-4ce4-42a6-a34e-0fd7970b58b6 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:01:18 devstack sudo[100262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3ffbabb0-4ce4-42a6-a34e-0fd7970b58b6 Jul 10 16:01:18 devstack sudo[100262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:01:18 devstack sudo[100257]: pam_unix(sudo:session): session closed for user root Jul 10 16:01:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.705s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:01:18 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:01:18 devstack cinder-volume[87420]: DEBUG oslo_service.periodic_task [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Running periodic task VolumeManager._thread_info {{(pid=87420) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 16:01:18 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] thread count: 29 {{(pid=87420) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 16:01:18 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] thread info: [<_MainThread(MainThread, started 133639250378880)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87420) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 16:01:18 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d42a8db-aa54-4ad8-b0b6-d88f8e57fdd7 tempest-VolumeDependencyTests-1953610052 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 16:01:18 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-4d42a8db-aa54-4ad8-b0b6-d88f8e57fdd7 tempest-VolumeDependencyTests-1953610052 None] Flow 'volume_create_manager' (02d63ec9-e2fb-4454-96b5-0e28e7953063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:01:18 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-4d42a8db-aa54-4ad8-b0b6-d88f8e57fdd7 tempest-VolumeDependencyTests-1953610052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d00e2d8-9ba1-47b0-872d-f832a8e2e8cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:01:18 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-4d42a8db-aa54-4ad8-b0b6-d88f8e57fdd7 tempest-VolumeDependencyTests-1953610052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d00e2d8-9ba1-47b0-872d-f832a8e2e8cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:01:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-489725946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8520c293-d0a8-4bda-a7f4-4c7e75f8bd36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04ae81aa08bc4ad2b44cb7434fd50afb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:01:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=28cb86fa-b673-4ad4-a099-480fb230f4ac,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:01:18Z,use_quota=True,user_id='4f557b08067046a78212ad5a9126f96c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:01:18 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-4d42a8db-aa54-4ad8-b0b6-d88f8e57fdd7 tempest-VolumeDependencyTests-1953610052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (375f338a-ac92-463a-a6e9-74a334102db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:01:18 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-4d42a8db-aa54-4ad8-b0b6-d88f8e57fdd7 tempest-VolumeDependencyTests-1953610052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (375f338a-ac92-463a-a6e9-74a334102db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:01:18 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-4d42a8db-aa54-4ad8-b0b6-d88f8e57fdd7 tempest-VolumeDependencyTests-1953610052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48c46cfc-3574-4339-b4db-0f023945d8f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:01:18 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-4d42a8db-aa54-4ad8-b0b6-d88f8e57fdd7 tempest-VolumeDependencyTests-1953610052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48c46cfc-3574-4339-b4db-0f023945d8f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8520c293-d0a8-4bda-a7f4-4c7e75f8bd36', 'volume_name': 'volume-8520c293-d0a8-4bda-a7f4-4c7e75f8bd36', 'volume_size': 1, 'snapshot_id': '28cb86fa-b673-4ad4-a099-480fb230f4ac'}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:01:18 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-4d42a8db-aa54-4ad8-b0b6-d88f8e57fdd7 tempest-VolumeDependencyTests-1953610052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4f1d999-a818-4c45-a311-952bea6d8f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:01:18 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-4d42a8db-aa54-4ad8-b0b6-d88f8e57fdd7 tempest-VolumeDependencyTests-1953610052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4f1d999-a818-4c45-a311-952bea6d8f3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:01:18 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-4d42a8db-aa54-4ad8-b0b6-d88f8e57fdd7 tempest-VolumeDependencyTests-1953610052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc2d0c38-d80c-4e45-9c86-8d53133b2853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:01:18 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-4d42a8db-aa54-4ad8-b0b6-d88f8e57fdd7 tempest-VolumeDependencyTests-1953610052 None] Volume 8520c293-d0a8-4bda-a7f4-4c7e75f8bd36: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8520c293-d0a8-4bda-a7f4-4c7e75f8bd36', 'volume_size': 1, 'snapshot_id': '28cb86fa-b673-4ad4-a099-480fb230f4ac'} Jul 10 16:01:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-4d42a8db-aa54-4ad8-b0b6-d88f8e57fdd7 tempest-VolumeDependencyTests-1953610052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:01:18 devstack sudo[100262]: pam_unix(sudo:session): session closed for user root Jul 10 16:01:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-370b0552-d973-4a70-9753-1121eecf4487 tempest-VolumesActionsTest-9461107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3ffbabb0-4ce4-42a6-a34e-0fd7970b58b6" returned: 0 in 0.857s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:01:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-370b0552-d973-4a70-9753-1121eecf4487 tempest-VolumesActionsTest-9461107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3ffbabb0-4ce4-42a6-a34e-0fd7970b58b6 /opt/stack/data/cinder/conversion/3ffbabb0-4ce4-42a6-a34e-0fd7970b58b6.temp_image.deb1952d-a38b-4626-b36b-bde8f8b367d7f2u9p56u.img {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:01:18 devstack sudo[100268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3ffbabb0-4ce4-42a6-a34e-0fd7970b58b6 /opt/stack/data/cinder/conversion/3ffbabb0-4ce4-42a6-a34e-0fd7970b58b6.temp_image.deb1952d-a38b-4626-b36b-bde8f8b367d7f2u9p56u.img Jul 10 16:01:18 devstack sudo[100268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:01:24 devstack sudo[100268]: pam_unix(sudo:session): session closed for user root Jul 10 16:01:24 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-370b0552-d973-4a70-9753-1121eecf4487 tempest-VolumesActionsTest-9461107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3ffbabb0-4ce4-42a6-a34e-0fd7970b58b6 /opt/stack/data/cinder/conversion/3ffbabb0-4ce4-42a6-a34e-0fd7970b58b6.temp_image.deb1952d-a38b-4626-b36b-bde8f8b367d7f2u9p56u.img" returned: 0 in 5.537s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:01:24 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[49c35b97-437c-46dc-a38c-a06f8a9446fd]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:01:24 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-370b0552-d973-4a70-9753-1121eecf4487 tempest-VolumesActionsTest-9461107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3ffbabb0-4ce4-42a6-a34e-0fd7970b58b6 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:01:24 devstack sudo[100300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3ffbabb0-4ce4-42a6-a34e-0fd7970b58b6 Jul 10 16:01:24 devstack sudo[100300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:01:25 devstack sudo[100300]: pam_unix(sudo:session): session closed for user root Jul 10 16:01:25 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-370b0552-d973-4a70-9753-1121eecf4487 tempest-VolumesActionsTest-9461107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3ffbabb0-4ce4-42a6-a34e-0fd7970b58b6" returned: 0 in 0.969s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:01:25 devstack cinder-volume[87420]: DEBUG cinder.image.image_utils [None req-370b0552-d973-4a70-9753-1121eecf4487 tempest-VolumesActionsTest-9461107 None] Image conversion details: src /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3ffbabb0-4ce4-42a6-a34e-0fd7970b58b6, size 1024.00 MB, duration 5.54 sec, destination /opt/stack/data/cinder/conversion/3ffbabb0-4ce4-42a6-a34e-0fd7970b58b6.temp_image.deb1952d-a38b-4626-b36b-bde8f8b367d7f2u9p56u.img {{(pid=87420) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 16:01:25 devstack cinder-volume[87420]: INFO cinder.image.image_utils [None req-370b0552-d973-4a70-9753-1121eecf4487 tempest-VolumesActionsTest-9461107 None] Converted 1024.00 MB image at 184.89 MB/s Jul 10 16:01:25 devstack cinder-volume[87420]: DEBUG cinder.image.image_utils [None req-370b0552-d973-4a70-9753-1121eecf4487 tempest-VolumesActionsTest-9461107 None] deb1952d-a38b-4626-b36b-bde8f8b367d7 was raw, no need to convert to raw {{(pid=87420) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 10 16:01:35 devstack cinder-volume[87420]: DEBUG dbcounter [-] [87420] Writing DB stats cinder:SELECT=78,cinder:UPDATE=102,cinder:INSERT=26,cinder:DELETE=10 {{(pid=87420) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 16:01:35 devstack cinder-volume[87420]: DEBUG dbcounter [-] [87420] Writing DB stats cinder:SELECT=85,cinder:INSERT=25,cinder:UPDATE=96,cinder:DELETE=5 {{(pid=87420) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 16:01:45 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-370b0552-d973-4a70-9753-1121eecf4487 tempest-VolumesActionsTest-9461107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 28.796s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:01:45 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-370b0552-d973-4a70-9753-1121eecf4487 tempest-VolumesActionsTest-9461107 None] Uploaded volume to glance image-id: deb1952d-a38b-4626-b36b-bde8f8b367d7. {{(pid=87420) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 10 16:01:45 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-4d42a8db-aa54-4ad8-b0b6-d88f8e57fdd7 tempest-VolumeDependencyTests-1953610052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 27.354s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:01:45 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-4d42a8db-aa54-4ad8-b0b6-d88f8e57fdd7 tempest-VolumeDependencyTests-1953610052 None] Acquiring lock "cinder-quobyte-28cb86fa-b673-4ad4-a099-480fb230f4ac-8520c293-d0a8-4bda-a7f4-4c7e75f8bd36" by "_create_volume_from_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:01:45 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-4d42a8db-aa54-4ad8-b0b6-d88f8e57fdd7 tempest-VolumeDependencyTests-1953610052 None] Lock "cinder-quobyte-28cb86fa-b673-4ad4-a099-480fb230f4ac-8520c293-d0a8-4bda-a7f4-4c7e75f8bd36" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:01:45 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-4d42a8db-aa54-4ad8-b0b6-d88f8e57fdd7 tempest-VolumeDependencyTests-1953610052 None] Creating volume 8520c293-d0a8-4bda-a7f4-4c7e75f8bd36 from snapshot 28cb86fa-b673-4ad4-a099-480fb230f4ac {{(pid=87420) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 10 16:01:45 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-4d42a8db-aa54-4ad8-b0b6-d88f8e57fdd7 tempest-VolumeDependencyTests-1953610052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:01:45 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-4d42a8db-aa54-4ad8-b0b6-d88f8e57fdd7 tempest-VolumeDependencyTests-1953610052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:01:45 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-4d42a8db-aa54-4ad8-b0b6-d88f8e57fdd7 tempest-VolumeDependencyTests-1953610052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:01:45 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-4d42a8db-aa54-4ad8-b0b6-d88f8e57fdd7 tempest-VolumeDependencyTests-1953610052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:01:45 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-4d42a8db-aa54-4ad8-b0b6-d88f8e57fdd7 tempest-VolumeDependencyTests-1953610052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:01:45 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-4d42a8db-aa54-4ad8-b0b6-d88f8e57fdd7 tempest-VolumeDependencyTests-1953610052 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 16:01:45 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-4d42a8db-aa54-4ad8-b0b6-d88f8e57fdd7 tempest-VolumeDependencyTests-1953610052 None] Acquiring lock "cinder-quobyte-8520c293-d0a8-4bda-a7f4-4c7e75f8bd36" by "_copy_volume_from_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:01:45 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-370b0552-d973-4a70-9753-1121eecf4487 tempest-VolumesActionsTest-9461107 None] Copy volume to image completed successfully. Jul 10 16:01:45 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-4d42a8db-aa54-4ad8-b0b6-d88f8e57fdd7 tempest-VolumeDependencyTests-1953610052 None] Lock "cinder-quobyte-8520c293-d0a8-4bda-a7f4-4c7e75f8bd36" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:01:45 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-4d42a8db-aa54-4ad8-b0b6-d88f8e57fdd7 tempest-VolumeDependencyTests-1953610052 None] snapshot: 28cb86fa-b673-4ad4-a099-480fb230f4ac, volume: 8520c293-d0a8-4bda-a7f4-4c7e75f8bd36, {{(pid=87420) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 16:01:45 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-4d42a8db-aa54-4ad8-b0b6-d88f8e57fdd7 tempest-VolumeDependencyTests-1953610052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:01:45 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-4d42a8db-aa54-4ad8-b0b6-d88f8e57fdd7 tempest-VolumeDependencyTests-1953610052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:01:45 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-4d42a8db-aa54-4ad8-b0b6-d88f8e57fdd7 tempest-VolumeDependencyTests-1953610052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:01:45 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-4d42a8db-aa54-4ad8-b0b6-d88f8e57fdd7 tempest-VolumeDependencyTests-1953610052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:01:45 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-4d42a8db-aa54-4ad8-b0b6-d88f8e57fdd7 tempest-VolumeDependencyTests-1953610052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:01:45 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbc6260c-0759-49ee-b423-728e64a3cfdf]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:01:45 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4d42a8db-aa54-4ad8-b0b6-d88f8e57fdd7 tempest-VolumeDependencyTests-1953610052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d073b26e-28c5-4864-85c6-c3419a19426b.28cb86fa-b673-4ad4-a099-480fb230f4ac {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:01:46 devstack sudo[100444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d073b26e-28c5-4864-85c6-c3419a19426b.28cb86fa-b673-4ad4-a099-480fb230f4ac Jul 10 16:01:46 devstack sudo[100444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:01:46 devstack sudo[100444]: pam_unix(sudo:session): session closed for user root Jul 10 16:01:46 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4d42a8db-aa54-4ad8-b0b6-d88f8e57fdd7 tempest-VolumeDependencyTests-1953610052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d073b26e-28c5-4864-85c6-c3419a19426b.28cb86fa-b673-4ad4-a099-480fb230f4ac" returned: 0 in 0.905s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:01:46 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-4d42a8db-aa54-4ad8-b0b6-d88f8e57fdd7 tempest-VolumeDependencyTests-1953610052 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d073b26e-28c5-4864-85c6-c3419a19426b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87420) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 16:01:46 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-4d42a8db-aa54-4ad8-b0b6-d88f8e57fdd7 tempest-VolumeDependencyTests-1953610052 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d073b26e-28c5-4864-85c6-c3419a19426b {{(pid=87420) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 16:01:46 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-4d42a8db-aa54-4ad8-b0b6-d88f8e57fdd7 tempest-VolumeDependencyTests-1953610052 None] Creating direct copy from snapshot {{(pid=87420) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 16:01:46 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[2de9a233-073c-4446-a43a-87067f4c6cbe]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:01:46 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4d42a8db-aa54-4ad8-b0b6-d88f8e57fdd7 tempest-VolumeDependencyTests-1953610052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d073b26e-28c5-4864-85c6-c3419a19426b {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:01:46 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-0234ca2f-6ced-49bf-a56b-e27a14a8a5f0 tempest-VolumesNegativeTest-603605191 None] Acquiring lock "cinder-a5076d7f-901d-45bd-8518-73794ca684db-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:01:46 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-0234ca2f-6ced-49bf-a56b-e27a14a8a5f0 tempest-VolumesNegativeTest-603605191 None] Lock "cinder-a5076d7f-901d-45bd-8518-73794ca684db-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:01:47 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-0234ca2f-6ced-49bf-a56b-e27a14a8a5f0 tempest-VolumesNegativeTest-603605191 None] Acquiring lock "cinder-quobyte-a5076d7f-901d-45bd-8518-73794ca684db" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:01:47 devstack sudo[100449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d073b26e-28c5-4864-85c6-c3419a19426b Jul 10 16:01:47 devstack sudo[100449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:01:47 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-0234ca2f-6ced-49bf-a56b-e27a14a8a5f0 tempest-VolumesNegativeTest-603605191 None] Lock "cinder-quobyte-a5076d7f-901d-45bd-8518-73794ca684db" acquired by "delete_volume" :: waited 0.022s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:01:47 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[54eb7e01-3319-43b3-aa37-5d37e1a22475]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:01:47 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-0234ca2f-6ced-49bf-a56b-e27a14a8a5f0 tempest-VolumesNegativeTest-603605191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a5076d7f-901d-45bd-8518-73794ca684db {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:01:47 devstack sudo[100451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a5076d7f-901d-45bd-8518-73794ca684db Jul 10 16:01:47 devstack sudo[100451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:01:47 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-8196b0bb-e8f8-43d5-b372-b2420e2ddeff tempest-VolumesActionsTest-9461107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:01:47 devstack sudo[100449]: pam_unix(sudo:session): session closed for user root Jul 10 16:01:47 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4d42a8db-aa54-4ad8-b0b6-d88f8e57fdd7 tempest-VolumeDependencyTests-1953610052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d073b26e-28c5-4864-85c6-c3419a19426b" returned: 0 in 0.790s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:01:47 devstack cinder-volume[87420]: DEBUG cinder.utils [None req-4d42a8db-aa54-4ad8-b0b6-d88f8e57fdd7 tempest-VolumeDependencyTests-1953610052 None] Path /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-8520c293-d0a8-4bda-a7f4-4c7e75f8bd36 not found in is_blk_device check {{(pid=87420) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 16:01:47 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4d42a8db-aa54-4ad8-b0b6-d88f8e57fdd7 tempest-VolumeDependencyTests-1953610052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d073b26e-28c5-4864-85c6-c3419a19426b /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-8520c293-d0a8-4bda-a7f4-4c7e75f8bd36 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:01:47 devstack sudo[100456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d073b26e-28c5-4864-85c6-c3419a19426b /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-8520c293-d0a8-4bda-a7f4-4c7e75f8bd36 Jul 10 16:01:47 devstack sudo[100456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:01:47 devstack sudo[100451]: pam_unix(sudo:session): session closed for user root Jul 10 16:01:47 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-0234ca2f-6ced-49bf-a56b-e27a14a8a5f0 tempest-VolumesNegativeTest-603605191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a5076d7f-901d-45bd-8518-73794ca684db" returned: 0 in 0.818s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:01:47 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-0234ca2f-6ced-49bf-a56b-e27a14a8a5f0 tempest-VolumesNegativeTest-603605191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a5076d7f-901d-45bd-8518-73794ca684db {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:01:47 devstack sudo[100461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a5076d7f-901d-45bd-8518-73794ca684db Jul 10 16:01:47 devstack sudo[100461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:01:48 devstack sudo[100461]: pam_unix(sudo:session): session closed for user root Jul 10 16:01:48 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-0234ca2f-6ced-49bf-a56b-e27a14a8a5f0 tempest-VolumesNegativeTest-603605191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a5076d7f-901d-45bd-8518-73794ca684db" returned: 0 in 0.857s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:01:48 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-0234ca2f-6ced-49bf-a56b-e27a14a8a5f0 tempest-VolumesNegativeTest-603605191 None] Lock "cinder-quobyte-a5076d7f-901d-45bd-8518-73794ca684db" released by "delete_volume" :: held 1.749s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:01:48 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-0234ca2f-6ced-49bf-a56b-e27a14a8a5f0 tempest-VolumesNegativeTest-603605191 None] Created reservations ['6041d22c-bbc7-4915-a1de-47f60ae9aa6c', 'e9f2154f-5cf2-4a4c-a99d-cf3646757f5e', '07b4185f-299e-4ef5-afee-5bd8c65ea872', 'cfc8c808-ef66-41e4-93f3-6c8c7b58747a'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:01:49 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-0234ca2f-6ced-49bf-a56b-e27a14a8a5f0 tempest-VolumesNegativeTest-603605191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:01:49 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-0234ca2f-6ced-49bf-a56b-e27a14a8a5f0 tempest-VolumesNegativeTest-603605191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:01:49 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-0234ca2f-6ced-49bf-a56b-e27a14a8a5f0 tempest-VolumesNegativeTest-603605191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:01:49 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-0234ca2f-6ced-49bf-a56b-e27a14a8a5f0 tempest-VolumesNegativeTest-603605191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:01:49 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-0234ca2f-6ced-49bf-a56b-e27a14a8a5f0 tempest-VolumesNegativeTest-603605191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:01:49 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-0234ca2f-6ced-49bf-a56b-e27a14a8a5f0 tempest-VolumesNegativeTest-603605191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:01:49 devstack sudo[100474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:01:49 devstack sudo[100474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:01:50 devstack sudo[100474]: pam_unix(sudo:session): session closed for user root Jul 10 16:01:50 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-0234ca2f-6ced-49bf-a56b-e27a14a8a5f0 tempest-VolumesNegativeTest-603605191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 1.304s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:01:50 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-0234ca2f-6ced-49bf-a56b-e27a14a8a5f0 tempest-VolumesNegativeTest-603605191 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:01:50 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-0234ca2f-6ced-49bf-a56b-e27a14a8a5f0 tempest-VolumesNegativeTest-603605191 None] Deleted volume successfully. Jul 10 16:01:50 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-0234ca2f-6ced-49bf-a56b-e27a14a8a5f0 tempest-VolumesNegativeTest-603605191 None] Lock "cinder-a5076d7f-901d-45bd-8518-73794ca684db-delete_volume" released by "delete_volume" :: held 3.455s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:01:53 devstack sudo[100456]: pam_unix(sudo:session): session closed for user root Jul 10 16:01:53 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4d42a8db-aa54-4ad8-b0b6-d88f8e57fdd7 tempest-VolumeDependencyTests-1953610052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d073b26e-28c5-4864-85c6-c3419a19426b /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-8520c293-d0a8-4bda-a7f4-4c7e75f8bd36" returned: 0 in 5.420s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:01:53 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[88399792-acea-42b8-9518-069ecb380e45]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:01:53 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4d42a8db-aa54-4ad8-b0b6-d88f8e57fdd7 tempest-VolumeDependencyTests-1953610052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d073b26e-28c5-4864-85c6-c3419a19426b {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:01:53 devstack sudo[100480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d073b26e-28c5-4864-85c6-c3419a19426b Jul 10 16:01:53 devstack sudo[100480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:01:54 devstack sudo[100480]: pam_unix(sudo:session): session closed for user root Jul 10 16:01:54 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4d42a8db-aa54-4ad8-b0b6-d88f8e57fdd7 tempest-VolumeDependencyTests-1953610052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d073b26e-28c5-4864-85c6-c3419a19426b" returned: 0 in 0.967s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:01:54 devstack cinder-volume[87420]: DEBUG cinder.image.image_utils [None req-4d42a8db-aa54-4ad8-b0b6-d88f8e57fdd7 tempest-VolumeDependencyTests-1953610052 None] Image conversion details: src /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d073b26e-28c5-4864-85c6-c3419a19426b, size 1024.00 MB, duration 5.42 sec, destination /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-8520c293-d0a8-4bda-a7f4-4c7e75f8bd36 {{(pid=87420) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 16:01:54 devstack cinder-volume[87420]: INFO cinder.image.image_utils [None req-4d42a8db-aa54-4ad8-b0b6-d88f8e57fdd7 tempest-VolumeDependencyTests-1953610052 None] Converted 1024.00 MB image at 188.88 MB/s Jul 10 16:01:54 devstack cinder-volume[87420]: WARNING cinder.volume.drivers.remotefs [None req-4d42a8db-aa54-4ad8-b0b6-d88f8e57fdd7 tempest-VolumeDependencyTests-1953610052 None] /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-8520c293-d0a8-4bda-a7f4-4c7e75f8bd36 is being set with open permissions: ugo+rw Jul 10 16:01:54 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4d42a8db-aa54-4ad8-b0b6-d88f8e57fdd7 tempest-VolumeDependencyTests-1953610052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-8520c293-d0a8-4bda-a7f4-4c7e75f8bd36 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:01:54 devstack sudo[100485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-8520c293-d0a8-4bda-a7f4-4c7e75f8bd36 Jul 10 16:01:54 devstack sudo[100485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:01:54 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-d36dd6a2-df13-499a-beab-8a004c74ba73 tempest-VolumesSnapshotNegativeTestJSON-1361038716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 16:01:54 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d36dd6a2-df13-499a-beab-8a004c74ba73 tempest-VolumesSnapshotNegativeTestJSON-1361038716 None] Flow 'volume_create_manager' (6431cbf0-3a57-434a-94e4-0c9f04a50f6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:01:54 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d36dd6a2-df13-499a-beab-8a004c74ba73 tempest-VolumesSnapshotNegativeTestJSON-1361038716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9c7d041-cfd3-4a36-950a-05cc283d5cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:01:54 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d36dd6a2-df13-499a-beab-8a004c74ba73 tempest-VolumesSnapshotNegativeTestJSON-1361038716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9c7d041-cfd3-4a36-950a-05cc283d5cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:01:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-184392496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49df9132-740e-461b-9749-247d5ad7369f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba91910596da4c968c47914e24455af3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:01:54Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:01:54Z,use_quota=True,user_id='af873af74ffc4527b7030ac80e81c513',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:01:54 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d36dd6a2-df13-499a-beab-8a004c74ba73 tempest-VolumesSnapshotNegativeTestJSON-1361038716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d139b755-80bc-47b1-846b-1cc955dcd65a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:01:54 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d36dd6a2-df13-499a-beab-8a004c74ba73 tempest-VolumesSnapshotNegativeTestJSON-1361038716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d139b755-80bc-47b1-846b-1cc955dcd65a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:01:54 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d36dd6a2-df13-499a-beab-8a004c74ba73 tempest-VolumesSnapshotNegativeTestJSON-1361038716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b61694fa-ada8-4671-ab57-88c745d146fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:01:54 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d36dd6a2-df13-499a-beab-8a004c74ba73 tempest-VolumesSnapshotNegativeTestJSON-1361038716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b61694fa-ada8-4671-ab57-88c745d146fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49df9132-740e-461b-9749-247d5ad7369f', 'volume_name': 'volume-49df9132-740e-461b-9749-247d5ad7369f', 'volume_size': 2}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:01:54 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d36dd6a2-df13-499a-beab-8a004c74ba73 tempest-VolumesSnapshotNegativeTestJSON-1361038716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8856c1d0-60d9-40e5-9b55-7a20b84c01a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:01:54 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d36dd6a2-df13-499a-beab-8a004c74ba73 tempest-VolumesSnapshotNegativeTestJSON-1361038716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8856c1d0-60d9-40e5-9b55-7a20b84c01a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:01:54 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d36dd6a2-df13-499a-beab-8a004c74ba73 tempest-VolumesSnapshotNegativeTestJSON-1361038716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d9f6036-bf30-48f3-aa0b-c07aa39345c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:01:54 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-d36dd6a2-df13-499a-beab-8a004c74ba73 tempest-VolumesSnapshotNegativeTestJSON-1361038716 None] Volume 49df9132-740e-461b-9749-247d5ad7369f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49df9132-740e-461b-9749-247d5ad7369f', 'volume_size': 2} Jul 10 16:01:54 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-d36dd6a2-df13-499a-beab-8a004c74ba73 tempest-VolumesSnapshotNegativeTestJSON-1361038716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:01:54 devstack sudo[100485]: pam_unix(sudo:session): session closed for user root Jul 10 16:01:54 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4d42a8db-aa54-4ad8-b0b6-d88f8e57fdd7 tempest-VolumeDependencyTests-1953610052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-8520c293-d0a8-4bda-a7f4-4c7e75f8bd36" returned: 0 in 0.727s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:01:54 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-4d42a8db-aa54-4ad8-b0b6-d88f8e57fdd7 tempest-VolumeDependencyTests-1953610052 None] Lock "cinder-quobyte-8520c293-d0a8-4bda-a7f4-4c7e75f8bd36" released by "_copy_volume_from_snapshot" :: held 8.921s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:01:54 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-4d42a8db-aa54-4ad8-b0b6-d88f8e57fdd7 tempest-VolumeDependencyTests-1953610052 None] Lock "cinder-quobyte-28cb86fa-b673-4ad4-a099-480fb230f4ac-8520c293-d0a8-4bda-a7f4-4c7e75f8bd36" released by "_create_volume_from_snapshot" :: held 8.955s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:01:54 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-4d42a8db-aa54-4ad8-b0b6-d88f8e57fdd7 tempest-VolumeDependencyTests-1953610052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.978s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:01:54 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-8196b0bb-e8f8-43d5-b372-b2420e2ddeff tempest-VolumesActionsTest-9461107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 7.371s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:01:54 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[6140dcfa-f5f9-4885-bbcc-a907062270a9]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:01:54 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8196b0bb-e8f8-43d5-b372-b2420e2ddeff tempest-VolumesActionsTest-9461107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3ffbabb0-4ce4-42a6-a34e-0fd7970b58b6 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:01:54 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-4d42a8db-aa54-4ad8-b0b6-d88f8e57fdd7 tempest-VolumeDependencyTests-1953610052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc2d0c38-d80c-4e45-9c86-8d53133b2853) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8520c293-d0a8-4bda-a7f4-4c7e75f8bd36', 'volume_size': 1, 'snapshot_id': '28cb86fa-b673-4ad4-a099-480fb230f4ac'}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:01:54 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-4d42a8db-aa54-4ad8-b0b6-d88f8e57fdd7 tempest-VolumeDependencyTests-1953610052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (771c4df9-0e73-471c-a48d-fe18dc1a4cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:01:54 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-4d42a8db-aa54-4ad8-b0b6-d88f8e57fdd7 tempest-VolumeDependencyTests-1953610052 None] Volume volume-8520c293-d0a8-4bda-a7f4-4c7e75f8bd36 (8520c293-d0a8-4bda-a7f4-4c7e75f8bd36): created successfully Jul 10 16:01:54 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-4d42a8db-aa54-4ad8-b0b6-d88f8e57fdd7 tempest-VolumeDependencyTests-1953610052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (771c4df9-0e73-471c-a48d-fe18dc1a4cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:01:54 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-4d42a8db-aa54-4ad8-b0b6-d88f8e57fdd7 tempest-VolumeDependencyTests-1953610052 None] Flow 'volume_create_manager' (02d63ec9-e2fb-4454-96b5-0e28e7953063) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:01:54 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-4d42a8db-aa54-4ad8-b0b6-d88f8e57fdd7 tempest-VolumeDependencyTests-1953610052 None] Created volume successfully. Jul 10 16:01:54 devstack sudo[100488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3ffbabb0-4ce4-42a6-a34e-0fd7970b58b6 Jul 10 16:01:54 devstack sudo[100488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:01:55 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-693fbb40-2d44-405b-a690-1ff532d9ca4c tempest-VolumeDependencyTests-1953610052 None] Acquiring lock "cinder-28cb86fa-b673-4ad4-a099-480fb230f4ac-delete_snapshot" by "delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:01:55 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-693fbb40-2d44-405b-a690-1ff532d9ca4c tempest-VolumeDependencyTests-1953610052 None] Lock "cinder-28cb86fa-b673-4ad4-a099-480fb230f4ac-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:01:55 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-693fbb40-2d44-405b-a690-1ff532d9ca4c tempest-VolumeDependencyTests-1953610052 None] Acquiring lock "cinder-quobyte-d073b26e-28c5-4864-85c6-c3419a19426b" by "delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:01:55 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-693fbb40-2d44-405b-a690-1ff532d9ca4c tempest-VolumeDependencyTests-1953610052 None] Lock "cinder-quobyte-d073b26e-28c5-4864-85c6-c3419a19426b" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:01:55 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-693fbb40-2d44-405b-a690-1ff532d9ca4c tempest-VolumeDependencyTests-1953610052 None] Acquiring lock "cinder-quobyte-28cb86fa-b673-4ad4-a099-480fb230f4ac" by "_delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:01:55 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-693fbb40-2d44-405b-a690-1ff532d9ca4c tempest-VolumeDependencyTests-1953610052 None] Lock "cinder-quobyte-28cb86fa-b673-4ad4-a099-480fb230f4ac" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:01:55 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-693fbb40-2d44-405b-a690-1ff532d9ca4c tempest-VolumeDependencyTests-1953610052 None] Deleting offline snapshot 28cb86fa-b673-4ad4-a099-480fb230f4ac of volume d073b26e-28c5-4864-85c6-c3419a19426b {{(pid=87420) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 16:01:55 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-693fbb40-2d44-405b-a690-1ff532d9ca4c tempest-VolumeDependencyTests-1953610052 None] snapshot_file for this snap is: volume-d073b26e-28c5-4864-85c6-c3419a19426b.28cb86fa-b673-4ad4-a099-480fb230f4ac {{(pid=87420) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 16:01:55 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0558745-ee80-41dc-9905-eadf0cf7442e]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:01:55 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-693fbb40-2d44-405b-a690-1ff532d9ca4c tempest-VolumeDependencyTests-1953610052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d073b26e-28c5-4864-85c6-c3419a19426b.28cb86fa-b673-4ad4-a099-480fb230f4ac {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:01:55 devstack sudo[100488]: pam_unix(sudo:session): session closed for user root Jul 10 16:01:55 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8196b0bb-e8f8-43d5-b372-b2420e2ddeff tempest-VolumesActionsTest-9461107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3ffbabb0-4ce4-42a6-a34e-0fd7970b58b6" returned: 0 in 0.835s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:01:55 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cdef58c-aecd-4f8b-84e7-597b9cfe0492]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:01:55 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8196b0bb-e8f8-43d5-b372-b2420e2ddeff tempest-VolumesActionsTest-9461107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3ffbabb0-4ce4-42a6-a34e-0fd7970b58b6 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:01:55 devstack sudo[100493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d073b26e-28c5-4864-85c6-c3419a19426b.28cb86fa-b673-4ad4-a099-480fb230f4ac Jul 10 16:01:55 devstack sudo[100493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:01:55 devstack sudo[100494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3ffbabb0-4ce4-42a6-a34e-0fd7970b58b6 Jul 10 16:01:55 devstack sudo[100494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:01:56 devstack sudo[100493]: pam_unix(sudo:session): session closed for user root Jul 10 16:01:56 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-693fbb40-2d44-405b-a690-1ff532d9ca4c tempest-VolumeDependencyTests-1953610052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d073b26e-28c5-4864-85c6-c3419a19426b.28cb86fa-b673-4ad4-a099-480fb230f4ac" returned: 0 in 0.786s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:01:56 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-693fbb40-2d44-405b-a690-1ff532d9ca4c tempest-VolumeDependencyTests-1953610052 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d073b26e-28c5-4864-85c6-c3419a19426b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87420) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 16:01:56 devstack sudo[100494]: pam_unix(sudo:session): session closed for user root Jul 10 16:01:56 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8196b0bb-e8f8-43d5-b372-b2420e2ddeff tempest-VolumesActionsTest-9461107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3ffbabb0-4ce4-42a6-a34e-0fd7970b58b6" returned: 0 in 0.781s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:01:56 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8196b0bb-e8f8-43d5-b372-b2420e2ddeff tempest-VolumesActionsTest-9461107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3ffbabb0-4ce4-42a6-a34e-0fd7970b58b6 /opt/stack/data/cinder/conversion/3ffbabb0-4ce4-42a6-a34e-0fd7970b58b6.temp_image.3ab72a71-6708-48f3-9c72-8a822e1ffbbej06glw40.img {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:01:56 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[984262ca-04d6-484f-8d70-0d8718fb1cb1]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:01:56 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-693fbb40-2d44-405b-a690-1ff532d9ca4c tempest-VolumeDependencyTests-1953610052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d073b26e-28c5-4864-85c6-c3419a19426b {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:01:56 devstack sudo[100503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3ffbabb0-4ce4-42a6-a34e-0fd7970b58b6 /opt/stack/data/cinder/conversion/3ffbabb0-4ce4-42a6-a34e-0fd7970b58b6.temp_image.3ab72a71-6708-48f3-9c72-8a822e1ffbbej06glw40.img Jul 10 16:01:56 devstack sudo[100503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:01:56 devstack sudo[100504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d073b26e-28c5-4864-85c6-c3419a19426b Jul 10 16:01:56 devstack sudo[100504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:01:57 devstack sudo[100504]: pam_unix(sudo:session): session closed for user root Jul 10 16:01:57 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-693fbb40-2d44-405b-a690-1ff532d9ca4c tempest-VolumeDependencyTests-1953610052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d073b26e-28c5-4864-85c6-c3419a19426b" returned: 0 in 1.029s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:01:57 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-693fbb40-2d44-405b-a690-1ff532d9ca4c tempest-VolumeDependencyTests-1953610052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d073b26e-28c5-4864-85c6-c3419a19426b.28cb86fa-b673-4ad4-a099-480fb230f4ac {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:01:57 devstack sudo[100520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d073b26e-28c5-4864-85c6-c3419a19426b.28cb86fa-b673-4ad4-a099-480fb230f4ac Jul 10 16:01:57 devstack sudo[100520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:01:58 devstack sudo[100520]: pam_unix(sudo:session): session closed for user root Jul 10 16:01:58 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-693fbb40-2d44-405b-a690-1ff532d9ca4c tempest-VolumeDependencyTests-1953610052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d073b26e-28c5-4864-85c6-c3419a19426b.28cb86fa-b673-4ad4-a099-480fb230f4ac" returned: 0 in 1.269s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:01:58 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-693fbb40-2d44-405b-a690-1ff532d9ca4c tempest-VolumeDependencyTests-1953610052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d073b26e-28c5-4864-85c6-c3419a19426b.28cb86fa-b673-4ad4-a099-480fb230f4ac {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:01:58 devstack sudo[100526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d073b26e-28c5-4864-85c6-c3419a19426b.28cb86fa-b673-4ad4-a099-480fb230f4ac Jul 10 16:01:58 devstack sudo[100526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:02:00 devstack sudo[100526]: pam_unix(sudo:session): session closed for user root Jul 10 16:02:00 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-693fbb40-2d44-405b-a690-1ff532d9ca4c tempest-VolumeDependencyTests-1953610052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d073b26e-28c5-4864-85c6-c3419a19426b.28cb86fa-b673-4ad4-a099-480fb230f4ac" returned: 0 in 1.274s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:02:00 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-693fbb40-2d44-405b-a690-1ff532d9ca4c tempest-VolumeDependencyTests-1953610052 None] Lock "cinder-quobyte-28cb86fa-b673-4ad4-a099-480fb230f4ac" released by "_delete_snapshot" :: held 4.532s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:02:00 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-693fbb40-2d44-405b-a690-1ff532d9ca4c tempest-VolumeDependencyTests-1953610052 None] Lock "cinder-quobyte-d073b26e-28c5-4864-85c6-c3419a19426b" released by "delete_snapshot" :: held 4.565s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:02:00 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-693fbb40-2d44-405b-a690-1ff532d9ca4c tempest-VolumeDependencyTests-1953610052 None] Created reservations ['32747f9d-1e20-44e2-831e-48e56adcde47', 'd783330e-8f8c-47a2-aaa1-eb7d6a67f510', 'e6e5bbad-e5ac-435b-b868-430465a539ae', '194be371-526c-469a-ab93-79965f283ed4'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:02:00 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-693fbb40-2d44-405b-a690-1ff532d9ca4c tempest-VolumeDependencyTests-1953610052 None] Delete snapshot completed successfully. Jul 10 16:02:00 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-693fbb40-2d44-405b-a690-1ff532d9ca4c tempest-VolumeDependencyTests-1953610052 None] Lock "cinder-28cb86fa-b673-4ad4-a099-480fb230f4ac-delete_snapshot" released by "delete_snapshot" :: held 4.911s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:02:01 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-17355318-71e3-44c7-9511-447dbf1bd776 tempest-VolumeDependencyTests-1953610052 None] Acquiring lock "cinder-d073b26e-28c5-4864-85c6-c3419a19426b-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:02:01 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-17355318-71e3-44c7-9511-447dbf1bd776 tempest-VolumeDependencyTests-1953610052 None] Lock "cinder-d073b26e-28c5-4864-85c6-c3419a19426b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:02:01 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-17355318-71e3-44c7-9511-447dbf1bd776 tempest-VolumeDependencyTests-1953610052 None] Acquiring lock "cinder-quobyte-d073b26e-28c5-4864-85c6-c3419a19426b" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:02:01 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-17355318-71e3-44c7-9511-447dbf1bd776 tempest-VolumeDependencyTests-1953610052 None] Lock "cinder-quobyte-d073b26e-28c5-4864-85c6-c3419a19426b" acquired by "delete_volume" :: waited 0.061s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:02:01 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2118e83-f136-430c-8d33-8bfef8029590]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:02:01 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-17355318-71e3-44c7-9511-447dbf1bd776 tempest-VolumeDependencyTests-1953610052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d073b26e-28c5-4864-85c6-c3419a19426b {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:02:01 devstack sudo[100503]: pam_unix(sudo:session): session closed for user root Jul 10 16:02:01 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8196b0bb-e8f8-43d5-b372-b2420e2ddeff tempest-VolumesActionsTest-9461107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3ffbabb0-4ce4-42a6-a34e-0fd7970b58b6 /opt/stack/data/cinder/conversion/3ffbabb0-4ce4-42a6-a34e-0fd7970b58b6.temp_image.3ab72a71-6708-48f3-9c72-8a822e1ffbbej06glw40.img" returned: 0 in 5.014s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:02:01 devstack sudo[100529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d073b26e-28c5-4864-85c6-c3419a19426b Jul 10 16:02:01 devstack sudo[100529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:02:01 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[2895cdcc-088c-4ab8-a26a-7d6aca71a49b]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:02:01 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8196b0bb-e8f8-43d5-b372-b2420e2ddeff tempest-VolumesActionsTest-9461107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3ffbabb0-4ce4-42a6-a34e-0fd7970b58b6 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:02:01 devstack sudo[100531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3ffbabb0-4ce4-42a6-a34e-0fd7970b58b6 Jul 10 16:02:01 devstack sudo[100531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:02:02 devstack sudo[100529]: pam_unix(sudo:session): session closed for user root Jul 10 16:02:02 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-17355318-71e3-44c7-9511-447dbf1bd776 tempest-VolumeDependencyTests-1953610052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d073b26e-28c5-4864-85c6-c3419a19426b" returned: 0 in 0.786s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:02:02 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-17355318-71e3-44c7-9511-447dbf1bd776 tempest-VolumeDependencyTests-1953610052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d073b26e-28c5-4864-85c6-c3419a19426b {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:02:02 devstack sudo[100538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d073b26e-28c5-4864-85c6-c3419a19426b Jul 10 16:02:02 devstack sudo[100538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:02:02 devstack sudo[100531]: pam_unix(sudo:session): session closed for user root Jul 10 16:02:02 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8196b0bb-e8f8-43d5-b372-b2420e2ddeff tempest-VolumesActionsTest-9461107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3ffbabb0-4ce4-42a6-a34e-0fd7970b58b6" returned: 0 in 0.959s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:02:02 devstack cinder-volume[87420]: DEBUG cinder.image.image_utils [None req-8196b0bb-e8f8-43d5-b372-b2420e2ddeff tempest-VolumesActionsTest-9461107 None] Image conversion details: src /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3ffbabb0-4ce4-42a6-a34e-0fd7970b58b6, size 1024.00 MB, duration 5.02 sec, destination /opt/stack/data/cinder/conversion/3ffbabb0-4ce4-42a6-a34e-0fd7970b58b6.temp_image.3ab72a71-6708-48f3-9c72-8a822e1ffbbej06glw40.img {{(pid=87420) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 16:02:02 devstack cinder-volume[87420]: INFO cinder.image.image_utils [None req-8196b0bb-e8f8-43d5-b372-b2420e2ddeff tempest-VolumesActionsTest-9461107 None] Converted 1024.00 MB image at 204.16 MB/s Jul 10 16:02:02 devstack cinder-volume[87420]: DEBUG cinder.image.image_utils [None req-8196b0bb-e8f8-43d5-b372-b2420e2ddeff tempest-VolumesActionsTest-9461107 None] 3ab72a71-6708-48f3-9c72-8a822e1ffbbe was raw, converting to qcow2 {{(pid=87420) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 10 16:02:02 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fbea8b9-eb13-4176-9be5-b136e671aded]: (4, 'raw') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:02:02 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8196b0bb-e8f8-43d5-b372-b2420e2ddeff tempest-VolumesActionsTest-9461107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/3ffbabb0-4ce4-42a6-a34e-0fd7970b58b6.temp_image.3ab72a71-6708-48f3-9c72-8a822e1ffbbej06glw40.img {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:02:02 devstack sudo[100541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/3ffbabb0-4ce4-42a6-a34e-0fd7970b58b6.temp_image.3ab72a71-6708-48f3-9c72-8a822e1ffbbej06glw40.img Jul 10 16:02:02 devstack sudo[100541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:02:02 devstack sudo[100538]: pam_unix(sudo:session): session closed for user root Jul 10 16:02:02 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-17355318-71e3-44c7-9511-447dbf1bd776 tempest-VolumeDependencyTests-1953610052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d073b26e-28c5-4864-85c6-c3419a19426b" returned: 0 in 0.665s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:02:02 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-17355318-71e3-44c7-9511-447dbf1bd776 tempest-VolumeDependencyTests-1953610052 None] Lock "cinder-quobyte-d073b26e-28c5-4864-85c6-c3419a19426b" released by "delete_volume" :: held 1.543s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:02:02 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-17355318-71e3-44c7-9511-447dbf1bd776 tempest-VolumeDependencyTests-1953610052 None] Created reservations ['15222a0a-a808-4db3-b5e4-fc9d0c88253b', '3223283e-fa3a-485d-88e7-0572ac2f452b', 'a28547ce-2313-4c9c-ba87-7a46119bb0b7', 'd583ff69-2935-42d8-b7f2-cc3e5eaf45b0'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:02:02 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-17355318-71e3-44c7-9511-447dbf1bd776 tempest-VolumeDependencyTests-1953610052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:02:02 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-17355318-71e3-44c7-9511-447dbf1bd776 tempest-VolumeDependencyTests-1953610052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:02:02 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-17355318-71e3-44c7-9511-447dbf1bd776 tempest-VolumeDependencyTests-1953610052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:02:03 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-17355318-71e3-44c7-9511-447dbf1bd776 tempest-VolumeDependencyTests-1953610052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:02:03 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-17355318-71e3-44c7-9511-447dbf1bd776 tempest-VolumeDependencyTests-1953610052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:02:03 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-17355318-71e3-44c7-9511-447dbf1bd776 tempest-VolumeDependencyTests-1953610052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:02:03 devstack sudo[100544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:02:03 devstack sudo[100544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:02:03 devstack sudo[100541]: pam_unix(sudo:session): session closed for user root Jul 10 16:02:03 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8196b0bb-e8f8-43d5-b372-b2420e2ddeff tempest-VolumesActionsTest-9461107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/3ffbabb0-4ce4-42a6-a34e-0fd7970b58b6.temp_image.3ab72a71-6708-48f3-9c72-8a822e1ffbbej06glw40.img" returned: 0 in 0.765s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:02:03 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8196b0bb-e8f8-43d5-b372-b2420e2ddeff tempest-VolumesActionsTest-9461107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/3ffbabb0-4ce4-42a6-a34e-0fd7970b58b6.temp_image.3ab72a71-6708-48f3-9c72-8a822e1ffbbej06glw40.img {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:02:03 devstack sudo[100549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/3ffbabb0-4ce4-42a6-a34e-0fd7970b58b6.temp_image.3ab72a71-6708-48f3-9c72-8a822e1ffbbej06glw40.img Jul 10 16:02:03 devstack sudo[100549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:02:03 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-1e57447b-d4b9-4fcc-8896-28c54d324b2a tempest-VolumeDependencyTests-1953610052 None] Acquiring lock "cinder-8520c293-d0a8-4bda-a7f4-4c7e75f8bd36-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:02:03 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-1e57447b-d4b9-4fcc-8896-28c54d324b2a tempest-VolumeDependencyTests-1953610052 None] Lock "cinder-8520c293-d0a8-4bda-a7f4-4c7e75f8bd36-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:02:03 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-1e57447b-d4b9-4fcc-8896-28c54d324b2a tempest-VolumeDependencyTests-1953610052 None] Acquiring lock "cinder-quobyte-8520c293-d0a8-4bda-a7f4-4c7e75f8bd36" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:02:03 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-1e57447b-d4b9-4fcc-8896-28c54d324b2a tempest-VolumeDependencyTests-1953610052 None] Lock "cinder-quobyte-8520c293-d0a8-4bda-a7f4-4c7e75f8bd36" acquired by "delete_volume" :: waited 0.025s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:02:03 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b7fe7a7-88a6-4436-b9e5-307f9855a826]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:02:03 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-1e57447b-d4b9-4fcc-8896-28c54d324b2a tempest-VolumeDependencyTests-1953610052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-8520c293-d0a8-4bda-a7f4-4c7e75f8bd36 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:02:03 devstack sudo[100544]: pam_unix(sudo:session): session closed for user root Jul 10 16:02:03 devstack sudo[100552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-8520c293-d0a8-4bda-a7f4-4c7e75f8bd36 Jul 10 16:02:03 devstack sudo[100552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:02:03 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-17355318-71e3-44c7-9511-447dbf1bd776 tempest-VolumeDependencyTests-1953610052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.764s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:02:03 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-17355318-71e3-44c7-9511-447dbf1bd776 tempest-VolumeDependencyTests-1953610052 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:02:03 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-17355318-71e3-44c7-9511-447dbf1bd776 tempest-VolumeDependencyTests-1953610052 None] Deleted volume successfully. Jul 10 16:02:03 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-17355318-71e3-44c7-9511-447dbf1bd776 tempest-VolumeDependencyTests-1953610052 None] Lock "cinder-d073b26e-28c5-4864-85c6-c3419a19426b-delete_volume" released by "delete_volume" :: held 2.625s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:02:04 devstack sudo[100549]: pam_unix(sudo:session): session closed for user root Jul 10 16:02:04 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8196b0bb-e8f8-43d5-b372-b2420e2ddeff tempest-VolumesActionsTest-9461107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/3ffbabb0-4ce4-42a6-a34e-0fd7970b58b6.temp_image.3ab72a71-6708-48f3-9c72-8a822e1ffbbej06glw40.img" returned: 1 in 0.754s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:02:04 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8196b0bb-e8f8-43d5-b372-b2420e2ddeff tempest-VolumesActionsTest-9461107 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/3ffbabb0-4ce4-42a6-a34e-0fd7970b58b6.temp_image.3ab72a71-6708-48f3-9c72-8a822e1ffbbej06glw40.img' failed. Not Retrying. {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 16:02:04 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8196b0bb-e8f8-43d5-b372-b2420e2ddeff tempest-VolumesActionsTest-9461107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/3ffbabb0-4ce4-42a6-a34e-0fd7970b58b6.temp_image.3ab72a71-6708-48f3-9c72-8a822e1ffbbej06glw40.img /opt/stack/data/cinder/conversion/vol_upload__y5n0hvn {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:02:04 devstack sudo[100557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/3ffbabb0-4ce4-42a6-a34e-0fd7970b58b6.temp_image.3ab72a71-6708-48f3-9c72-8a822e1ffbbej06glw40.img /opt/stack/data/cinder/conversion/vol_upload__y5n0hvn Jul 10 16:02:04 devstack sudo[100557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:02:04 devstack sudo[100552]: pam_unix(sudo:session): session closed for user root Jul 10 16:02:04 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-1e57447b-d4b9-4fcc-8896-28c54d324b2a tempest-VolumeDependencyTests-1953610052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-8520c293-d0a8-4bda-a7f4-4c7e75f8bd36" returned: 0 in 0.824s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:02:04 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-1e57447b-d4b9-4fcc-8896-28c54d324b2a tempest-VolumeDependencyTests-1953610052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-8520c293-d0a8-4bda-a7f4-4c7e75f8bd36 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:02:04 devstack sudo[100562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-8520c293-d0a8-4bda-a7f4-4c7e75f8bd36 Jul 10 16:02:04 devstack sudo[100562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:02:04 devstack sudo[100557]: pam_unix(sudo:session): session closed for user root Jul 10 16:02:04 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8196b0bb-e8f8-43d5-b372-b2420e2ddeff tempest-VolumesActionsTest-9461107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/3ffbabb0-4ce4-42a6-a34e-0fd7970b58b6.temp_image.3ab72a71-6708-48f3-9c72-8a822e1ffbbej06glw40.img /opt/stack/data/cinder/conversion/vol_upload__y5n0hvn" returned: 0 in 0.694s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:02:04 devstack cinder-volume[87420]: DEBUG cinder.image.image_utils [None req-8196b0bb-e8f8-43d5-b372-b2420e2ddeff tempest-VolumesActionsTest-9461107 None] Image conversion details: src /opt/stack/data/cinder/conversion/3ffbabb0-4ce4-42a6-a34e-0fd7970b58b6.temp_image.3ab72a71-6708-48f3-9c72-8a822e1ffbbej06glw40.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload__y5n0hvn {{(pid=87420) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 16:02:04 devstack cinder-volume[87420]: INFO cinder.image.image_utils [None req-8196b0bb-e8f8-43d5-b372-b2420e2ddeff tempest-VolumesActionsTest-9461107 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 10 16:02:04 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b27709c-2d09-4040-98bf-d48c1a629a45]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:02:04 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8196b0bb-e8f8-43d5-b372-b2420e2ddeff tempest-VolumesActionsTest-9461107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload__y5n0hvn {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:02:04 devstack sudo[100567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload__y5n0hvn Jul 10 16:02:04 devstack sudo[100567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:02:05 devstack sudo[100562]: pam_unix(sudo:session): session closed for user root Jul 10 16:02:05 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-1e57447b-d4b9-4fcc-8896-28c54d324b2a tempest-VolumeDependencyTests-1953610052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-8520c293-d0a8-4bda-a7f4-4c7e75f8bd36" returned: 0 in 0.657s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:02:05 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-1e57447b-d4b9-4fcc-8896-28c54d324b2a tempest-VolumeDependencyTests-1953610052 None] Lock "cinder-quobyte-8520c293-d0a8-4bda-a7f4-4c7e75f8bd36" released by "delete_volume" :: held 1.534s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:02:05 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-1e57447b-d4b9-4fcc-8896-28c54d324b2a tempest-VolumeDependencyTests-1953610052 None] Created reservations ['e25ba995-5a40-45e8-b439-b22ae1b6ef2a', '1d35a812-1419-47cd-a571-79ce52de462f', '16622796-2c29-4642-bbd3-ce18f460c2fd', 'ba1bdb7f-cd9e-43bb-a10a-24150945ab5f'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:02:05 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-1e57447b-d4b9-4fcc-8896-28c54d324b2a tempest-VolumeDependencyTests-1953610052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:02:05 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-1e57447b-d4b9-4fcc-8896-28c54d324b2a tempest-VolumeDependencyTests-1953610052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:02:05 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-1e57447b-d4b9-4fcc-8896-28c54d324b2a tempest-VolumeDependencyTests-1953610052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:02:05 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-1e57447b-d4b9-4fcc-8896-28c54d324b2a tempest-VolumeDependencyTests-1953610052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:02:05 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-1e57447b-d4b9-4fcc-8896-28c54d324b2a tempest-VolumeDependencyTests-1953610052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:02:05 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-1e57447b-d4b9-4fcc-8896-28c54d324b2a tempest-VolumeDependencyTests-1953610052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:02:05 devstack sudo[100570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:02:05 devstack sudo[100570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:02:05 devstack sudo[100567]: pam_unix(sudo:session): session closed for user root Jul 10 16:02:05 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8196b0bb-e8f8-43d5-b372-b2420e2ddeff tempest-VolumesActionsTest-9461107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload__y5n0hvn" returned: 0 in 0.737s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:02:05 devstack sudo[100570]: pam_unix(sudo:session): session closed for user root Jul 10 16:02:05 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-1e57447b-d4b9-4fcc-8896-28c54d324b2a tempest-VolumeDependencyTests-1953610052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.693s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:02:05 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-1e57447b-d4b9-4fcc-8896-28c54d324b2a tempest-VolumeDependencyTests-1953610052 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:02:05 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-1e57447b-d4b9-4fcc-8896-28c54d324b2a tempest-VolumeDependencyTests-1953610052 None] Deleted volume successfully. Jul 10 16:02:06 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-1e57447b-d4b9-4fcc-8896-28c54d324b2a tempest-VolumeDependencyTests-1953610052 None] Lock "cinder-8520c293-d0a8-4bda-a7f4-4c7e75f8bd36-delete_volume" released by "delete_volume" :: held 2.450s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:02:07 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-8196b0bb-e8f8-43d5-b372-b2420e2ddeff tempest-VolumesActionsTest-9461107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 12.183s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:02:07 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-8196b0bb-e8f8-43d5-b372-b2420e2ddeff tempest-VolumesActionsTest-9461107 None] Uploaded volume to glance image-id: 3ab72a71-6708-48f3-9c72-8a822e1ffbbe. {{(pid=87420) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 10 16:02:07 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-d36dd6a2-df13-499a-beab-8a004c74ba73 tempest-VolumesSnapshotNegativeTestJSON-1361038716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.464s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:02:07 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-d36dd6a2-df13-499a-beab-8a004c74ba73 tempest-VolumesSnapshotNegativeTestJSON-1361038716 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:01:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-184392496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49df9132-740e-461b-9749-247d5ad7369f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba91910596da4c968c47914e24455af3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:01:54Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:01:54Z,use_quota=True,user_id='af873af74ffc4527b7030ac80e81c513',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 16:02:07 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-d36dd6a2-df13-499a-beab-8a004c74ba73 tempest-VolumesSnapshotNegativeTestJSON-1361038716 None] Creating volume 49df9132-740e-461b-9749-247d5ad7369f {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 16:02:07 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-d36dd6a2-df13-499a-beab-8a004c74ba73 tempest-VolumesSnapshotNegativeTestJSON-1361038716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:02:07 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-d36dd6a2-df13-499a-beab-8a004c74ba73 tempest-VolumesSnapshotNegativeTestJSON-1361038716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:02:07 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-d36dd6a2-df13-499a-beab-8a004c74ba73 tempest-VolumesSnapshotNegativeTestJSON-1361038716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:02:07 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-d36dd6a2-df13-499a-beab-8a004c74ba73 tempest-VolumesSnapshotNegativeTestJSON-1361038716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:02:07 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-d36dd6a2-df13-499a-beab-8a004c74ba73 tempest-VolumesSnapshotNegativeTestJSON-1361038716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:02:07 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-d36dd6a2-df13-499a-beab-8a004c74ba73 tempest-VolumesSnapshotNegativeTestJSON-1361038716 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 16:02:07 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-d36dd6a2-df13-499a-beab-8a004c74ba73 tempest-VolumesSnapshotNegativeTestJSON-1361038716 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 16:02:07 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d36dd6a2-df13-499a-beab-8a004c74ba73 tempest-VolumesSnapshotNegativeTestJSON-1361038716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-49df9132-740e-461b-9749-247d5ad7369f 2147483648 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:02:07 devstack sudo[100576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-49df9132-740e-461b-9749-247d5ad7369f 2147483648 Jul 10 16:02:07 devstack sudo[100576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:02:07 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-8196b0bb-e8f8-43d5-b372-b2420e2ddeff tempest-VolumesActionsTest-9461107 None] Copy volume to image completed successfully. Jul 10 16:02:08 devstack sudo[100576]: pam_unix(sudo:session): session closed for user root Jul 10 16:02:08 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d36dd6a2-df13-499a-beab-8a004c74ba73 tempest-VolumesSnapshotNegativeTestJSON-1361038716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-49df9132-740e-461b-9749-247d5ad7369f 2147483648" returned: 0 in 1.111s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:02:08 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d36dd6a2-df13-499a-beab-8a004c74ba73 tempest-VolumesSnapshotNegativeTestJSON-1361038716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-49df9132-740e-461b-9749-247d5ad7369f {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:02:08 devstack sudo[100582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-49df9132-740e-461b-9749-247d5ad7369f Jul 10 16:02:08 devstack sudo[100582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:02:08 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-0bb07a7e-5f63-4aeb-af90-e53c0fc73180 tempest-VolumesActionsTest-9461107 None] Acquiring lock "cinder-3ffbabb0-4ce4-42a6-a34e-0fd7970b58b6-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:02:08 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-0bb07a7e-5f63-4aeb-af90-e53c0fc73180 tempest-VolumesActionsTest-9461107 None] Lock "cinder-3ffbabb0-4ce4-42a6-a34e-0fd7970b58b6-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:02:08 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-0bb07a7e-5f63-4aeb-af90-e53c0fc73180 tempest-VolumesActionsTest-9461107 None] Acquiring lock "cinder-quobyte-3ffbabb0-4ce4-42a6-a34e-0fd7970b58b6" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:02:08 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-0bb07a7e-5f63-4aeb-af90-e53c0fc73180 tempest-VolumesActionsTest-9461107 None] Lock "cinder-quobyte-3ffbabb0-4ce4-42a6-a34e-0fd7970b58b6" acquired by "delete_volume" :: waited 0.021s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:02:08 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c0a6b9-05f7-41b9-a3e7-01c6803396e1]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:02:08 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-0bb07a7e-5f63-4aeb-af90-e53c0fc73180 tempest-VolumesActionsTest-9461107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3ffbabb0-4ce4-42a6-a34e-0fd7970b58b6 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:02:08 devstack sudo[100584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3ffbabb0-4ce4-42a6-a34e-0fd7970b58b6 Jul 10 16:02:08 devstack sudo[100584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:02:09 devstack sudo[100582]: pam_unix(sudo:session): session closed for user root Jul 10 16:02:09 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d36dd6a2-df13-499a-beab-8a004c74ba73 tempest-VolumesSnapshotNegativeTestJSON-1361038716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-49df9132-740e-461b-9749-247d5ad7369f" returned: 0 in 0.846s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:02:09 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-d36dd6a2-df13-499a-beab-8a004c74ba73 tempest-VolumesSnapshotNegativeTestJSON-1361038716 None] <== create_volume: return (2005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 16:02:09 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-d36dd6a2-df13-499a-beab-8a004c74ba73 tempest-VolumesSnapshotNegativeTestJSON-1361038716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.009s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:02:09 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d36dd6a2-df13-499a-beab-8a004c74ba73 tempest-VolumesSnapshotNegativeTestJSON-1361038716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d9f6036-bf30-48f3-aa0b-c07aa39345c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49df9132-740e-461b-9749-247d5ad7369f', 'volume_size': 2}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:02:09 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d36dd6a2-df13-499a-beab-8a004c74ba73 tempest-VolumesSnapshotNegativeTestJSON-1361038716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (464b5249-c2d9-4065-9684-f8a8c20a462e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:02:09 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-d36dd6a2-df13-499a-beab-8a004c74ba73 tempest-VolumesSnapshotNegativeTestJSON-1361038716 None] Volume volume-49df9132-740e-461b-9749-247d5ad7369f (49df9132-740e-461b-9749-247d5ad7369f): created successfully Jul 10 16:02:09 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d36dd6a2-df13-499a-beab-8a004c74ba73 tempest-VolumesSnapshotNegativeTestJSON-1361038716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (464b5249-c2d9-4065-9684-f8a8c20a462e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:02:09 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d36dd6a2-df13-499a-beab-8a004c74ba73 tempest-VolumesSnapshotNegativeTestJSON-1361038716 None] Flow 'volume_create_manager' (6431cbf0-3a57-434a-94e4-0c9f04a50f6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:02:09 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-d36dd6a2-df13-499a-beab-8a004c74ba73 tempest-VolumesSnapshotNegativeTestJSON-1361038716 None] Created volume successfully. Jul 10 16:02:09 devstack sudo[100584]: pam_unix(sudo:session): session closed for user root Jul 10 16:02:09 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-0bb07a7e-5f63-4aeb-af90-e53c0fc73180 tempest-VolumesActionsTest-9461107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3ffbabb0-4ce4-42a6-a34e-0fd7970b58b6" returned: 0 in 0.891s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:02:09 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-0bb07a7e-5f63-4aeb-af90-e53c0fc73180 tempest-VolumesActionsTest-9461107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3ffbabb0-4ce4-42a6-a34e-0fd7970b58b6 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:02:09 devstack sudo[100593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3ffbabb0-4ce4-42a6-a34e-0fd7970b58b6 Jul 10 16:02:09 devstack sudo[100593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:02:09 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b77f0b2-feea-4b62-98d8-f6376b074cb1 tempest-ProjectReaderTests-1913780754 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 16:02:10 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-9b77f0b2-feea-4b62-98d8-f6376b074cb1 tempest-ProjectReaderTests-1913780754 None] Flow 'volume_create_manager' (f2f86534-9357-44c6-a485-2b8e4c97d704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:02:10 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-9b77f0b2-feea-4b62-98d8-f6376b074cb1 tempest-ProjectReaderTests-1913780754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e10cd0a9-ba80-4c3a-b06d-546570832b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:02:10 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-9b77f0b2-feea-4b62-98d8-f6376b074cb1 tempest-ProjectReaderTests-1913780754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e10cd0a9-ba80-4c3a-b06d-546570832b7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:02:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1887150963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7287da5c-a70b-4fb7-ace6-efa04a643951,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e082ec7c142a4f86a9d060c838340528',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:02:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:02:10Z,use_quota=True,user_id='b502110f3aeb4a8a82d2f5f8980fe04c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:02:10 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-9b77f0b2-feea-4b62-98d8-f6376b074cb1 tempest-ProjectReaderTests-1913780754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7a89a73-6e10-4e4d-af5f-1d8648e86422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:02:10 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-9b77f0b2-feea-4b62-98d8-f6376b074cb1 tempest-ProjectReaderTests-1913780754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7a89a73-6e10-4e4d-af5f-1d8648e86422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:02:10 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-9b77f0b2-feea-4b62-98d8-f6376b074cb1 tempest-ProjectReaderTests-1913780754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a36ed973-9809-4fee-bd70-65be58444091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:02:10 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-9b77f0b2-feea-4b62-98d8-f6376b074cb1 tempest-ProjectReaderTests-1913780754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a36ed973-9809-4fee-bd70-65be58444091) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7287da5c-a70b-4fb7-ace6-efa04a643951', 'volume_name': 'volume-7287da5c-a70b-4fb7-ace6-efa04a643951', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:02:10 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-9b77f0b2-feea-4b62-98d8-f6376b074cb1 tempest-ProjectReaderTests-1913780754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (743cd013-b67a-4ace-a16e-2c56b87b3dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:02:10 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-9b77f0b2-feea-4b62-98d8-f6376b074cb1 tempest-ProjectReaderTests-1913780754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (743cd013-b67a-4ace-a16e-2c56b87b3dd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:02:10 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-9b77f0b2-feea-4b62-98d8-f6376b074cb1 tempest-ProjectReaderTests-1913780754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77106b3d-e475-4fab-8df0-c713c4ecb1c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:02:10 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-9b77f0b2-feea-4b62-98d8-f6376b074cb1 tempest-ProjectReaderTests-1913780754 None] Volume 7287da5c-a70b-4fb7-ace6-efa04a643951: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7287da5c-a70b-4fb7-ace6-efa04a643951', 'volume_size': 1} Jul 10 16:02:10 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-9b77f0b2-feea-4b62-98d8-f6376b074cb1 tempest-ProjectReaderTests-1913780754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:02:10 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-9b77f0b2-feea-4b62-98d8-f6376b074cb1 tempest-ProjectReaderTests-1913780754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:02:10 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-9b77f0b2-feea-4b62-98d8-f6376b074cb1 tempest-ProjectReaderTests-1913780754 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:02:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1887150963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7287da5c-a70b-4fb7-ace6-efa04a643951,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e082ec7c142a4f86a9d060c838340528',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:02:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:02:10Z,use_quota=True,user_id='b502110f3aeb4a8a82d2f5f8980fe04c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 16:02:10 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-9b77f0b2-feea-4b62-98d8-f6376b074cb1 tempest-ProjectReaderTests-1913780754 None] Creating volume 7287da5c-a70b-4fb7-ace6-efa04a643951 {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 16:02:10 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-9b77f0b2-feea-4b62-98d8-f6376b074cb1 tempest-ProjectReaderTests-1913780754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:02:10 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-9b77f0b2-feea-4b62-98d8-f6376b074cb1 tempest-ProjectReaderTests-1913780754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:02:10 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-9b77f0b2-feea-4b62-98d8-f6376b074cb1 tempest-ProjectReaderTests-1913780754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:02:10 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-9b77f0b2-feea-4b62-98d8-f6376b074cb1 tempest-ProjectReaderTests-1913780754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:02:10 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-9b77f0b2-feea-4b62-98d8-f6376b074cb1 tempest-ProjectReaderTests-1913780754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:02:10 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-9b77f0b2-feea-4b62-98d8-f6376b074cb1 tempest-ProjectReaderTests-1913780754 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 16:02:10 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-9b77f0b2-feea-4b62-98d8-f6376b074cb1 tempest-ProjectReaderTests-1913780754 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 16:02:10 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-9b77f0b2-feea-4b62-98d8-f6376b074cb1 tempest-ProjectReaderTests-1913780754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7287da5c-a70b-4fb7-ace6-efa04a643951 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:02:10 devstack sudo[100595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7287da5c-a70b-4fb7-ace6-efa04a643951 1073741824 Jul 10 16:02:10 devstack sudo[100595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:02:10 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-2cceb81b-5d63-43bf-8ad0-23f8669157b1 tempest-VolumesSnapshotNegativeTestJSON-1361038716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:02:10 devstack sudo[100593]: pam_unix(sudo:session): session closed for user root Jul 10 16:02:10 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-0bb07a7e-5f63-4aeb-af90-e53c0fc73180 tempest-VolumesActionsTest-9461107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3ffbabb0-4ce4-42a6-a34e-0fd7970b58b6" returned: 0 in 0.862s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:02:10 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-0bb07a7e-5f63-4aeb-af90-e53c0fc73180 tempest-VolumesActionsTest-9461107 None] Lock "cinder-quobyte-3ffbabb0-4ce4-42a6-a34e-0fd7970b58b6" released by "delete_volume" :: held 1.793s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:02:10 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-0bb07a7e-5f63-4aeb-af90-e53c0fc73180 tempest-VolumesActionsTest-9461107 None] Created reservations ['dd61d422-c5b4-4684-8c82-42c94541ea6e', '7cd0e71d-41a1-4f62-b495-ef2a71602cc6', '2ec57baa-77f0-4326-ae47-4b1d708de737', '5cb4f5f4-0fe1-409a-b477-e8f0501bd987'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:02:10 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-0bb07a7e-5f63-4aeb-af90-e53c0fc73180 tempest-VolumesActionsTest-9461107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:02:10 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-0bb07a7e-5f63-4aeb-af90-e53c0fc73180 tempest-VolumesActionsTest-9461107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:02:10 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-0bb07a7e-5f63-4aeb-af90-e53c0fc73180 tempest-VolumesActionsTest-9461107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:02:10 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-0bb07a7e-5f63-4aeb-af90-e53c0fc73180 tempest-VolumesActionsTest-9461107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:02:10 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-0bb07a7e-5f63-4aeb-af90-e53c0fc73180 tempest-VolumesActionsTest-9461107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:02:10 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-0bb07a7e-5f63-4aeb-af90-e53c0fc73180 tempest-VolumesActionsTest-9461107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:02:10 devstack sudo[100598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:02:10 devstack sudo[100598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:02:11 devstack sudo[100595]: pam_unix(sudo:session): session closed for user root Jul 10 16:02:11 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-9b77f0b2-feea-4b62-98d8-f6376b074cb1 tempest-ProjectReaderTests-1913780754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7287da5c-a70b-4fb7-ace6-efa04a643951 1073741824" returned: 0 in 1.138s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:02:11 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-9b77f0b2-feea-4b62-98d8-f6376b074cb1 tempest-ProjectReaderTests-1913780754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7287da5c-a70b-4fb7-ace6-efa04a643951 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:02:11 devstack sudo[100598]: pam_unix(sudo:session): session closed for user root Jul 10 16:02:11 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-0bb07a7e-5f63-4aeb-af90-e53c0fc73180 tempest-VolumesActionsTest-9461107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.839s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:02:11 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-0bb07a7e-5f63-4aeb-af90-e53c0fc73180 tempest-VolumesActionsTest-9461107 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:02:11 devstack sudo[100605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7287da5c-a70b-4fb7-ace6-efa04a643951 Jul 10 16:02:11 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-0bb07a7e-5f63-4aeb-af90-e53c0fc73180 tempest-VolumesActionsTest-9461107 None] Deleted volume successfully. Jul 10 16:02:11 devstack sudo[100605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:02:11 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-0bb07a7e-5f63-4aeb-af90-e53c0fc73180 tempest-VolumesActionsTest-9461107 None] Lock "cinder-3ffbabb0-4ce4-42a6-a34e-0fd7970b58b6-delete_volume" released by "delete_volume" :: held 2.917s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:02:12 devstack sudo[100605]: pam_unix(sudo:session): session closed for user root Jul 10 16:02:12 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-9b77f0b2-feea-4b62-98d8-f6376b074cb1 tempest-ProjectReaderTests-1913780754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7287da5c-a70b-4fb7-ace6-efa04a643951" returned: 0 in 0.756s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:02:12 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-9b77f0b2-feea-4b62-98d8-f6376b074cb1 tempest-ProjectReaderTests-1913780754 None] <== create_volume: return (1947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 16:02:12 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-9b77f0b2-feea-4b62-98d8-f6376b074cb1 tempest-ProjectReaderTests-1913780754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.949s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:02:12 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-2cceb81b-5d63-43bf-8ad0-23f8669157b1 tempest-VolumesSnapshotNegativeTestJSON-1361038716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.893s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:02:12 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-2cceb81b-5d63-43bf-8ad0-23f8669157b1 tempest-VolumesSnapshotNegativeTestJSON-1361038716 None] Creating offline snapshot 98641ecb-0848-49af-8306-e0768815f7b3 of volume 49df9132-740e-461b-9749-247d5ad7369f {{(pid=87420) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 16:02:12 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-9b77f0b2-feea-4b62-98d8-f6376b074cb1 tempest-ProjectReaderTests-1913780754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77106b3d-e475-4fab-8df0-c713c4ecb1c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7287da5c-a70b-4fb7-ace6-efa04a643951', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:02:12 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-9b77f0b2-feea-4b62-98d8-f6376b074cb1 tempest-ProjectReaderTests-1913780754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88cac868-5d4e-463a-a7f5-f57ff7c24236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:02:12 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd745542-1493-4892-9ab7-a835e7be76fc]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:02:12 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-2cceb81b-5d63-43bf-8ad0-23f8669157b1 tempest-VolumesSnapshotNegativeTestJSON-1361038716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-49df9132-740e-461b-9749-247d5ad7369f {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:02:12 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-9b77f0b2-feea-4b62-98d8-f6376b074cb1 tempest-ProjectReaderTests-1913780754 None] Volume volume-7287da5c-a70b-4fb7-ace6-efa04a643951 (7287da5c-a70b-4fb7-ace6-efa04a643951): created successfully Jul 10 16:02:12 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-9b77f0b2-feea-4b62-98d8-f6376b074cb1 tempest-ProjectReaderTests-1913780754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88cac868-5d4e-463a-a7f5-f57ff7c24236) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:02:12 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-9b77f0b2-feea-4b62-98d8-f6376b074cb1 tempest-ProjectReaderTests-1913780754 None] Flow 'volume_create_manager' (f2f86534-9357-44c6-a485-2b8e4c97d704) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:02:12 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-9b77f0b2-feea-4b62-98d8-f6376b074cb1 tempest-ProjectReaderTests-1913780754 None] Created volume successfully. Jul 10 16:02:12 devstack sudo[100608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-49df9132-740e-461b-9749-247d5ad7369f Jul 10 16:02:12 devstack sudo[100608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:02:12 devstack sudo[100608]: pam_unix(sudo:session): session closed for user root Jul 10 16:02:12 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-2cceb81b-5d63-43bf-8ad0-23f8669157b1 tempest-VolumesSnapshotNegativeTestJSON-1361038716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-49df9132-740e-461b-9749-247d5ad7369f" returned: 0 in 0.786s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:02:12 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-2cceb81b-5d63-43bf-8ad0-23f8669157b1 tempest-VolumesSnapshotNegativeTestJSON-1361038716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-49df9132-740e-461b-9749-247d5ad7369f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-49df9132-740e-461b-9749-247d5ad7369f.98641ecb-0848-49af-8306-e0768815f7b3 2G {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:02:12 devstack sudo[100613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-49df9132-740e-461b-9749-247d5ad7369f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-49df9132-740e-461b-9749-247d5ad7369f.98641ecb-0848-49af-8306-e0768815f7b3 2G Jul 10 16:02:12 devstack sudo[100613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:02:13 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-082e3c6d-cc31-4eab-b0b8-907d7aeabfb9 tempest-ProjectReaderTests-1913780754 None] Acquiring lock "cinder-7287da5c-a70b-4fb7-ace6-efa04a643951-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:02:13 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-082e3c6d-cc31-4eab-b0b8-907d7aeabfb9 tempest-ProjectReaderTests-1913780754 None] Lock "cinder-7287da5c-a70b-4fb7-ace6-efa04a643951-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:02:13 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-082e3c6d-cc31-4eab-b0b8-907d7aeabfb9 tempest-ProjectReaderTests-1913780754 None] Acquiring lock "cinder-quobyte-7287da5c-a70b-4fb7-ace6-efa04a643951" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:02:13 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-082e3c6d-cc31-4eab-b0b8-907d7aeabfb9 tempest-ProjectReaderTests-1913780754 None] Lock "cinder-quobyte-7287da5c-a70b-4fb7-ace6-efa04a643951" acquired by "delete_volume" :: waited 0.022s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:02:13 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[24278ebb-131b-4bd2-ba12-376ca6824d15]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:02:13 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-082e3c6d-cc31-4eab-b0b8-907d7aeabfb9 tempest-ProjectReaderTests-1913780754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7287da5c-a70b-4fb7-ace6-efa04a643951 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:02:13 devstack sudo[100619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7287da5c-a70b-4fb7-ace6-efa04a643951 Jul 10 16:02:13 devstack sudo[100619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:02:13 devstack sudo[100613]: pam_unix(sudo:session): session closed for user root Jul 10 16:02:13 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-2cceb81b-5d63-43bf-8ad0-23f8669157b1 tempest-VolumesSnapshotNegativeTestJSON-1361038716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-49df9132-740e-461b-9749-247d5ad7369f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-49df9132-740e-461b-9749-247d5ad7369f.98641ecb-0848-49af-8306-e0768815f7b3 2G" returned: 0 in 0.954s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:02:13 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-2cceb81b-5d63-43bf-8ad0-23f8669157b1 tempest-VolumesSnapshotNegativeTestJSON-1361038716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49df9132-740e-461b-9749-247d5ad7369f -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-49df9132-740e-461b-9749-247d5ad7369f.98641ecb-0848-49af-8306-e0768815f7b3 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:02:13 devstack sudo[100622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49df9132-740e-461b-9749-247d5ad7369f -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-49df9132-740e-461b-9749-247d5ad7369f.98641ecb-0848-49af-8306-e0768815f7b3 Jul 10 16:02:13 devstack sudo[100622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:02:14 devstack sudo[100619]: pam_unix(sudo:session): session closed for user root Jul 10 16:02:14 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-082e3c6d-cc31-4eab-b0b8-907d7aeabfb9 tempest-ProjectReaderTests-1913780754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7287da5c-a70b-4fb7-ace6-efa04a643951" returned: 0 in 0.871s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:02:14 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-082e3c6d-cc31-4eab-b0b8-907d7aeabfb9 tempest-ProjectReaderTests-1913780754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7287da5c-a70b-4fb7-ace6-efa04a643951 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:02:14 devstack sudo[100628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7287da5c-a70b-4fb7-ace6-efa04a643951 Jul 10 16:02:14 devstack sudo[100628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:02:14 devstack sudo[100622]: pam_unix(sudo:session): session closed for user root Jul 10 16:02:14 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-2cceb81b-5d63-43bf-8ad0-23f8669157b1 tempest-VolumesSnapshotNegativeTestJSON-1361038716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49df9132-740e-461b-9749-247d5ad7369f -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-49df9132-740e-461b-9749-247d5ad7369f.98641ecb-0848-49af-8306-e0768815f7b3" returned: 0 in 0.915s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:02:14 devstack cinder-volume[87420]: WARNING cinder.volume.drivers.remotefs [None req-2cceb81b-5d63-43bf-8ad0-23f8669157b1 tempest-VolumesSnapshotNegativeTestJSON-1361038716 None] /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-49df9132-740e-461b-9749-247d5ad7369f.98641ecb-0848-49af-8306-e0768815f7b3 is being set with open permissions: ugo+rw Jul 10 16:02:14 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-2cceb81b-5d63-43bf-8ad0-23f8669157b1 tempest-VolumesSnapshotNegativeTestJSON-1361038716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-49df9132-740e-461b-9749-247d5ad7369f.98641ecb-0848-49af-8306-e0768815f7b3 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:02:14 devstack sudo[100633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-49df9132-740e-461b-9749-247d5ad7369f.98641ecb-0848-49af-8306-e0768815f7b3 Jul 10 16:02:14 devstack sudo[100633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:02:15 devstack sudo[100628]: pam_unix(sudo:session): session closed for user root Jul 10 16:02:15 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-082e3c6d-cc31-4eab-b0b8-907d7aeabfb9 tempest-ProjectReaderTests-1913780754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7287da5c-a70b-4fb7-ace6-efa04a643951" returned: 0 in 0.814s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:02:15 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-082e3c6d-cc31-4eab-b0b8-907d7aeabfb9 tempest-ProjectReaderTests-1913780754 None] Lock "cinder-quobyte-7287da5c-a70b-4fb7-ace6-efa04a643951" released by "delete_volume" :: held 1.729s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:02:15 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-082e3c6d-cc31-4eab-b0b8-907d7aeabfb9 tempest-ProjectReaderTests-1913780754 None] Created reservations ['f4d0c022-b2fd-4fd5-a979-512399af5365', '0c52513d-d60a-47ac-8cff-9088c8854142', 'acd214e2-6668-4e9b-8eb7-2567289a1ddd', 'bc5ef974-ef24-48a0-9e76-8e48cf9aa9c4'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:02:15 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-082e3c6d-cc31-4eab-b0b8-907d7aeabfb9 tempest-ProjectReaderTests-1913780754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:02:15 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-082e3c6d-cc31-4eab-b0b8-907d7aeabfb9 tempest-ProjectReaderTests-1913780754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:02:15 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-082e3c6d-cc31-4eab-b0b8-907d7aeabfb9 tempest-ProjectReaderTests-1913780754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:02:15 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-082e3c6d-cc31-4eab-b0b8-907d7aeabfb9 tempest-ProjectReaderTests-1913780754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:02:15 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-082e3c6d-cc31-4eab-b0b8-907d7aeabfb9 tempest-ProjectReaderTests-1913780754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:02:15 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-082e3c6d-cc31-4eab-b0b8-907d7aeabfb9 tempest-ProjectReaderTests-1913780754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:02:15 devstack sudo[100638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:02:15 devstack sudo[100638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:02:15 devstack sudo[100633]: pam_unix(sudo:session): session closed for user root Jul 10 16:02:15 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-2cceb81b-5d63-43bf-8ad0-23f8669157b1 tempest-VolumesSnapshotNegativeTestJSON-1361038716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-49df9132-740e-461b-9749-247d5ad7369f.98641ecb-0848-49af-8306-e0768815f7b3" returned: 0 in 0.821s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:02:15 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-2cceb81b-5d63-43bf-8ad0-23f8669157b1 tempest-VolumesSnapshotNegativeTestJSON-1361038716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-49df9132-740e-461b-9749-247d5ad7369f.info {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:02:15 devstack sudo[100640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-49df9132-740e-461b-9749-247d5ad7369f.info Jul 10 16:02:15 devstack sudo[100640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:02:16 devstack sudo[100638]: pam_unix(sudo:session): session closed for user root Jul 10 16:02:16 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-082e3c6d-cc31-4eab-b0b8-907d7aeabfb9 tempest-ProjectReaderTests-1913780754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.821s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:02:16 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-082e3c6d-cc31-4eab-b0b8-907d7aeabfb9 tempest-ProjectReaderTests-1913780754 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:02:16 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-082e3c6d-cc31-4eab-b0b8-907d7aeabfb9 tempest-ProjectReaderTests-1913780754 None] Deleted volume successfully. Jul 10 16:02:16 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-082e3c6d-cc31-4eab-b0b8-907d7aeabfb9 tempest-ProjectReaderTests-1913780754 None] Lock "cinder-7287da5c-a70b-4fb7-ace6-efa04a643951-delete_volume" released by "delete_volume" :: held 2.875s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:02:16 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5424d2e-0d87-49bd-bff6-6f9ce36315b0 tempest-ProjectReaderTests-1913780754 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 16:02:16 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f5424d2e-0d87-49bd-bff6-6f9ce36315b0 tempest-ProjectReaderTests-1913780754 None] Flow 'volume_create_manager' (5cd789ae-1759-4a9f-9f39-0084cda3e505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:02:16 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f5424d2e-0d87-49bd-bff6-6f9ce36315b0 tempest-ProjectReaderTests-1913780754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f93079c0-ec9e-422e-bd04-9e9ea51c90c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:02:16 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f5424d2e-0d87-49bd-bff6-6f9ce36315b0 tempest-ProjectReaderTests-1913780754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f93079c0-ec9e-422e-bd04-9e9ea51c90c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:02:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-150104634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96a071e1-e128-4b7a-a2ef-0e094305d538,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e082ec7c142a4f86a9d060c838340528',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:02:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:02:16Z,use_quota=True,user_id='b502110f3aeb4a8a82d2f5f8980fe04c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:02:16 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f5424d2e-0d87-49bd-bff6-6f9ce36315b0 tempest-ProjectReaderTests-1913780754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf81a5f9-62d0-4eda-b70d-b9cac859b468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:02:16 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f5424d2e-0d87-49bd-bff6-6f9ce36315b0 tempest-ProjectReaderTests-1913780754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf81a5f9-62d0-4eda-b70d-b9cac859b468) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:02:16 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f5424d2e-0d87-49bd-bff6-6f9ce36315b0 tempest-ProjectReaderTests-1913780754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cce657c-c888-4789-9cf9-6788b4ddc511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:02:16 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f5424d2e-0d87-49bd-bff6-6f9ce36315b0 tempest-ProjectReaderTests-1913780754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cce657c-c888-4789-9cf9-6788b4ddc511) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96a071e1-e128-4b7a-a2ef-0e094305d538', 'volume_name': 'volume-96a071e1-e128-4b7a-a2ef-0e094305d538', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:02:16 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f5424d2e-0d87-49bd-bff6-6f9ce36315b0 tempest-ProjectReaderTests-1913780754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (090c3808-4c87-4b2a-b786-0717dd265c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:02:16 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f5424d2e-0d87-49bd-bff6-6f9ce36315b0 tempest-ProjectReaderTests-1913780754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (090c3808-4c87-4b2a-b786-0717dd265c00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:02:16 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f5424d2e-0d87-49bd-bff6-6f9ce36315b0 tempest-ProjectReaderTests-1913780754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91ee6000-dc86-4273-9955-c1bdcca48817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:02:16 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-f5424d2e-0d87-49bd-bff6-6f9ce36315b0 tempest-ProjectReaderTests-1913780754 None] Volume 96a071e1-e128-4b7a-a2ef-0e094305d538: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96a071e1-e128-4b7a-a2ef-0e094305d538', 'volume_size': 1} Jul 10 16:02:16 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-f5424d2e-0d87-49bd-bff6-6f9ce36315b0 tempest-ProjectReaderTests-1913780754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:02:16 devstack sudo[100640]: pam_unix(sudo:session): session closed for user root Jul 10 16:02:16 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-2cceb81b-5d63-43bf-8ad0-23f8669157b1 tempest-VolumesSnapshotNegativeTestJSON-1361038716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-49df9132-740e-461b-9749-247d5ad7369f.info" returned: 0 in 0.874s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:02:16 devstack cinder-volume[87420]: WARNING cinder.volume.drivers.remotefs [None req-2cceb81b-5d63-43bf-8ad0-23f8669157b1 tempest-VolumesSnapshotNegativeTestJSON-1361038716 None] /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-49df9132-740e-461b-9749-247d5ad7369f.info is being set with open permissions: ugo+rw Jul 10 16:02:16 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-2cceb81b-5d63-43bf-8ad0-23f8669157b1 tempest-VolumesSnapshotNegativeTestJSON-1361038716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-49df9132-740e-461b-9749-247d5ad7369f.info {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:02:16 devstack sudo[100644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-49df9132-740e-461b-9749-247d5ad7369f.info Jul 10 16:02:16 devstack sudo[100644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:02:17 devstack sudo[100644]: pam_unix(sudo:session): session closed for user root Jul 10 16:02:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-2cceb81b-5d63-43bf-8ad0-23f8669157b1 tempest-VolumesSnapshotNegativeTestJSON-1361038716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-49df9132-740e-461b-9749-247d5ad7369f.info" returned: 0 in 0.654s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:02:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-2cceb81b-5d63-43bf-8ad0-23f8669157b1 tempest-VolumesSnapshotNegativeTestJSON-1361038716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.137s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:02:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-f5424d2e-0d87-49bd-bff6-6f9ce36315b0 tempest-ProjectReaderTests-1913780754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.685s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:02:17 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-f5424d2e-0d87-49bd-bff6-6f9ce36315b0 tempest-ProjectReaderTests-1913780754 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:02:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-150104634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96a071e1-e128-4b7a-a2ef-0e094305d538,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e082ec7c142a4f86a9d060c838340528',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:02:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:02:16Z,use_quota=True,user_id='b502110f3aeb4a8a82d2f5f8980fe04c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 16:02:17 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-f5424d2e-0d87-49bd-bff6-6f9ce36315b0 tempest-ProjectReaderTests-1913780754 None] Creating volume 96a071e1-e128-4b7a-a2ef-0e094305d538 {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 16:02:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-f5424d2e-0d87-49bd-bff6-6f9ce36315b0 tempest-ProjectReaderTests-1913780754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:02:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-f5424d2e-0d87-49bd-bff6-6f9ce36315b0 tempest-ProjectReaderTests-1913780754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:02:17 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-f5424d2e-0d87-49bd-bff6-6f9ce36315b0 tempest-ProjectReaderTests-1913780754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:02:17 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-f5424d2e-0d87-49bd-bff6-6f9ce36315b0 tempest-ProjectReaderTests-1913780754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:02:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-f5424d2e-0d87-49bd-bff6-6f9ce36315b0 tempest-ProjectReaderTests-1913780754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:02:17 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-f5424d2e-0d87-49bd-bff6-6f9ce36315b0 tempest-ProjectReaderTests-1913780754 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 16:02:17 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-f5424d2e-0d87-49bd-bff6-6f9ce36315b0 tempest-ProjectReaderTests-1913780754 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 16:02:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f5424d2e-0d87-49bd-bff6-6f9ce36315b0 tempest-ProjectReaderTests-1913780754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-96a071e1-e128-4b7a-a2ef-0e094305d538 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:02:17 devstack sudo[100647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-96a071e1-e128-4b7a-a2ef-0e094305d538 1073741824 Jul 10 16:02:17 devstack sudo[100647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:02:17 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-2cceb81b-5d63-43bf-8ad0-23f8669157b1 tempest-VolumesSnapshotNegativeTestJSON-1361038716 None] Create snapshot completed successfully Jul 10 16:02:17 devstack cinder-volume[87420]: DEBUG oslo_service.periodic_task [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87420) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 16:02:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:02:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:02:17 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:02:17 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:02:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:02:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:02:17 devstack sudo[100649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:02:17 devstack sudo[100649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:02:17 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-efdb1af8-8203-4686-a5a3-6f265a701484 tempest-VolumesSnapshotNegativeTestJSON-1361038716 None] Acquiring lock "cinder-98641ecb-0848-49af-8306-e0768815f7b3-delete_snapshot" by "delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:02:17 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-efdb1af8-8203-4686-a5a3-6f265a701484 tempest-VolumesSnapshotNegativeTestJSON-1361038716 None] Lock "cinder-98641ecb-0848-49af-8306-e0768815f7b3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:02:17 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-efdb1af8-8203-4686-a5a3-6f265a701484 tempest-VolumesSnapshotNegativeTestJSON-1361038716 None] Acquiring lock "cinder-quobyte-49df9132-740e-461b-9749-247d5ad7369f" by "delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:02:17 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-efdb1af8-8203-4686-a5a3-6f265a701484 tempest-VolumesSnapshotNegativeTestJSON-1361038716 None] Lock "cinder-quobyte-49df9132-740e-461b-9749-247d5ad7369f" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:02:17 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-efdb1af8-8203-4686-a5a3-6f265a701484 tempest-VolumesSnapshotNegativeTestJSON-1361038716 None] Acquiring lock "cinder-quobyte-98641ecb-0848-49af-8306-e0768815f7b3" by "_delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:02:17 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-efdb1af8-8203-4686-a5a3-6f265a701484 tempest-VolumesSnapshotNegativeTestJSON-1361038716 None] Lock "cinder-quobyte-98641ecb-0848-49af-8306-e0768815f7b3" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:02:17 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-efdb1af8-8203-4686-a5a3-6f265a701484 tempest-VolumesSnapshotNegativeTestJSON-1361038716 None] Deleting offline snapshot 98641ecb-0848-49af-8306-e0768815f7b3 of volume 49df9132-740e-461b-9749-247d5ad7369f {{(pid=87420) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 16:02:17 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-efdb1af8-8203-4686-a5a3-6f265a701484 tempest-VolumesSnapshotNegativeTestJSON-1361038716 None] snapshot_file for this snap is: volume-49df9132-740e-461b-9749-247d5ad7369f.98641ecb-0848-49af-8306-e0768815f7b3 {{(pid=87420) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 16:02:17 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[bffb848e-8c92-4f50-b0f8-6b2f7c1be1fd]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:02:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-efdb1af8-8203-4686-a5a3-6f265a701484 tempest-VolumesSnapshotNegativeTestJSON-1361038716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-49df9132-740e-461b-9749-247d5ad7369f.98641ecb-0848-49af-8306-e0768815f7b3 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:02:17 devstack sudo[100651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-49df9132-740e-461b-9749-247d5ad7369f.98641ecb-0848-49af-8306-e0768815f7b3 Jul 10 16:02:17 devstack sudo[100651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:02:18 devstack sudo[100647]: pam_unix(sudo:session): session closed for user root Jul 10 16:02:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f5424d2e-0d87-49bd-bff6-6f9ce36315b0 tempest-ProjectReaderTests-1913780754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-96a071e1-e128-4b7a-a2ef-0e094305d538 1073741824" returned: 0 in 1.007s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:02:18 devstack sudo[100649]: pam_unix(sudo:session): session closed for user root Jul 10 16:02:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.818s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:02:18 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:02:18 devstack cinder-volume[87420]: DEBUG oslo_service.periodic_task [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Running periodic task VolumeManager._thread_info {{(pid=87420) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 16:02:18 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] thread count: 29 {{(pid=87420) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 16:02:18 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] thread info: [<_MainThread(MainThread, started 133639250378880)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87420) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 16:02:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f5424d2e-0d87-49bd-bff6-6f9ce36315b0 tempest-ProjectReaderTests-1913780754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-96a071e1-e128-4b7a-a2ef-0e094305d538 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:02:18 devstack sudo[100658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-96a071e1-e128-4b7a-a2ef-0e094305d538 Jul 10 16:02:18 devstack sudo[100658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:02:18 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-078d6ff0-71bb-43d4-9a21-108715a019e5 tempest-VolumesCloneTest-57588304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 16:02:18 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-078d6ff0-71bb-43d4-9a21-108715a019e5 tempest-VolumesCloneTest-57588304 None] Flow 'volume_create_manager' (3000b04a-6184-4825-838d-7de88076993f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:02:18 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-078d6ff0-71bb-43d4-9a21-108715a019e5 tempest-VolumesCloneTest-57588304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5113af6f-a918-4b15-a636-c7e2a112c465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:02:18 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-078d6ff0-71bb-43d4-9a21-108715a019e5 tempest-VolumesCloneTest-57588304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5113af6f-a918-4b15-a636-c7e2a112c465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:02:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1664472019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75ec9296-7be7-4411-9e87-fe06607914d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4decf878fd074549b094049e1235c492',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:02:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:02:18Z,use_quota=True,user_id='afd0d64adb384754a526dd600ec092b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:02:18 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-078d6ff0-71bb-43d4-9a21-108715a019e5 tempest-VolumesCloneTest-57588304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8250c4c-28b0-463d-a469-0674fcbb89a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:02:18 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-078d6ff0-71bb-43d4-9a21-108715a019e5 tempest-VolumesCloneTest-57588304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8250c4c-28b0-463d-a469-0674fcbb89a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:02:18 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-078d6ff0-71bb-43d4-9a21-108715a019e5 tempest-VolumesCloneTest-57588304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cce90f48-1468-4d9d-a8bc-8f740d3e33c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:02:18 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-078d6ff0-71bb-43d4-9a21-108715a019e5 tempest-VolumesCloneTest-57588304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cce90f48-1468-4d9d-a8bc-8f740d3e33c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75ec9296-7be7-4411-9e87-fe06607914d2', 'volume_name': 'volume-75ec9296-7be7-4411-9e87-fe06607914d2', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:02:18 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-078d6ff0-71bb-43d4-9a21-108715a019e5 tempest-VolumesCloneTest-57588304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fae177c-c2ba-4724-8d7b-574708ceb225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:02:18 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-078d6ff0-71bb-43d4-9a21-108715a019e5 tempest-VolumesCloneTest-57588304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fae177c-c2ba-4724-8d7b-574708ceb225) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:02:18 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-078d6ff0-71bb-43d4-9a21-108715a019e5 tempest-VolumesCloneTest-57588304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (872b2294-92a7-4415-800f-fe72a9b8f109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:02:18 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-078d6ff0-71bb-43d4-9a21-108715a019e5 tempest-VolumesCloneTest-57588304 None] Volume 75ec9296-7be7-4411-9e87-fe06607914d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75ec9296-7be7-4411-9e87-fe06607914d2', 'volume_size': 1} Jul 10 16:02:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-078d6ff0-71bb-43d4-9a21-108715a019e5 tempest-VolumesCloneTest-57588304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:02:18 devstack sudo[100651]: pam_unix(sudo:session): session closed for user root Jul 10 16:02:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-efdb1af8-8203-4686-a5a3-6f265a701484 tempest-VolumesSnapshotNegativeTestJSON-1361038716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-49df9132-740e-461b-9749-247d5ad7369f.98641ecb-0848-49af-8306-e0768815f7b3" returned: 0 in 0.961s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:02:18 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-efdb1af8-8203-4686-a5a3-6f265a701484 tempest-VolumesSnapshotNegativeTestJSON-1361038716 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-49df9132-740e-461b-9749-247d5ad7369f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87420) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 16:02:18 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[82cb4320-e0c5-4688-af8a-486621b702fd]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:02:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-efdb1af8-8203-4686-a5a3-6f265a701484 tempest-VolumesSnapshotNegativeTestJSON-1361038716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-49df9132-740e-461b-9749-247d5ad7369f {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:02:18 devstack sudo[100663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-49df9132-740e-461b-9749-247d5ad7369f Jul 10 16:02:18 devstack sudo[100663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:02:18 devstack sudo[100658]: pam_unix(sudo:session): session closed for user root Jul 10 16:02:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f5424d2e-0d87-49bd-bff6-6f9ce36315b0 tempest-ProjectReaderTests-1913780754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-96a071e1-e128-4b7a-a2ef-0e094305d538" returned: 0 in 0.716s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:02:18 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-f5424d2e-0d87-49bd-bff6-6f9ce36315b0 tempest-ProjectReaderTests-1913780754 None] <== create_volume: return (1802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 16:02:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-f5424d2e-0d87-49bd-bff6-6f9ce36315b0 tempest-ProjectReaderTests-1913780754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.807s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:02:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-078d6ff0-71bb-43d4-9a21-108715a019e5 tempest-VolumesCloneTest-57588304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.471s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:02:18 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-078d6ff0-71bb-43d4-9a21-108715a019e5 tempest-VolumesCloneTest-57588304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:02:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1664472019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75ec9296-7be7-4411-9e87-fe06607914d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4decf878fd074549b094049e1235c492',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:02:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:02:18Z,use_quota=True,user_id='afd0d64adb384754a526dd600ec092b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 16:02:18 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-078d6ff0-71bb-43d4-9a21-108715a019e5 tempest-VolumesCloneTest-57588304 None] Creating volume 75ec9296-7be7-4411-9e87-fe06607914d2 {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 16:02:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-078d6ff0-71bb-43d4-9a21-108715a019e5 tempest-VolumesCloneTest-57588304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:02:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-078d6ff0-71bb-43d4-9a21-108715a019e5 tempest-VolumesCloneTest-57588304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:02:18 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-078d6ff0-71bb-43d4-9a21-108715a019e5 tempest-VolumesCloneTest-57588304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:02:18 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-078d6ff0-71bb-43d4-9a21-108715a019e5 tempest-VolumesCloneTest-57588304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:02:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-078d6ff0-71bb-43d4-9a21-108715a019e5 tempest-VolumesCloneTest-57588304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:02:18 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-078d6ff0-71bb-43d4-9a21-108715a019e5 tempest-VolumesCloneTest-57588304 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 16:02:18 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-078d6ff0-71bb-43d4-9a21-108715a019e5 tempest-VolumesCloneTest-57588304 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 16:02:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-078d6ff0-71bb-43d4-9a21-108715a019e5 tempest-VolumesCloneTest-57588304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-75ec9296-7be7-4411-9e87-fe06607914d2 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:02:19 devstack sudo[100666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-75ec9296-7be7-4411-9e87-fe06607914d2 1073741824 Jul 10 16:02:19 devstack sudo[100666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:02:19 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f5424d2e-0d87-49bd-bff6-6f9ce36315b0 tempest-ProjectReaderTests-1913780754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91ee6000-dc86-4273-9955-c1bdcca48817) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96a071e1-e128-4b7a-a2ef-0e094305d538', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:02:19 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f5424d2e-0d87-49bd-bff6-6f9ce36315b0 tempest-ProjectReaderTests-1913780754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bf3d8ba-6697-4722-9dfd-3a1bf8fd17a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:02:19 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-f5424d2e-0d87-49bd-bff6-6f9ce36315b0 tempest-ProjectReaderTests-1913780754 None] Volume volume-96a071e1-e128-4b7a-a2ef-0e094305d538 (96a071e1-e128-4b7a-a2ef-0e094305d538): created successfully Jul 10 16:02:19 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f5424d2e-0d87-49bd-bff6-6f9ce36315b0 tempest-ProjectReaderTests-1913780754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bf3d8ba-6697-4722-9dfd-3a1bf8fd17a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:02:19 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f5424d2e-0d87-49bd-bff6-6f9ce36315b0 tempest-ProjectReaderTests-1913780754 None] Flow 'volume_create_manager' (5cd789ae-1759-4a9f-9f39-0084cda3e505) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:02:19 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-f5424d2e-0d87-49bd-bff6-6f9ce36315b0 tempest-ProjectReaderTests-1913780754 None] Created volume successfully. Jul 10 16:02:19 devstack sudo[100663]: pam_unix(sudo:session): session closed for user root Jul 10 16:02:19 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-efdb1af8-8203-4686-a5a3-6f265a701484 tempest-VolumesSnapshotNegativeTestJSON-1361038716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-49df9132-740e-461b-9749-247d5ad7369f" returned: 0 in 0.831s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:02:19 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-efdb1af8-8203-4686-a5a3-6f265a701484 tempest-VolumesSnapshotNegativeTestJSON-1361038716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-49df9132-740e-461b-9749-247d5ad7369f.98641ecb-0848-49af-8306-e0768815f7b3 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:02:19 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-5b74f0bb-377f-4978-bfa0-de0e954559fa tempest-ProjectReaderTests-1913780754 None] Acquiring lock "cinder-96a071e1-e128-4b7a-a2ef-0e094305d538-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:02:19 devstack sudo[100671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-49df9132-740e-461b-9749-247d5ad7369f.98641ecb-0848-49af-8306-e0768815f7b3 Jul 10 16:02:19 devstack sudo[100671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:02:19 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-5b74f0bb-377f-4978-bfa0-de0e954559fa tempest-ProjectReaderTests-1913780754 None] Lock "cinder-96a071e1-e128-4b7a-a2ef-0e094305d538-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:02:19 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-5b74f0bb-377f-4978-bfa0-de0e954559fa tempest-ProjectReaderTests-1913780754 None] Acquiring lock "cinder-quobyte-96a071e1-e128-4b7a-a2ef-0e094305d538" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:02:19 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-5b74f0bb-377f-4978-bfa0-de0e954559fa tempest-ProjectReaderTests-1913780754 None] Lock "cinder-quobyte-96a071e1-e128-4b7a-a2ef-0e094305d538" acquired by "delete_volume" :: waited 0.018s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:02:19 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f55e041-073f-4d2f-9bfb-d487ba70b078]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:02:19 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-5b74f0bb-377f-4978-bfa0-de0e954559fa tempest-ProjectReaderTests-1913780754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-96a071e1-e128-4b7a-a2ef-0e094305d538 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:02:19 devstack sudo[100676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-96a071e1-e128-4b7a-a2ef-0e094305d538 Jul 10 16:02:19 devstack sudo[100676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:02:19 devstack sudo[100666]: pam_unix(sudo:session): session closed for user root Jul 10 16:02:19 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-078d6ff0-71bb-43d4-9a21-108715a019e5 tempest-VolumesCloneTest-57588304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-75ec9296-7be7-4411-9e87-fe06607914d2 1073741824" returned: 0 in 0.957s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:02:19 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-078d6ff0-71bb-43d4-9a21-108715a019e5 tempest-VolumesCloneTest-57588304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-75ec9296-7be7-4411-9e87-fe06607914d2 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:02:20 devstack sudo[100679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-75ec9296-7be7-4411-9e87-fe06607914d2 Jul 10 16:02:20 devstack sudo[100679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:02:20 devstack sudo[100671]: pam_unix(sudo:session): session closed for user root Jul 10 16:02:20 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-efdb1af8-8203-4686-a5a3-6f265a701484 tempest-VolumesSnapshotNegativeTestJSON-1361038716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-49df9132-740e-461b-9749-247d5ad7369f.98641ecb-0848-49af-8306-e0768815f7b3" returned: 0 in 0.864s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:02:20 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-efdb1af8-8203-4686-a5a3-6f265a701484 tempest-VolumesSnapshotNegativeTestJSON-1361038716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-49df9132-740e-461b-9749-247d5ad7369f.98641ecb-0848-49af-8306-e0768815f7b3 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:02:20 devstack sudo[100687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-49df9132-740e-461b-9749-247d5ad7369f.98641ecb-0848-49af-8306-e0768815f7b3 Jul 10 16:02:20 devstack sudo[100687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:02:20 devstack sudo[100676]: pam_unix(sudo:session): session closed for user root Jul 10 16:02:20 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-5b74f0bb-377f-4978-bfa0-de0e954559fa tempest-ProjectReaderTests-1913780754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-96a071e1-e128-4b7a-a2ef-0e094305d538" returned: 0 in 0.885s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:02:20 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-5b74f0bb-377f-4978-bfa0-de0e954559fa tempest-ProjectReaderTests-1913780754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-96a071e1-e128-4b7a-a2ef-0e094305d538 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:02:20 devstack sudo[100689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-96a071e1-e128-4b7a-a2ef-0e094305d538 Jul 10 16:02:20 devstack sudo[100689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:02:20 devstack sudo[100679]: pam_unix(sudo:session): session closed for user root Jul 10 16:02:20 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-078d6ff0-71bb-43d4-9a21-108715a019e5 tempest-VolumesCloneTest-57588304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-75ec9296-7be7-4411-9e87-fe06607914d2" returned: 0 in 0.717s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:02:20 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-078d6ff0-71bb-43d4-9a21-108715a019e5 tempest-VolumesCloneTest-57588304 None] <== create_volume: return (1727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 16:02:20 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-078d6ff0-71bb-43d4-9a21-108715a019e5 tempest-VolumesCloneTest-57588304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.730s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:02:20 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-078d6ff0-71bb-43d4-9a21-108715a019e5 tempest-VolumesCloneTest-57588304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (872b2294-92a7-4415-800f-fe72a9b8f109) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75ec9296-7be7-4411-9e87-fe06607914d2', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:02:20 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-078d6ff0-71bb-43d4-9a21-108715a019e5 tempest-VolumesCloneTest-57588304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fce056ce-12b4-4a0a-9dab-ac93f33aac87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:02:20 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-078d6ff0-71bb-43d4-9a21-108715a019e5 tempest-VolumesCloneTest-57588304 None] Volume volume-75ec9296-7be7-4411-9e87-fe06607914d2 (75ec9296-7be7-4411-9e87-fe06607914d2): created successfully Jul 10 16:02:20 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-078d6ff0-71bb-43d4-9a21-108715a019e5 tempest-VolumesCloneTest-57588304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fce056ce-12b4-4a0a-9dab-ac93f33aac87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:02:20 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-078d6ff0-71bb-43d4-9a21-108715a019e5 tempest-VolumesCloneTest-57588304 None] Flow 'volume_create_manager' (3000b04a-6184-4825-838d-7de88076993f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:02:20 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-078d6ff0-71bb-43d4-9a21-108715a019e5 tempest-VolumesCloneTest-57588304 None] Created volume successfully. Jul 10 16:02:21 devstack sudo[100687]: pam_unix(sudo:session): session closed for user root Jul 10 16:02:21 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-efdb1af8-8203-4686-a5a3-6f265a701484 tempest-VolumesSnapshotNegativeTestJSON-1361038716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-49df9132-740e-461b-9749-247d5ad7369f.98641ecb-0848-49af-8306-e0768815f7b3" returned: 0 in 0.695s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:02:21 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-efdb1af8-8203-4686-a5a3-6f265a701484 tempest-VolumesSnapshotNegativeTestJSON-1361038716 None] Lock "cinder-quobyte-98641ecb-0848-49af-8306-e0768815f7b3" released by "_delete_snapshot" :: held 3.469s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:02:21 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-efdb1af8-8203-4686-a5a3-6f265a701484 tempest-VolumesSnapshotNegativeTestJSON-1361038716 None] Lock "cinder-quobyte-49df9132-740e-461b-9749-247d5ad7369f" released by "delete_snapshot" :: held 3.504s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:02:21 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-efdb1af8-8203-4686-a5a3-6f265a701484 tempest-VolumesSnapshotNegativeTestJSON-1361038716 None] Created reservations ['5a25810e-1fa6-466d-a677-02f3edbbf4d1', 'fc7fb71e-fdc0-46fd-a188-ac3fba8dea9d', '0e90ebc1-e808-42cd-8516-966a12a3f656', 'b7ea99ea-db91-492f-b9b0-0b93ad1cef41'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:02:21 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-efdb1af8-8203-4686-a5a3-6f265a701484 tempest-VolumesSnapshotNegativeTestJSON-1361038716 None] Delete snapshot completed successfully. Jul 10 16:02:21 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-efdb1af8-8203-4686-a5a3-6f265a701484 tempest-VolumesSnapshotNegativeTestJSON-1361038716 None] Lock "cinder-98641ecb-0848-49af-8306-e0768815f7b3-delete_snapshot" released by "delete_snapshot" :: held 3.658s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:02:21 devstack sudo[100689]: pam_unix(sudo:session): session closed for user root Jul 10 16:02:21 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-5b74f0bb-377f-4978-bfa0-de0e954559fa tempest-ProjectReaderTests-1913780754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-96a071e1-e128-4b7a-a2ef-0e094305d538" returned: 0 in 0.733s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:02:21 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-5b74f0bb-377f-4978-bfa0-de0e954559fa tempest-ProjectReaderTests-1913780754 None] Lock "cinder-quobyte-96a071e1-e128-4b7a-a2ef-0e094305d538" released by "delete_volume" :: held 1.660s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:02:21 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-5b74f0bb-377f-4978-bfa0-de0e954559fa tempest-ProjectReaderTests-1913780754 None] Created reservations ['5811a8af-ecaf-48fe-b055-0f6f56f8c4c3', '74880ec8-82a8-4940-947b-447102909bac', 'bd39e27f-3be6-4a76-9ccd-e2f0e60da41d', '352b17a2-2854-4961-a7d4-067aedf91f1c'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:02:21 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-5b74f0bb-377f-4978-bfa0-de0e954559fa tempest-ProjectReaderTests-1913780754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:02:21 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-5b74f0bb-377f-4978-bfa0-de0e954559fa tempest-ProjectReaderTests-1913780754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:02:21 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-5b74f0bb-377f-4978-bfa0-de0e954559fa tempest-ProjectReaderTests-1913780754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:02:21 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-5b74f0bb-377f-4978-bfa0-de0e954559fa tempest-ProjectReaderTests-1913780754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:02:21 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-5b74f0bb-377f-4978-bfa0-de0e954559fa tempest-ProjectReaderTests-1913780754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:02:21 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-5b74f0bb-377f-4978-bfa0-de0e954559fa tempest-ProjectReaderTests-1913780754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:02:21 devstack sudo[100694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:02:21 devstack sudo[100694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:02:21 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-a2333768-5148-4053-b832-ba33926762fd tempest-VolumesSnapshotNegativeTestJSON-1361038716 None] Acquiring lock "cinder-49df9132-740e-461b-9749-247d5ad7369f-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:02:22 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-a2333768-5148-4053-b832-ba33926762fd tempest-VolumesSnapshotNegativeTestJSON-1361038716 None] Lock "cinder-49df9132-740e-461b-9749-247d5ad7369f-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:02:22 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-a2333768-5148-4053-b832-ba33926762fd tempest-VolumesSnapshotNegativeTestJSON-1361038716 None] Acquiring lock "cinder-quobyte-49df9132-740e-461b-9749-247d5ad7369f" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:02:22 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-a2333768-5148-4053-b832-ba33926762fd tempest-VolumesSnapshotNegativeTestJSON-1361038716 None] Lock "cinder-quobyte-49df9132-740e-461b-9749-247d5ad7369f" acquired by "delete_volume" :: waited 0.025s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:02:22 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[c83cc28c-df1b-4110-9753-4de471b1fa21]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:02:22 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a2333768-5148-4053-b832-ba33926762fd tempest-VolumesSnapshotNegativeTestJSON-1361038716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-49df9132-740e-461b-9749-247d5ad7369f {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:02:22 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1651186-a8c5-4656-85fe-6fb65b81d483 tempest-VolumesCloneTest-57588304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 16:02:22 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d1651186-a8c5-4656-85fe-6fb65b81d483 tempest-VolumesCloneTest-57588304 None] Flow 'volume_create_manager' (9997759d-70b1-4305-bb32-ea674790fc63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:02:22 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d1651186-a8c5-4656-85fe-6fb65b81d483 tempest-VolumesCloneTest-57588304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ae3bb97-0c48-4490-9e7e-ea3accffdd7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:02:22 devstack sudo[100694]: pam_unix(sudo:session): session closed for user root Jul 10 16:02:22 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d1651186-a8c5-4656-85fe-6fb65b81d483 tempest-VolumesCloneTest-57588304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ae3bb97-0c48-4490-9e7e-ea3accffdd7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:02:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2109483784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32c26c83-5488-470a-b073-c917d660402b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4decf878fd074549b094049e1235c492',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:02:22Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=75ec9296-7be7-4411-9e87-fe06607914d2,status='creating',terminated_at=None,updated_at=2026-07-10T14:02:22Z,use_quota=True,user_id='afd0d64adb384754a526dd600ec092b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:02:22 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d1651186-a8c5-4656-85fe-6fb65b81d483 tempest-VolumesCloneTest-57588304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec36fdd2-c87a-4710-83c9-acab450e7240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:02:22 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d1651186-a8c5-4656-85fe-6fb65b81d483 tempest-VolumesCloneTest-57588304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec36fdd2-c87a-4710-83c9-acab450e7240) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:02:22 devstack sudo[100698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-49df9132-740e-461b-9749-247d5ad7369f Jul 10 16:02:22 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d1651186-a8c5-4656-85fe-6fb65b81d483 tempest-VolumesCloneTest-57588304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2420801-06fb-49eb-82fe-3a80f8feb5ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:02:22 devstack sudo[100698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:02:22 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-5b74f0bb-377f-4978-bfa0-de0e954559fa tempest-ProjectReaderTests-1913780754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.877s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:02:22 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-5b74f0bb-377f-4978-bfa0-de0e954559fa tempest-ProjectReaderTests-1913780754 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:02:22 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-5b74f0bb-377f-4978-bfa0-de0e954559fa tempest-ProjectReaderTests-1913780754 None] Deleted volume successfully. Jul 10 16:02:22 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d1651186-a8c5-4656-85fe-6fb65b81d483 tempest-VolumesCloneTest-57588304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2420801-06fb-49eb-82fe-3a80f8feb5ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '32c26c83-5488-470a-b073-c917d660402b', 'volume_name': 'volume-32c26c83-5488-470a-b073-c917d660402b', 'volume_size': 2, 'source_volid': '75ec9296-7be7-4411-9e87-fe06607914d2', 'source_volstatus': 'available'}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:02:22 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d1651186-a8c5-4656-85fe-6fb65b81d483 tempest-VolumesCloneTest-57588304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c94e106-c670-4e9e-ab8a-aec607ce949f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:02:22 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d1651186-a8c5-4656-85fe-6fb65b81d483 tempest-VolumesCloneTest-57588304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c94e106-c670-4e9e-ab8a-aec607ce949f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:02:22 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d1651186-a8c5-4656-85fe-6fb65b81d483 tempest-VolumesCloneTest-57588304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc0ac151-c8c9-466c-bfdd-f56939ec0be9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:02:22 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-d1651186-a8c5-4656-85fe-6fb65b81d483 tempest-VolumesCloneTest-57588304 None] Volume 32c26c83-5488-470a-b073-c917d660402b: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-32c26c83-5488-470a-b073-c917d660402b', 'volume_size': 2, 'source_volid': '75ec9296-7be7-4411-9e87-fe06607914d2', 'source_volstatus': 'available'} Jul 10 16:02:22 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-5b74f0bb-377f-4978-bfa0-de0e954559fa tempest-ProjectReaderTests-1913780754 None] Lock "cinder-96a071e1-e128-4b7a-a2ef-0e094305d538-delete_volume" released by "delete_volume" :: held 2.786s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:02:22 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-d1651186-a8c5-4656-85fe-6fb65b81d483 tempest-VolumesCloneTest-57588304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:02:22 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-d1651186-a8c5-4656-85fe-6fb65b81d483 tempest-VolumesCloneTest-57588304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:02:22 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-d1651186-a8c5-4656-85fe-6fb65b81d483 tempest-VolumesCloneTest-57588304 None] Cloning volume 75ec9296-7be7-4411-9e87-fe06607914d2 to volume 32c26c83-5488-470a-b073-c917d660402b Jul 10 16:02:22 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-d1651186-a8c5-4656-85fe-6fb65b81d483 tempest-VolumesCloneTest-57588304 None] Creating offline snapshot 10c03a28-ae7c-4dc2-b56a-c5971811fdd1 of volume 75ec9296-7be7-4411-9e87-fe06607914d2 {{(pid=87420) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 16:02:22 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[0af6b5f3-9eb8-4a8f-a01a-27fd4e0de44f]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:02:22 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d1651186-a8c5-4656-85fe-6fb65b81d483 tempest-VolumesCloneTest-57588304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-75ec9296-7be7-4411-9e87-fe06607914d2 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:02:22 devstack sudo[100700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-75ec9296-7be7-4411-9e87-fe06607914d2 Jul 10 16:02:22 devstack sudo[100700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:02:23 devstack sudo[100698]: pam_unix(sudo:session): session closed for user root Jul 10 16:02:23 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a2333768-5148-4053-b832-ba33926762fd tempest-VolumesSnapshotNegativeTestJSON-1361038716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-49df9132-740e-461b-9749-247d5ad7369f" returned: 0 in 0.934s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:02:23 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a2333768-5148-4053-b832-ba33926762fd tempest-VolumesSnapshotNegativeTestJSON-1361038716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-49df9132-740e-461b-9749-247d5ad7369f {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:02:23 devstack sudo[100705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-49df9132-740e-461b-9749-247d5ad7369f Jul 10 16:02:23 devstack sudo[100705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:02:23 devstack sudo[100700]: pam_unix(sudo:session): session closed for user root Jul 10 16:02:23 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d1651186-a8c5-4656-85fe-6fb65b81d483 tempest-VolumesCloneTest-57588304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-75ec9296-7be7-4411-9e87-fe06607914d2" returned: 0 in 0.979s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:02:23 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d1651186-a8c5-4656-85fe-6fb65b81d483 tempest-VolumesCloneTest-57588304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-75ec9296-7be7-4411-9e87-fe06607914d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-75ec9296-7be7-4411-9e87-fe06607914d2.10c03a28-ae7c-4dc2-b56a-c5971811fdd1 1G {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:02:23 devstack sudo[100711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-75ec9296-7be7-4411-9e87-fe06607914d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-75ec9296-7be7-4411-9e87-fe06607914d2.10c03a28-ae7c-4dc2-b56a-c5971811fdd1 1G Jul 10 16:02:23 devstack sudo[100711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:02:23 devstack sudo[100705]: pam_unix(sudo:session): session closed for user root Jul 10 16:02:23 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a2333768-5148-4053-b832-ba33926762fd tempest-VolumesSnapshotNegativeTestJSON-1361038716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-49df9132-740e-461b-9749-247d5ad7369f" returned: 0 in 0.768s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:02:23 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-a2333768-5148-4053-b832-ba33926762fd tempest-VolumesSnapshotNegativeTestJSON-1361038716 None] Lock "cinder-quobyte-49df9132-740e-461b-9749-247d5ad7369f" released by "delete_volume" :: held 1.790s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:02:23 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-a2333768-5148-4053-b832-ba33926762fd tempest-VolumesSnapshotNegativeTestJSON-1361038716 None] Created reservations ['5c907161-7d68-4c04-989d-998537ab2117', '044b3c12-67fd-404c-a34f-7d58e9bcda33', 'bd4d6a7e-cc90-4628-b635-1374e7dbc8cf', '86e333af-8797-4326-9782-0f40fa36e79f'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:02:24 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-a2333768-5148-4053-b832-ba33926762fd tempest-VolumesSnapshotNegativeTestJSON-1361038716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:02:24 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-a2333768-5148-4053-b832-ba33926762fd tempest-VolumesSnapshotNegativeTestJSON-1361038716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:02:24 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-a2333768-5148-4053-b832-ba33926762fd tempest-VolumesSnapshotNegativeTestJSON-1361038716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:02:24 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-a2333768-5148-4053-b832-ba33926762fd tempest-VolumesSnapshotNegativeTestJSON-1361038716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:02:24 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-a2333768-5148-4053-b832-ba33926762fd tempest-VolumesSnapshotNegativeTestJSON-1361038716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:02:24 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a2333768-5148-4053-b832-ba33926762fd tempest-VolumesSnapshotNegativeTestJSON-1361038716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:02:24 devstack sudo[100714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:02:24 devstack sudo[100714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:02:24 devstack sudo[100711]: pam_unix(sudo:session): session closed for user root Jul 10 16:02:24 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d1651186-a8c5-4656-85fe-6fb65b81d483 tempest-VolumesCloneTest-57588304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-75ec9296-7be7-4411-9e87-fe06607914d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-75ec9296-7be7-4411-9e87-fe06607914d2.10c03a28-ae7c-4dc2-b56a-c5971811fdd1 1G" returned: 0 in 1.039s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:02:24 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d1651186-a8c5-4656-85fe-6fb65b81d483 tempest-VolumesCloneTest-57588304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75ec9296-7be7-4411-9e87-fe06607914d2 -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-75ec9296-7be7-4411-9e87-fe06607914d2.10c03a28-ae7c-4dc2-b56a-c5971811fdd1 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:02:24 devstack sudo[100722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75ec9296-7be7-4411-9e87-fe06607914d2 -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-75ec9296-7be7-4411-9e87-fe06607914d2.10c03a28-ae7c-4dc2-b56a-c5971811fdd1 Jul 10 16:02:24 devstack sudo[100722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:02:24 devstack sudo[100714]: pam_unix(sudo:session): session closed for user root Jul 10 16:02:24 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a2333768-5148-4053-b832-ba33926762fd tempest-VolumesSnapshotNegativeTestJSON-1361038716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.770s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:02:24 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-a2333768-5148-4053-b832-ba33926762fd tempest-VolumesSnapshotNegativeTestJSON-1361038716 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:02:24 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-a2333768-5148-4053-b832-ba33926762fd tempest-VolumesSnapshotNegativeTestJSON-1361038716 None] Deleted volume successfully. Jul 10 16:02:24 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-a2333768-5148-4053-b832-ba33926762fd tempest-VolumesSnapshotNegativeTestJSON-1361038716 None] Lock "cinder-49df9132-740e-461b-9749-247d5ad7369f-delete_volume" released by "delete_volume" :: held 2.831s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:02:25 devstack sudo[100722]: pam_unix(sudo:session): session closed for user root Jul 10 16:02:25 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d1651186-a8c5-4656-85fe-6fb65b81d483 tempest-VolumesCloneTest-57588304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75ec9296-7be7-4411-9e87-fe06607914d2 -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-75ec9296-7be7-4411-9e87-fe06607914d2.10c03a28-ae7c-4dc2-b56a-c5971811fdd1" returned: 0 in 0.837s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:02:25 devstack cinder-volume[87420]: WARNING cinder.volume.drivers.remotefs [None req-d1651186-a8c5-4656-85fe-6fb65b81d483 tempest-VolumesCloneTest-57588304 None] /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-75ec9296-7be7-4411-9e87-fe06607914d2.10c03a28-ae7c-4dc2-b56a-c5971811fdd1 is being set with open permissions: ugo+rw Jul 10 16:02:25 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d1651186-a8c5-4656-85fe-6fb65b81d483 tempest-VolumesCloneTest-57588304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-75ec9296-7be7-4411-9e87-fe06607914d2.10c03a28-ae7c-4dc2-b56a-c5971811fdd1 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:02:25 devstack sudo[100729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-75ec9296-7be7-4411-9e87-fe06607914d2.10c03a28-ae7c-4dc2-b56a-c5971811fdd1 Jul 10 16:02:25 devstack sudo[100729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:02:26 devstack sudo[100729]: pam_unix(sudo:session): session closed for user root Jul 10 16:02:26 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d1651186-a8c5-4656-85fe-6fb65b81d483 tempest-VolumesCloneTest-57588304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-75ec9296-7be7-4411-9e87-fe06607914d2.10c03a28-ae7c-4dc2-b56a-c5971811fdd1" returned: 0 in 0.724s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:02:26 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d1651186-a8c5-4656-85fe-6fb65b81d483 tempest-VolumesCloneTest-57588304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-75ec9296-7be7-4411-9e87-fe06607914d2.info {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:02:26 devstack sudo[100732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-75ec9296-7be7-4411-9e87-fe06607914d2.info Jul 10 16:02:26 devstack sudo[100732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:02:26 devstack sudo[100732]: pam_unix(sudo:session): session closed for user root Jul 10 16:02:26 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d1651186-a8c5-4656-85fe-6fb65b81d483 tempest-VolumesCloneTest-57588304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-75ec9296-7be7-4411-9e87-fe06607914d2.info" returned: 0 in 0.858s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:02:26 devstack cinder-volume[87420]: WARNING cinder.volume.drivers.remotefs [None req-d1651186-a8c5-4656-85fe-6fb65b81d483 tempest-VolumesCloneTest-57588304 None] /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-75ec9296-7be7-4411-9e87-fe06607914d2.info is being set with open permissions: ugo+rw Jul 10 16:02:26 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d1651186-a8c5-4656-85fe-6fb65b81d483 tempest-VolumesCloneTest-57588304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-75ec9296-7be7-4411-9e87-fe06607914d2.info {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:02:26 devstack sudo[100735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-75ec9296-7be7-4411-9e87-fe06607914d2.info Jul 10 16:02:26 devstack sudo[100735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:02:27 devstack sudo[100735]: pam_unix(sudo:session): session closed for user root Jul 10 16:02:27 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d1651186-a8c5-4656-85fe-6fb65b81d483 tempest-VolumesCloneTest-57588304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-75ec9296-7be7-4411-9e87-fe06607914d2.info" returned: 0 in 0.709s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:02:27 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-d1651186-a8c5-4656-85fe-6fb65b81d483 tempest-VolumesCloneTest-57588304 None] Acquiring lock "cinder-quobyte-32c26c83-5488-470a-b073-c917d660402b" by "_copy_volume_from_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:02:27 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-d1651186-a8c5-4656-85fe-6fb65b81d483 tempest-VolumesCloneTest-57588304 None] Lock "cinder-quobyte-32c26c83-5488-470a-b073-c917d660402b" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:02:27 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-d1651186-a8c5-4656-85fe-6fb65b81d483 tempest-VolumesCloneTest-57588304 None] snapshot: 10c03a28-ae7c-4dc2-b56a-c5971811fdd1, volume: 32c26c83-5488-470a-b073-c917d660402b, {{(pid=87420) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 16:02:27 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-d1651186-a8c5-4656-85fe-6fb65b81d483 tempest-VolumesCloneTest-57588304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:02:27 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-d1651186-a8c5-4656-85fe-6fb65b81d483 tempest-VolumesCloneTest-57588304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:02:27 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-d1651186-a8c5-4656-85fe-6fb65b81d483 tempest-VolumesCloneTest-57588304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:02:27 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-d1651186-a8c5-4656-85fe-6fb65b81d483 tempest-VolumesCloneTest-57588304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:02:27 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-d1651186-a8c5-4656-85fe-6fb65b81d483 tempest-VolumesCloneTest-57588304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:02:27 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[5448fed8-ec18-4661-88c4-8b7059779438]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:02:27 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d1651186-a8c5-4656-85fe-6fb65b81d483 tempest-VolumesCloneTest-57588304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-75ec9296-7be7-4411-9e87-fe06607914d2.10c03a28-ae7c-4dc2-b56a-c5971811fdd1 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:02:27 devstack sudo[100738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-75ec9296-7be7-4411-9e87-fe06607914d2.10c03a28-ae7c-4dc2-b56a-c5971811fdd1 Jul 10 16:02:27 devstack sudo[100738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:02:28 devstack sudo[100738]: pam_unix(sudo:session): session closed for user root Jul 10 16:02:28 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d1651186-a8c5-4656-85fe-6fb65b81d483 tempest-VolumesCloneTest-57588304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-75ec9296-7be7-4411-9e87-fe06607914d2.10c03a28-ae7c-4dc2-b56a-c5971811fdd1" returned: 0 in 0.952s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:02:28 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-d1651186-a8c5-4656-85fe-6fb65b81d483 tempest-VolumesCloneTest-57588304 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-75ec9296-7be7-4411-9e87-fe06607914d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87420) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 16:02:28 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-d1651186-a8c5-4656-85fe-6fb65b81d483 tempest-VolumesCloneTest-57588304 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-75ec9296-7be7-4411-9e87-fe06607914d2 {{(pid=87420) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 16:02:28 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-d1651186-a8c5-4656-85fe-6fb65b81d483 tempest-VolumesCloneTest-57588304 None] Creating direct copy from snapshot {{(pid=87420) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 16:02:28 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe94eb5c-59dd-44b5-9095-3d65cce2b456]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:02:28 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d1651186-a8c5-4656-85fe-6fb65b81d483 tempest-VolumesCloneTest-57588304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-75ec9296-7be7-4411-9e87-fe06607914d2 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:02:28 devstack sudo[100744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-75ec9296-7be7-4411-9e87-fe06607914d2 Jul 10 16:02:28 devstack sudo[100744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:02:29 devstack sudo[100744]: pam_unix(sudo:session): session closed for user root Jul 10 16:02:29 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d1651186-a8c5-4656-85fe-6fb65b81d483 tempest-VolumesCloneTest-57588304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-75ec9296-7be7-4411-9e87-fe06607914d2" returned: 0 in 0.861s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:02:29 devstack cinder-volume[87420]: DEBUG cinder.utils [None req-d1651186-a8c5-4656-85fe-6fb65b81d483 tempest-VolumesCloneTest-57588304 None] Path /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-32c26c83-5488-470a-b073-c917d660402b not found in is_blk_device check {{(pid=87420) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 16:02:29 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d1651186-a8c5-4656-85fe-6fb65b81d483 tempest-VolumesCloneTest-57588304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-75ec9296-7be7-4411-9e87-fe06607914d2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-32c26c83-5488-470a-b073-c917d660402b {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:02:29 devstack sudo[100750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-75ec9296-7be7-4411-9e87-fe06607914d2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-32c26c83-5488-470a-b073-c917d660402b Jul 10 16:02:29 devstack sudo[100750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:02:36 devstack sudo[100750]: pam_unix(sudo:session): session closed for user root Jul 10 16:02:36 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d1651186-a8c5-4656-85fe-6fb65b81d483 tempest-VolumesCloneTest-57588304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-75ec9296-7be7-4411-9e87-fe06607914d2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-32c26c83-5488-470a-b073-c917d660402b" returned: 0 in 6.466s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:02:36 devstack cinder-volume[87420]: DEBUG dbcounter [-] [87420] Writing DB stats cinder:UPDATE=94,cinder:SELECT=62,cinder:INSERT=21,cinder:DELETE=10 {{(pid=87420) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 16:02:36 devstack cinder-volume[87420]: DEBUG dbcounter [-] [87420] Writing DB stats cinder:SELECT=68,cinder:INSERT=22,cinder:UPDATE=74,cinder:DELETE=3 {{(pid=87420) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 16:02:36 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[9690692c-22cd-410a-b377-f994b2788708]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:02:36 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d1651186-a8c5-4656-85fe-6fb65b81d483 tempest-VolumesCloneTest-57588304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-75ec9296-7be7-4411-9e87-fe06607914d2 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:02:36 devstack sudo[100800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-75ec9296-7be7-4411-9e87-fe06607914d2 Jul 10 16:02:36 devstack sudo[100800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:02:37 devstack sudo[100800]: pam_unix(sudo:session): session closed for user root Jul 10 16:02:37 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d1651186-a8c5-4656-85fe-6fb65b81d483 tempest-VolumesCloneTest-57588304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-75ec9296-7be7-4411-9e87-fe06607914d2" returned: 0 in 1.148s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:02:37 devstack cinder-volume[87420]: DEBUG cinder.image.image_utils [None req-d1651186-a8c5-4656-85fe-6fb65b81d483 tempest-VolumesCloneTest-57588304 None] Image conversion details: src /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-75ec9296-7be7-4411-9e87-fe06607914d2, size 1024.00 MB, duration 6.47 sec, destination /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-32c26c83-5488-470a-b073-c917d660402b {{(pid=87420) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 16:02:37 devstack cinder-volume[87420]: INFO cinder.image.image_utils [None req-d1651186-a8c5-4656-85fe-6fb65b81d483 tempest-VolumesCloneTest-57588304 None] Converted 1024.00 MB image at 158.34 MB/s Jul 10 16:02:37 devstack cinder-volume[87420]: WARNING cinder.volume.drivers.remotefs [None req-d1651186-a8c5-4656-85fe-6fb65b81d483 tempest-VolumesCloneTest-57588304 None] /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-32c26c83-5488-470a-b073-c917d660402b is being set with open permissions: ugo+rw Jul 10 16:02:37 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d1651186-a8c5-4656-85fe-6fb65b81d483 tempest-VolumesCloneTest-57588304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-32c26c83-5488-470a-b073-c917d660402b {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:02:37 devstack sudo[100805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-32c26c83-5488-470a-b073-c917d660402b Jul 10 16:02:37 devstack sudo[100805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:02:38 devstack sudo[100805]: pam_unix(sudo:session): session closed for user root Jul 10 16:02:38 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d1651186-a8c5-4656-85fe-6fb65b81d483 tempest-VolumesCloneTest-57588304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-32c26c83-5488-470a-b073-c917d660402b" returned: 0 in 0.810s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:02:38 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-d1651186-a8c5-4656-85fe-6fb65b81d483 tempest-VolumesCloneTest-57588304 None] Lock "cinder-quobyte-32c26c83-5488-470a-b073-c917d660402b" released by "_copy_volume_from_snapshot" :: held 10.357s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:02:38 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-d1651186-a8c5-4656-85fe-6fb65b81d483 tempest-VolumesCloneTest-57588304 None] Acquiring lock "cinder-quobyte-10c03a28-ae7c-4dc2-b56a-c5971811fdd1" by "_delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:02:38 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-d1651186-a8c5-4656-85fe-6fb65b81d483 tempest-VolumesCloneTest-57588304 None] Lock "cinder-quobyte-10c03a28-ae7c-4dc2-b56a-c5971811fdd1" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:02:38 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-d1651186-a8c5-4656-85fe-6fb65b81d483 tempest-VolumesCloneTest-57588304 None] Deleting offline snapshot 10c03a28-ae7c-4dc2-b56a-c5971811fdd1 of volume 75ec9296-7be7-4411-9e87-fe06607914d2 {{(pid=87420) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 16:02:38 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-d1651186-a8c5-4656-85fe-6fb65b81d483 tempest-VolumesCloneTest-57588304 None] snapshot_file for this snap is: volume-75ec9296-7be7-4411-9e87-fe06607914d2.10c03a28-ae7c-4dc2-b56a-c5971811fdd1 {{(pid=87420) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 16:02:38 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[453b2c1e-617c-4099-883b-a3ca35ebc2b8]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:02:38 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d1651186-a8c5-4656-85fe-6fb65b81d483 tempest-VolumesCloneTest-57588304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-75ec9296-7be7-4411-9e87-fe06607914d2.10c03a28-ae7c-4dc2-b56a-c5971811fdd1 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:02:38 devstack sudo[100808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-75ec9296-7be7-4411-9e87-fe06607914d2.10c03a28-ae7c-4dc2-b56a-c5971811fdd1 Jul 10 16:02:38 devstack sudo[100808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:02:39 devstack sudo[100808]: pam_unix(sudo:session): session closed for user root Jul 10 16:02:39 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d1651186-a8c5-4656-85fe-6fb65b81d483 tempest-VolumesCloneTest-57588304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-75ec9296-7be7-4411-9e87-fe06607914d2.10c03a28-ae7c-4dc2-b56a-c5971811fdd1" returned: 0 in 1.001s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:02:39 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-d1651186-a8c5-4656-85fe-6fb65b81d483 tempest-VolumesCloneTest-57588304 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-75ec9296-7be7-4411-9e87-fe06607914d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87420) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 16:02:39 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5e14fe8-6f1d-4854-a3a3-228f08fc50e0]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:02:39 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d1651186-a8c5-4656-85fe-6fb65b81d483 tempest-VolumesCloneTest-57588304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-75ec9296-7be7-4411-9e87-fe06607914d2 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:02:39 devstack sudo[100813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-75ec9296-7be7-4411-9e87-fe06607914d2 Jul 10 16:02:39 devstack sudo[100813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:02:40 devstack sudo[100813]: pam_unix(sudo:session): session closed for user root Jul 10 16:02:40 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d1651186-a8c5-4656-85fe-6fb65b81d483 tempest-VolumesCloneTest-57588304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-75ec9296-7be7-4411-9e87-fe06607914d2" returned: 0 in 1.075s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:02:40 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d1651186-a8c5-4656-85fe-6fb65b81d483 tempest-VolumesCloneTest-57588304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-75ec9296-7be7-4411-9e87-fe06607914d2.10c03a28-ae7c-4dc2-b56a-c5971811fdd1 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:02:40 devstack sudo[100818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-75ec9296-7be7-4411-9e87-fe06607914d2.10c03a28-ae7c-4dc2-b56a-c5971811fdd1 Jul 10 16:02:40 devstack sudo[100818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:02:41 devstack sudo[100818]: pam_unix(sudo:session): session closed for user root Jul 10 16:02:41 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d1651186-a8c5-4656-85fe-6fb65b81d483 tempest-VolumesCloneTest-57588304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-75ec9296-7be7-4411-9e87-fe06607914d2.10c03a28-ae7c-4dc2-b56a-c5971811fdd1" returned: 0 in 0.862s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:02:41 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d1651186-a8c5-4656-85fe-6fb65b81d483 tempest-VolumesCloneTest-57588304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-75ec9296-7be7-4411-9e87-fe06607914d2.10c03a28-ae7c-4dc2-b56a-c5971811fdd1 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:02:41 devstack sudo[100823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-75ec9296-7be7-4411-9e87-fe06607914d2.10c03a28-ae7c-4dc2-b56a-c5971811fdd1 Jul 10 16:02:41 devstack sudo[100823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:02:41 devstack sudo[100823]: pam_unix(sudo:session): session closed for user root Jul 10 16:02:41 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d1651186-a8c5-4656-85fe-6fb65b81d483 tempest-VolumesCloneTest-57588304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-75ec9296-7be7-4411-9e87-fe06607914d2.10c03a28-ae7c-4dc2-b56a-c5971811fdd1" returned: 0 in 0.806s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:02:41 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-d1651186-a8c5-4656-85fe-6fb65b81d483 tempest-VolumesCloneTest-57588304 None] Lock "cinder-quobyte-10c03a28-ae7c-4dc2-b56a-c5971811fdd1" released by "_delete_snapshot" :: held 3.892s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:02:42 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-d1651186-a8c5-4656-85fe-6fb65b81d483 tempest-VolumesCloneTest-57588304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 19.658s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:02:42 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d1651186-a8c5-4656-85fe-6fb65b81d483 tempest-VolumesCloneTest-57588304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc0ac151-c8c9-466c-bfdd-f56939ec0be9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32c26c83-5488-470a-b073-c917d660402b', 'volume_size': 2, 'source_volid': '75ec9296-7be7-4411-9e87-fe06607914d2', 'source_volstatus': 'available'}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:02:42 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d1651186-a8c5-4656-85fe-6fb65b81d483 tempest-VolumesCloneTest-57588304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (895d9d18-a16e-4944-8c5e-4439cd854639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:02:42 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-d1651186-a8c5-4656-85fe-6fb65b81d483 tempest-VolumesCloneTest-57588304 None] Volume volume-32c26c83-5488-470a-b073-c917d660402b (32c26c83-5488-470a-b073-c917d660402b): created successfully Jul 10 16:02:42 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d1651186-a8c5-4656-85fe-6fb65b81d483 tempest-VolumesCloneTest-57588304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (895d9d18-a16e-4944-8c5e-4439cd854639) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:02:42 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d1651186-a8c5-4656-85fe-6fb65b81d483 tempest-VolumesCloneTest-57588304 None] Flow 'volume_create_manager' (9997759d-70b1-4305-bb32-ea674790fc63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:02:42 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-d1651186-a8c5-4656-85fe-6fb65b81d483 tempest-VolumesCloneTest-57588304 None] Created volume successfully. Jul 10 16:02:43 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-8cff5340-ac41-4d51-ba1d-468349712ac1 tempest-VolumesCloneTest-57588304 None] Acquiring lock "cinder-32c26c83-5488-470a-b073-c917d660402b-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:02:43 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-8cff5340-ac41-4d51-ba1d-468349712ac1 tempest-VolumesCloneTest-57588304 None] Lock "cinder-32c26c83-5488-470a-b073-c917d660402b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:02:43 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-8cff5340-ac41-4d51-ba1d-468349712ac1 tempest-VolumesCloneTest-57588304 None] Acquiring lock "cinder-quobyte-32c26c83-5488-470a-b073-c917d660402b" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:02:43 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-8cff5340-ac41-4d51-ba1d-468349712ac1 tempest-VolumesCloneTest-57588304 None] Lock "cinder-quobyte-32c26c83-5488-470a-b073-c917d660402b" acquired by "delete_volume" :: waited 0.018s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:02:43 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[af75a02b-3de6-4140-8a05-9d4928d60d1a]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:02:43 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8cff5340-ac41-4d51-ba1d-468349712ac1 tempest-VolumesCloneTest-57588304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-32c26c83-5488-470a-b073-c917d660402b {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:02:43 devstack sudo[100827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-32c26c83-5488-470a-b073-c917d660402b Jul 10 16:02:43 devstack sudo[100827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:02:44 devstack sudo[100827]: pam_unix(sudo:session): session closed for user root Jul 10 16:02:44 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8cff5340-ac41-4d51-ba1d-468349712ac1 tempest-VolumesCloneTest-57588304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-32c26c83-5488-470a-b073-c917d660402b" returned: 0 in 0.879s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:02:44 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8cff5340-ac41-4d51-ba1d-468349712ac1 tempest-VolumesCloneTest-57588304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-32c26c83-5488-470a-b073-c917d660402b {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:02:44 devstack sudo[100833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-32c26c83-5488-470a-b073-c917d660402b Jul 10 16:02:44 devstack sudo[100833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:02:45 devstack sudo[100833]: pam_unix(sudo:session): session closed for user root Jul 10 16:02:45 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8cff5340-ac41-4d51-ba1d-468349712ac1 tempest-VolumesCloneTest-57588304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-32c26c83-5488-470a-b073-c917d660402b" returned: 0 in 0.711s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:02:45 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-8cff5340-ac41-4d51-ba1d-468349712ac1 tempest-VolumesCloneTest-57588304 None] Lock "cinder-quobyte-32c26c83-5488-470a-b073-c917d660402b" released by "delete_volume" :: held 1.648s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:02:45 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-8cff5340-ac41-4d51-ba1d-468349712ac1 tempest-VolumesCloneTest-57588304 None] Created reservations ['51dc2dc2-59f3-46a2-b9df-229106b48b1d', 'bbe6f8f0-fa10-41e7-9b05-20142e933f6e', 'c08c6718-cd6f-46ad-8c67-bee66b0828b7', '9d38a8f1-581c-4e7d-ba22-594fa0d6661c'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:02:45 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-8cff5340-ac41-4d51-ba1d-468349712ac1 tempest-VolumesCloneTest-57588304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:02:45 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-8cff5340-ac41-4d51-ba1d-468349712ac1 tempest-VolumesCloneTest-57588304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:02:45 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-8cff5340-ac41-4d51-ba1d-468349712ac1 tempest-VolumesCloneTest-57588304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:02:45 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-8cff5340-ac41-4d51-ba1d-468349712ac1 tempest-VolumesCloneTest-57588304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:02:45 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-8cff5340-ac41-4d51-ba1d-468349712ac1 tempest-VolumesCloneTest-57588304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:02:45 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8cff5340-ac41-4d51-ba1d-468349712ac1 tempest-VolumesCloneTest-57588304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:02:45 devstack sudo[100837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:02:45 devstack sudo[100837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:02:45 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-e8e2bce6-b425-47a7-8311-64764f77b494 tempest-VolumesCloneTest-57588304 None] Acquiring lock "cinder-75ec9296-7be7-4411-9e87-fe06607914d2-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:02:45 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-e8e2bce6-b425-47a7-8311-64764f77b494 tempest-VolumesCloneTest-57588304 None] Lock "cinder-75ec9296-7be7-4411-9e87-fe06607914d2-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:02:45 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-e8e2bce6-b425-47a7-8311-64764f77b494 tempest-VolumesCloneTest-57588304 None] Acquiring lock "cinder-quobyte-75ec9296-7be7-4411-9e87-fe06607914d2" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:02:45 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-e8e2bce6-b425-47a7-8311-64764f77b494 tempest-VolumesCloneTest-57588304 None] Lock "cinder-quobyte-75ec9296-7be7-4411-9e87-fe06607914d2" acquired by "delete_volume" :: waited 0.022s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:02:46 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[591d8f50-ed1c-422f-a214-da75966dea19]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:02:46 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-e8e2bce6-b425-47a7-8311-64764f77b494 tempest-VolumesCloneTest-57588304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-75ec9296-7be7-4411-9e87-fe06607914d2 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:02:46 devstack sudo[100844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-75ec9296-7be7-4411-9e87-fe06607914d2 Jul 10 16:02:46 devstack sudo[100844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:02:46 devstack sudo[100837]: pam_unix(sudo:session): session closed for user root Jul 10 16:02:46 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8cff5340-ac41-4d51-ba1d-468349712ac1 tempest-VolumesCloneTest-57588304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 1.002s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:02:46 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-8cff5340-ac41-4d51-ba1d-468349712ac1 tempest-VolumesCloneTest-57588304 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:02:46 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-8cff5340-ac41-4d51-ba1d-468349712ac1 tempest-VolumesCloneTest-57588304 None] Deleted volume successfully. Jul 10 16:02:46 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-8cff5340-ac41-4d51-ba1d-468349712ac1 tempest-VolumesCloneTest-57588304 None] Lock "cinder-32c26c83-5488-470a-b073-c917d660402b-delete_volume" released by "delete_volume" :: held 2.977s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:02:46 devstack sudo[100844]: pam_unix(sudo:session): session closed for user root Jul 10 16:02:46 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-e8e2bce6-b425-47a7-8311-64764f77b494 tempest-VolumesCloneTest-57588304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-75ec9296-7be7-4411-9e87-fe06607914d2" returned: 0 in 0.851s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:02:46 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-e8e2bce6-b425-47a7-8311-64764f77b494 tempest-VolumesCloneTest-57588304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-75ec9296-7be7-4411-9e87-fe06607914d2 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:02:46 devstack sudo[100850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-75ec9296-7be7-4411-9e87-fe06607914d2 Jul 10 16:02:46 devstack sudo[100850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:02:47 devstack sudo[100850]: pam_unix(sudo:session): session closed for user root Jul 10 16:02:47 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-e8e2bce6-b425-47a7-8311-64764f77b494 tempest-VolumesCloneTest-57588304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-75ec9296-7be7-4411-9e87-fe06607914d2" returned: 0 in 0.791s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:02:47 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-e8e2bce6-b425-47a7-8311-64764f77b494 tempest-VolumesCloneTest-57588304 None] Lock "cinder-quobyte-75ec9296-7be7-4411-9e87-fe06607914d2" released by "delete_volume" :: held 1.756s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:02:47 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-e8e2bce6-b425-47a7-8311-64764f77b494 tempest-VolumesCloneTest-57588304 None] Created reservations ['7a4107ba-ee94-4b0b-931e-5e85085c12a0', '7ebb2648-f458-44a0-961a-3522ff17658a', '75bb8d7e-5e8b-4ee4-baee-808dafa49aab', '5a11f501-178e-4402-8b32-32662839e170'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:02:47 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-e8e2bce6-b425-47a7-8311-64764f77b494 tempest-VolumesCloneTest-57588304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:02:47 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-e8e2bce6-b425-47a7-8311-64764f77b494 tempest-VolumesCloneTest-57588304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:02:47 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-e8e2bce6-b425-47a7-8311-64764f77b494 tempest-VolumesCloneTest-57588304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:02:47 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-e8e2bce6-b425-47a7-8311-64764f77b494 tempest-VolumesCloneTest-57588304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:02:47 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-e8e2bce6-b425-47a7-8311-64764f77b494 tempest-VolumesCloneTest-57588304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:02:47 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-e8e2bce6-b425-47a7-8311-64764f77b494 tempest-VolumesCloneTest-57588304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:02:47 devstack sudo[100853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:02:47 devstack sudo[100853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:02:48 devstack sudo[100853]: pam_unix(sudo:session): session closed for user root Jul 10 16:02:48 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-e8e2bce6-b425-47a7-8311-64764f77b494 tempest-VolumesCloneTest-57588304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.833s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:02:48 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-e8e2bce6-b425-47a7-8311-64764f77b494 tempest-VolumesCloneTest-57588304 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:02:48 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-e8e2bce6-b425-47a7-8311-64764f77b494 tempest-VolumesCloneTest-57588304 None] Deleted volume successfully. Jul 10 16:02:48 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-e8e2bce6-b425-47a7-8311-64764f77b494 tempest-VolumesCloneTest-57588304 None] Lock "cinder-75ec9296-7be7-4411-9e87-fe06607914d2-delete_volume" released by "delete_volume" :: held 2.890s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:02:57 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f08d582-5a41-4ef1-8f88-e3ecb30a9f8b tempest-SnapshotDependencyTests-546132345 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 16:02:57 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-9f08d582-5a41-4ef1-8f88-e3ecb30a9f8b tempest-SnapshotDependencyTests-546132345 None] Flow 'volume_create_manager' (cd0e8c90-b2db-4e8f-b9d6-199055eb5289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:02:57 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-9f08d582-5a41-4ef1-8f88-e3ecb30a9f8b tempest-SnapshotDependencyTests-546132345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (814f0608-d686-4c58-abd1-5c38558a6482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:02:58 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-9f08d582-5a41-4ef1-8f88-e3ecb30a9f8b tempest-SnapshotDependencyTests-546132345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (814f0608-d686-4c58-abd1-5c38558a6482) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:02:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-754912369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9ee5627-0bad-4c48-92ff-ad44ea82f806,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a26e419f38c5419b8a0e10e7ecc93d8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:02:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:02:58Z,use_quota=True,user_id='bdc51de524564eb381ea951af6164c35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:02:58 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-9f08d582-5a41-4ef1-8f88-e3ecb30a9f8b tempest-SnapshotDependencyTests-546132345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b9b5e39-6b0f-4869-94a7-6403db70cd84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:02:58 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-9f08d582-5a41-4ef1-8f88-e3ecb30a9f8b tempest-SnapshotDependencyTests-546132345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b9b5e39-6b0f-4869-94a7-6403db70cd84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:02:58 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-9f08d582-5a41-4ef1-8f88-e3ecb30a9f8b tempest-SnapshotDependencyTests-546132345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75a655f9-0034-4d08-9d09-9ca1bd6ebfde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:02:58 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-9f08d582-5a41-4ef1-8f88-e3ecb30a9f8b tempest-SnapshotDependencyTests-546132345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75a655f9-0034-4d08-9d09-9ca1bd6ebfde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9ee5627-0bad-4c48-92ff-ad44ea82f806', 'volume_name': 'volume-b9ee5627-0bad-4c48-92ff-ad44ea82f806', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:02:58 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-9f08d582-5a41-4ef1-8f88-e3ecb30a9f8b tempest-SnapshotDependencyTests-546132345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c40d8ef1-a595-401a-8c2f-b9136608f106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:02:58 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-9f08d582-5a41-4ef1-8f88-e3ecb30a9f8b tempest-SnapshotDependencyTests-546132345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c40d8ef1-a595-401a-8c2f-b9136608f106) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:02:58 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-9f08d582-5a41-4ef1-8f88-e3ecb30a9f8b tempest-SnapshotDependencyTests-546132345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (281a1369-1834-425f-87a8-0ffee93e4537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:02:58 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-9f08d582-5a41-4ef1-8f88-e3ecb30a9f8b tempest-SnapshotDependencyTests-546132345 None] Volume b9ee5627-0bad-4c48-92ff-ad44ea82f806: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9ee5627-0bad-4c48-92ff-ad44ea82f806', 'volume_size': 1} Jul 10 16:02:58 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-9f08d582-5a41-4ef1-8f88-e3ecb30a9f8b tempest-SnapshotDependencyTests-546132345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:02:58 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-9f08d582-5a41-4ef1-8f88-e3ecb30a9f8b tempest-SnapshotDependencyTests-546132345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:02:58 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-9f08d582-5a41-4ef1-8f88-e3ecb30a9f8b tempest-SnapshotDependencyTests-546132345 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:02:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-754912369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9ee5627-0bad-4c48-92ff-ad44ea82f806,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a26e419f38c5419b8a0e10e7ecc93d8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:02:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:02:58Z,use_quota=True,user_id='bdc51de524564eb381ea951af6164c35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 16:02:58 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-9f08d582-5a41-4ef1-8f88-e3ecb30a9f8b tempest-SnapshotDependencyTests-546132345 None] Creating volume b9ee5627-0bad-4c48-92ff-ad44ea82f806 {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 16:02:58 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-9f08d582-5a41-4ef1-8f88-e3ecb30a9f8b tempest-SnapshotDependencyTests-546132345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:02:58 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-9f08d582-5a41-4ef1-8f88-e3ecb30a9f8b tempest-SnapshotDependencyTests-546132345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:02:58 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-9f08d582-5a41-4ef1-8f88-e3ecb30a9f8b tempest-SnapshotDependencyTests-546132345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:02:58 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-9f08d582-5a41-4ef1-8f88-e3ecb30a9f8b tempest-SnapshotDependencyTests-546132345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:02:58 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-9f08d582-5a41-4ef1-8f88-e3ecb30a9f8b tempest-SnapshotDependencyTests-546132345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:02:58 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-9f08d582-5a41-4ef1-8f88-e3ecb30a9f8b tempest-SnapshotDependencyTests-546132345 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 16:02:58 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-9f08d582-5a41-4ef1-8f88-e3ecb30a9f8b tempest-SnapshotDependencyTests-546132345 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 16:02:58 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-9f08d582-5a41-4ef1-8f88-e3ecb30a9f8b tempest-SnapshotDependencyTests-546132345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b9ee5627-0bad-4c48-92ff-ad44ea82f806 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:02:58 devstack sudo[100858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b9ee5627-0bad-4c48-92ff-ad44ea82f806 1073741824 Jul 10 16:02:58 devstack sudo[100858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:02:59 devstack sudo[100858]: pam_unix(sudo:session): session closed for user root Jul 10 16:02:59 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-9f08d582-5a41-4ef1-8f88-e3ecb30a9f8b tempest-SnapshotDependencyTests-546132345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b9ee5627-0bad-4c48-92ff-ad44ea82f806 1073741824" returned: 0 in 1.053s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:02:59 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-9f08d582-5a41-4ef1-8f88-e3ecb30a9f8b tempest-SnapshotDependencyTests-546132345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b9ee5627-0bad-4c48-92ff-ad44ea82f806 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:02:59 devstack sudo[100867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b9ee5627-0bad-4c48-92ff-ad44ea82f806 Jul 10 16:02:59 devstack sudo[100867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:02:59 devstack sudo[100867]: pam_unix(sudo:session): session closed for user root Jul 10 16:02:59 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-9f08d582-5a41-4ef1-8f88-e3ecb30a9f8b tempest-SnapshotDependencyTests-546132345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b9ee5627-0bad-4c48-92ff-ad44ea82f806" returned: 0 in 0.727s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:02:59 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-9f08d582-5a41-4ef1-8f88-e3ecb30a9f8b tempest-SnapshotDependencyTests-546132345 None] <== create_volume: return (1834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 16:02:59 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-9f08d582-5a41-4ef1-8f88-e3ecb30a9f8b tempest-SnapshotDependencyTests-546132345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.837s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:02:59 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-9f08d582-5a41-4ef1-8f88-e3ecb30a9f8b tempest-SnapshotDependencyTests-546132345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (281a1369-1834-425f-87a8-0ffee93e4537) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9ee5627-0bad-4c48-92ff-ad44ea82f806', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:02:59 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-9f08d582-5a41-4ef1-8f88-e3ecb30a9f8b tempest-SnapshotDependencyTests-546132345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f9c6cb9-5f1f-43f1-b437-b28a97b22144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:02:59 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-9f08d582-5a41-4ef1-8f88-e3ecb30a9f8b tempest-SnapshotDependencyTests-546132345 None] Volume volume-b9ee5627-0bad-4c48-92ff-ad44ea82f806 (b9ee5627-0bad-4c48-92ff-ad44ea82f806): created successfully Jul 10 16:02:59 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-9f08d582-5a41-4ef1-8f88-e3ecb30a9f8b tempest-SnapshotDependencyTests-546132345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f9c6cb9-5f1f-43f1-b437-b28a97b22144) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:02:59 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-9f08d582-5a41-4ef1-8f88-e3ecb30a9f8b tempest-SnapshotDependencyTests-546132345 None] Flow 'volume_create_manager' (cd0e8c90-b2db-4e8f-b9d6-199055eb5289) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:02:59 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-9f08d582-5a41-4ef1-8f88-e3ecb30a9f8b tempest-SnapshotDependencyTests-546132345 None] Created volume successfully. Jul 10 16:03:01 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-36b2f708-b467-461c-84ca-7b80d9269f78 tempest-SnapshotDependencyTests-546132345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:03:01 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-36b2f708-b467-461c-84ca-7b80d9269f78 tempest-SnapshotDependencyTests-546132345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:03:01 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-36b2f708-b467-461c-84ca-7b80d9269f78 tempest-SnapshotDependencyTests-546132345 None] Creating offline snapshot b993078b-907a-4048-ad10-9a156ffd168d of volume b9ee5627-0bad-4c48-92ff-ad44ea82f806 {{(pid=87420) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 16:03:01 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[63cb21ba-d8de-4797-9abe-dbf7c3ef794c]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:03:01 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-36b2f708-b467-461c-84ca-7b80d9269f78 tempest-SnapshotDependencyTests-546132345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b9ee5627-0bad-4c48-92ff-ad44ea82f806 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:03:01 devstack sudo[100870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b9ee5627-0bad-4c48-92ff-ad44ea82f806 Jul 10 16:03:01 devstack sudo[100870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:03:02 devstack sudo[100870]: pam_unix(sudo:session): session closed for user root Jul 10 16:03:02 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-36b2f708-b467-461c-84ca-7b80d9269f78 tempest-SnapshotDependencyTests-546132345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b9ee5627-0bad-4c48-92ff-ad44ea82f806" returned: 0 in 0.930s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:03:02 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-36b2f708-b467-461c-84ca-7b80d9269f78 tempest-SnapshotDependencyTests-546132345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b9ee5627-0bad-4c48-92ff-ad44ea82f806,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b9ee5627-0bad-4c48-92ff-ad44ea82f806.b993078b-907a-4048-ad10-9a156ffd168d 1G {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:03:02 devstack sudo[100875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b9ee5627-0bad-4c48-92ff-ad44ea82f806,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b9ee5627-0bad-4c48-92ff-ad44ea82f806.b993078b-907a-4048-ad10-9a156ffd168d 1G Jul 10 16:03:02 devstack sudo[100875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:03:03 devstack sudo[100875]: pam_unix(sudo:session): session closed for user root Jul 10 16:03:03 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-36b2f708-b467-461c-84ca-7b80d9269f78 tempest-SnapshotDependencyTests-546132345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b9ee5627-0bad-4c48-92ff-ad44ea82f806,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b9ee5627-0bad-4c48-92ff-ad44ea82f806.b993078b-907a-4048-ad10-9a156ffd168d 1G" returned: 0 in 0.897s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:03:03 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-36b2f708-b467-461c-84ca-7b80d9269f78 tempest-SnapshotDependencyTests-546132345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9ee5627-0bad-4c48-92ff-ad44ea82f806 -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b9ee5627-0bad-4c48-92ff-ad44ea82f806.b993078b-907a-4048-ad10-9a156ffd168d {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:03:03 devstack sudo[100881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9ee5627-0bad-4c48-92ff-ad44ea82f806 -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b9ee5627-0bad-4c48-92ff-ad44ea82f806.b993078b-907a-4048-ad10-9a156ffd168d Jul 10 16:03:03 devstack sudo[100881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:03:03 devstack sudo[100881]: pam_unix(sudo:session): session closed for user root Jul 10 16:03:03 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-36b2f708-b467-461c-84ca-7b80d9269f78 tempest-SnapshotDependencyTests-546132345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9ee5627-0bad-4c48-92ff-ad44ea82f806 -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b9ee5627-0bad-4c48-92ff-ad44ea82f806.b993078b-907a-4048-ad10-9a156ffd168d" returned: 0 in 0.727s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:03:03 devstack cinder-volume[87420]: WARNING cinder.volume.drivers.remotefs [None req-36b2f708-b467-461c-84ca-7b80d9269f78 tempest-SnapshotDependencyTests-546132345 None] /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b9ee5627-0bad-4c48-92ff-ad44ea82f806.b993078b-907a-4048-ad10-9a156ffd168d is being set with open permissions: ugo+rw Jul 10 16:03:03 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-36b2f708-b467-461c-84ca-7b80d9269f78 tempest-SnapshotDependencyTests-546132345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b9ee5627-0bad-4c48-92ff-ad44ea82f806.b993078b-907a-4048-ad10-9a156ffd168d {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:03:03 devstack sudo[100886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b9ee5627-0bad-4c48-92ff-ad44ea82f806.b993078b-907a-4048-ad10-9a156ffd168d Jul 10 16:03:03 devstack sudo[100886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:03:04 devstack sudo[100886]: pam_unix(sudo:session): session closed for user root Jul 10 16:03:04 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-36b2f708-b467-461c-84ca-7b80d9269f78 tempest-SnapshotDependencyTests-546132345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b9ee5627-0bad-4c48-92ff-ad44ea82f806.b993078b-907a-4048-ad10-9a156ffd168d" returned: 0 in 0.738s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:03:04 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-36b2f708-b467-461c-84ca-7b80d9269f78 tempest-SnapshotDependencyTests-546132345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b9ee5627-0bad-4c48-92ff-ad44ea82f806.info {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:03:04 devstack sudo[100889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b9ee5627-0bad-4c48-92ff-ad44ea82f806.info Jul 10 16:03:04 devstack sudo[100889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:03:05 devstack sudo[100889]: pam_unix(sudo:session): session closed for user root Jul 10 16:03:05 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-36b2f708-b467-461c-84ca-7b80d9269f78 tempest-SnapshotDependencyTests-546132345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b9ee5627-0bad-4c48-92ff-ad44ea82f806.info" returned: 0 in 0.857s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:03:05 devstack cinder-volume[87420]: WARNING cinder.volume.drivers.remotefs [None req-36b2f708-b467-461c-84ca-7b80d9269f78 tempest-SnapshotDependencyTests-546132345 None] /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b9ee5627-0bad-4c48-92ff-ad44ea82f806.info is being set with open permissions: ugo+rw Jul 10 16:03:05 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-36b2f708-b467-461c-84ca-7b80d9269f78 tempest-SnapshotDependencyTests-546132345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b9ee5627-0bad-4c48-92ff-ad44ea82f806.info {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:03:05 devstack sudo[100892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b9ee5627-0bad-4c48-92ff-ad44ea82f806.info Jul 10 16:03:05 devstack sudo[100892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:03:06 devstack sudo[100892]: pam_unix(sudo:session): session closed for user root Jul 10 16:03:06 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-36b2f708-b467-461c-84ca-7b80d9269f78 tempest-SnapshotDependencyTests-546132345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b9ee5627-0bad-4c48-92ff-ad44ea82f806.info" returned: 0 in 0.836s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:03:06 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-36b2f708-b467-461c-84ca-7b80d9269f78 tempest-SnapshotDependencyTests-546132345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.122s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:03:06 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-36b2f708-b467-461c-84ca-7b80d9269f78 tempest-SnapshotDependencyTests-546132345 None] Create snapshot completed successfully Jul 10 16:03:08 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-5809e966-ebec-415e-a2fc-57ed8522cd59 tempest-SnapshotDependencyTests-546132345 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 16:03:08 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-5809e966-ebec-415e-a2fc-57ed8522cd59 tempest-SnapshotDependencyTests-546132345 None] Flow 'volume_create_manager' (9bbdf8ff-4671-4fab-927c-9f9aa9174682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:03:08 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-5809e966-ebec-415e-a2fc-57ed8522cd59 tempest-SnapshotDependencyTests-546132345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a746d1d-7dde-4599-b811-4eda8eef6668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:03:08 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-5809e966-ebec-415e-a2fc-57ed8522cd59 tempest-SnapshotDependencyTests-546132345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a746d1d-7dde-4599-b811-4eda8eef6668) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:03:08Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9879c6a-ca3d-4134-ac0e-ad1c688ff919,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a26e419f38c5419b8a0e10e7ecc93d8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:03:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b993078b-907a-4048-ad10-9a156ffd168d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:03:08Z,use_quota=True,user_id='bdc51de524564eb381ea951af6164c35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:03:08 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-5809e966-ebec-415e-a2fc-57ed8522cd59 tempest-SnapshotDependencyTests-546132345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83f08e99-d7a5-4fe5-a0a9-53707566b78b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:03:08 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-5809e966-ebec-415e-a2fc-57ed8522cd59 tempest-SnapshotDependencyTests-546132345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83f08e99-d7a5-4fe5-a0a9-53707566b78b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:03:08 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-5809e966-ebec-415e-a2fc-57ed8522cd59 tempest-SnapshotDependencyTests-546132345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d348ed0-26fe-4178-8a76-45fb21d1a1cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:03:08 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-5809e966-ebec-415e-a2fc-57ed8522cd59 tempest-SnapshotDependencyTests-546132345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d348ed0-26fe-4178-8a76-45fb21d1a1cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b9879c6a-ca3d-4134-ac0e-ad1c688ff919', 'volume_name': 'volume-b9879c6a-ca3d-4134-ac0e-ad1c688ff919', 'volume_size': 1, 'snapshot_id': 'b993078b-907a-4048-ad10-9a156ffd168d'}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:03:08 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-5809e966-ebec-415e-a2fc-57ed8522cd59 tempest-SnapshotDependencyTests-546132345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03242f22-3b98-469a-bbcb-354fe432c4e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:03:08 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-5809e966-ebec-415e-a2fc-57ed8522cd59 tempest-SnapshotDependencyTests-546132345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03242f22-3b98-469a-bbcb-354fe432c4e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:03:08 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-5809e966-ebec-415e-a2fc-57ed8522cd59 tempest-SnapshotDependencyTests-546132345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31df55f2-ec5f-48be-88b5-2fe98f99d2d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:03:08 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-5809e966-ebec-415e-a2fc-57ed8522cd59 tempest-SnapshotDependencyTests-546132345 None] Volume b9879c6a-ca3d-4134-ac0e-ad1c688ff919: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b9879c6a-ca3d-4134-ac0e-ad1c688ff919', 'volume_size': 1, 'snapshot_id': 'b993078b-907a-4048-ad10-9a156ffd168d'} Jul 10 16:03:08 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-5809e966-ebec-415e-a2fc-57ed8522cd59 tempest-SnapshotDependencyTests-546132345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:03:08 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-5809e966-ebec-415e-a2fc-57ed8522cd59 tempest-SnapshotDependencyTests-546132345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:03:08 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-5809e966-ebec-415e-a2fc-57ed8522cd59 tempest-SnapshotDependencyTests-546132345 None] Acquiring lock "cinder-quobyte-b993078b-907a-4048-ad10-9a156ffd168d-b9879c6a-ca3d-4134-ac0e-ad1c688ff919" by "_create_volume_from_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:03:08 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-5809e966-ebec-415e-a2fc-57ed8522cd59 tempest-SnapshotDependencyTests-546132345 None] Lock "cinder-quobyte-b993078b-907a-4048-ad10-9a156ffd168d-b9879c6a-ca3d-4134-ac0e-ad1c688ff919" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:03:08 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-5809e966-ebec-415e-a2fc-57ed8522cd59 tempest-SnapshotDependencyTests-546132345 None] Creating volume b9879c6a-ca3d-4134-ac0e-ad1c688ff919 from snapshot b993078b-907a-4048-ad10-9a156ffd168d {{(pid=87420) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 10 16:03:08 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-5809e966-ebec-415e-a2fc-57ed8522cd59 tempest-SnapshotDependencyTests-546132345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:03:08 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-5809e966-ebec-415e-a2fc-57ed8522cd59 tempest-SnapshotDependencyTests-546132345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:03:08 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-5809e966-ebec-415e-a2fc-57ed8522cd59 tempest-SnapshotDependencyTests-546132345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:03:08 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-5809e966-ebec-415e-a2fc-57ed8522cd59 tempest-SnapshotDependencyTests-546132345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:03:08 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-5809e966-ebec-415e-a2fc-57ed8522cd59 tempest-SnapshotDependencyTests-546132345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:03:08 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-5809e966-ebec-415e-a2fc-57ed8522cd59 tempest-SnapshotDependencyTests-546132345 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 16:03:08 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-5809e966-ebec-415e-a2fc-57ed8522cd59 tempest-SnapshotDependencyTests-546132345 None] Acquiring lock "cinder-quobyte-b9879c6a-ca3d-4134-ac0e-ad1c688ff919" by "_copy_volume_from_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:03:08 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-5809e966-ebec-415e-a2fc-57ed8522cd59 tempest-SnapshotDependencyTests-546132345 None] Lock "cinder-quobyte-b9879c6a-ca3d-4134-ac0e-ad1c688ff919" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:03:08 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-5809e966-ebec-415e-a2fc-57ed8522cd59 tempest-SnapshotDependencyTests-546132345 None] snapshot: b993078b-907a-4048-ad10-9a156ffd168d, volume: b9879c6a-ca3d-4134-ac0e-ad1c688ff919, {{(pid=87420) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 16:03:08 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-5809e966-ebec-415e-a2fc-57ed8522cd59 tempest-SnapshotDependencyTests-546132345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:03:08 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-5809e966-ebec-415e-a2fc-57ed8522cd59 tempest-SnapshotDependencyTests-546132345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:03:08 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-5809e966-ebec-415e-a2fc-57ed8522cd59 tempest-SnapshotDependencyTests-546132345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:03:08 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-5809e966-ebec-415e-a2fc-57ed8522cd59 tempest-SnapshotDependencyTests-546132345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:03:08 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-5809e966-ebec-415e-a2fc-57ed8522cd59 tempest-SnapshotDependencyTests-546132345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:03:08 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e9b2f04-8042-485d-a724-71931c912906]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:03:08 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-5809e966-ebec-415e-a2fc-57ed8522cd59 tempest-SnapshotDependencyTests-546132345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b9ee5627-0bad-4c48-92ff-ad44ea82f806.b993078b-907a-4048-ad10-9a156ffd168d {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:03:08 devstack sudo[100927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b9ee5627-0bad-4c48-92ff-ad44ea82f806.b993078b-907a-4048-ad10-9a156ffd168d Jul 10 16:03:08 devstack sudo[100927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:03:09 devstack sudo[100927]: pam_unix(sudo:session): session closed for user root Jul 10 16:03:09 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-5809e966-ebec-415e-a2fc-57ed8522cd59 tempest-SnapshotDependencyTests-546132345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b9ee5627-0bad-4c48-92ff-ad44ea82f806.b993078b-907a-4048-ad10-9a156ffd168d" returned: 0 in 0.901s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:03:09 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-5809e966-ebec-415e-a2fc-57ed8522cd59 tempest-SnapshotDependencyTests-546132345 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9ee5627-0bad-4c48-92ff-ad44ea82f806(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87420) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 16:03:09 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-5809e966-ebec-415e-a2fc-57ed8522cd59 tempest-SnapshotDependencyTests-546132345 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b9ee5627-0bad-4c48-92ff-ad44ea82f806 {{(pid=87420) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 16:03:09 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-5809e966-ebec-415e-a2fc-57ed8522cd59 tempest-SnapshotDependencyTests-546132345 None] Creating direct copy from snapshot {{(pid=87420) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 16:03:09 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[baedac15-eaf2-4597-a10d-378a5111d517]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:03:09 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-5809e966-ebec-415e-a2fc-57ed8522cd59 tempest-SnapshotDependencyTests-546132345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b9ee5627-0bad-4c48-92ff-ad44ea82f806 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:03:09 devstack sudo[100932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b9ee5627-0bad-4c48-92ff-ad44ea82f806 Jul 10 16:03:09 devstack sudo[100932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:03:10 devstack sudo[100932]: pam_unix(sudo:session): session closed for user root Jul 10 16:03:10 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-5809e966-ebec-415e-a2fc-57ed8522cd59 tempest-SnapshotDependencyTests-546132345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b9ee5627-0bad-4c48-92ff-ad44ea82f806" returned: 0 in 0.827s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:03:10 devstack cinder-volume[87420]: DEBUG cinder.utils [None req-5809e966-ebec-415e-a2fc-57ed8522cd59 tempest-SnapshotDependencyTests-546132345 None] Path /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b9879c6a-ca3d-4134-ac0e-ad1c688ff919 not found in is_blk_device check {{(pid=87420) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 16:03:10 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-5809e966-ebec-415e-a2fc-57ed8522cd59 tempest-SnapshotDependencyTests-546132345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b9ee5627-0bad-4c48-92ff-ad44ea82f806 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b9879c6a-ca3d-4134-ac0e-ad1c688ff919 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:03:10 devstack sudo[100944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b9ee5627-0bad-4c48-92ff-ad44ea82f806 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b9879c6a-ca3d-4134-ac0e-ad1c688ff919 Jul 10 16:03:10 devstack sudo[100944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:03:17 devstack cinder-volume[87420]: DEBUG oslo_service.periodic_task [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87420) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 16:03:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:03:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:03:17 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:03:17 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:03:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.044s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:03:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:03:17 devstack sudo[101030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:03:17 devstack sudo[101030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:03:17 devstack sudo[100944]: pam_unix(sudo:session): session closed for user root Jul 10 16:03:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-5809e966-ebec-415e-a2fc-57ed8522cd59 tempest-SnapshotDependencyTests-546132345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b9ee5627-0bad-4c48-92ff-ad44ea82f806 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b9879c6a-ca3d-4134-ac0e-ad1c688ff919" returned: 0 in 7.544s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:03:17 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8a9d88a-6fd8-48b4-a796-c1849c6a7f6f]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:03:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-5809e966-ebec-415e-a2fc-57ed8522cd59 tempest-SnapshotDependencyTests-546132345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b9ee5627-0bad-4c48-92ff-ad44ea82f806 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:03:18 devstack sudo[101032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b9ee5627-0bad-4c48-92ff-ad44ea82f806 Jul 10 16:03:18 devstack sudo[101032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:03:18 devstack sudo[101030]: pam_unix(sudo:session): session closed for user root Jul 10 16:03:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.961s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:03:18 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:03:18 devstack cinder-volume[87420]: DEBUG oslo_service.periodic_task [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Running periodic task VolumeManager._thread_info {{(pid=87420) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 16:03:18 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] thread count: 29 {{(pid=87420) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 16:03:18 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] thread info: [<_MainThread(MainThread, started 133639250378880)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87420) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 16:03:18 devstack cinder-volume[87420]: DEBUG dbcounter [-] [87420] Writing DB stats cinder:UPDATE=33,cinder:SELECT=18,cinder:INSERT=5,cinder:DELETE=2 {{(pid=87420) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 16:03:18 devstack cinder-volume[87420]: DEBUG dbcounter [-] [87420] Writing DB stats cinder:UPDATE=17,cinder:SELECT=20,cinder:INSERT=6,cinder:DELETE=3 {{(pid=87420) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 16:03:19 devstack sudo[101032]: pam_unix(sudo:session): session closed for user root Jul 10 16:03:19 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-5809e966-ebec-415e-a2fc-57ed8522cd59 tempest-SnapshotDependencyTests-546132345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b9ee5627-0bad-4c48-92ff-ad44ea82f806" returned: 0 in 1.299s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:03:19 devstack cinder-volume[87420]: DEBUG cinder.image.image_utils [None req-5809e966-ebec-415e-a2fc-57ed8522cd59 tempest-SnapshotDependencyTests-546132345 None] Image conversion details: src /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b9ee5627-0bad-4c48-92ff-ad44ea82f806, size 1024.00 MB, duration 7.55 sec, destination /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b9879c6a-ca3d-4134-ac0e-ad1c688ff919 {{(pid=87420) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 16:03:19 devstack cinder-volume[87420]: INFO cinder.image.image_utils [None req-5809e966-ebec-415e-a2fc-57ed8522cd59 tempest-SnapshotDependencyTests-546132345 None] Converted 1024.00 MB image at 135.71 MB/s Jul 10 16:03:19 devstack cinder-volume[87420]: WARNING cinder.volume.drivers.remotefs [None req-5809e966-ebec-415e-a2fc-57ed8522cd59 tempest-SnapshotDependencyTests-546132345 None] /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b9879c6a-ca3d-4134-ac0e-ad1c688ff919 is being set with open permissions: ugo+rw Jul 10 16:03:19 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-5809e966-ebec-415e-a2fc-57ed8522cd59 tempest-SnapshotDependencyTests-546132345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b9879c6a-ca3d-4134-ac0e-ad1c688ff919 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:03:19 devstack sudo[101038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b9879c6a-ca3d-4134-ac0e-ad1c688ff919 Jul 10 16:03:19 devstack sudo[101038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:03:19 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d12eb07-fc33-4e4a-b455-7032d850f610 tempest-TestMinimumBasicScenario-1246116665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 16:03:19 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-4d12eb07-fc33-4e4a-b455-7032d850f610 tempest-TestMinimumBasicScenario-1246116665 None] Flow 'volume_create_manager' (49e9af01-64ba-4798-9567-24c47555add5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:03:19 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-4d12eb07-fc33-4e4a-b455-7032d850f610 tempest-TestMinimumBasicScenario-1246116665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4d8a7d3-c84b-4d81-9bf8-cd4b942cc9f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:03:19 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-4d12eb07-fc33-4e4a-b455-7032d850f610 tempest-TestMinimumBasicScenario-1246116665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4d8a7d3-c84b-4d81-9bf8-cd4b942cc9f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:03:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1359362408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcb72bca-705b-48f9-ba59-eb980ff0aa9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ede2668defa3477dae9646344f33f5be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:03:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:03:19Z,use_quota=True,user_id='f9307fbdfe354fc4abcce19c69f17f24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:03:19 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-4d12eb07-fc33-4e4a-b455-7032d850f610 tempest-TestMinimumBasicScenario-1246116665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f956f35c-bff1-4884-aa68-3621b047e014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:03:19 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-4d12eb07-fc33-4e4a-b455-7032d850f610 tempest-TestMinimumBasicScenario-1246116665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f956f35c-bff1-4884-aa68-3621b047e014) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:03:19 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-4d12eb07-fc33-4e4a-b455-7032d850f610 tempest-TestMinimumBasicScenario-1246116665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3c8a2c5-0883-4aa8-9a6b-16d1295a44c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:03:19 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-4d12eb07-fc33-4e4a-b455-7032d850f610 tempest-TestMinimumBasicScenario-1246116665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3c8a2c5-0883-4aa8-9a6b-16d1295a44c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dcb72bca-705b-48f9-ba59-eb980ff0aa9c', 'volume_name': 'volume-dcb72bca-705b-48f9-ba59-eb980ff0aa9c', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:03:19 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-4d12eb07-fc33-4e4a-b455-7032d850f610 tempest-TestMinimumBasicScenario-1246116665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff60f678-1438-4a4b-bdd7-e84130e1417a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:03:19 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-4d12eb07-fc33-4e4a-b455-7032d850f610 tempest-TestMinimumBasicScenario-1246116665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff60f678-1438-4a4b-bdd7-e84130e1417a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:03:19 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-4d12eb07-fc33-4e4a-b455-7032d850f610 tempest-TestMinimumBasicScenario-1246116665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f44fea7f-166c-4fd4-8400-f3acd249d720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:03:19 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-4d12eb07-fc33-4e4a-b455-7032d850f610 tempest-TestMinimumBasicScenario-1246116665 None] Volume dcb72bca-705b-48f9-ba59-eb980ff0aa9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dcb72bca-705b-48f9-ba59-eb980ff0aa9c', 'volume_size': 1} Jul 10 16:03:19 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-4d12eb07-fc33-4e4a-b455-7032d850f610 tempest-TestMinimumBasicScenario-1246116665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:03:20 devstack sudo[101038]: pam_unix(sudo:session): session closed for user root Jul 10 16:03:20 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-5809e966-ebec-415e-a2fc-57ed8522cd59 tempest-SnapshotDependencyTests-546132345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b9879c6a-ca3d-4134-ac0e-ad1c688ff919" returned: 0 in 0.841s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:03:20 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-5809e966-ebec-415e-a2fc-57ed8522cd59 tempest-SnapshotDependencyTests-546132345 None] Lock "cinder-quobyte-b9879c6a-ca3d-4134-ac0e-ad1c688ff919" released by "_copy_volume_from_snapshot" :: held 11.605s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:03:20 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-5809e966-ebec-415e-a2fc-57ed8522cd59 tempest-SnapshotDependencyTests-546132345 None] Lock "cinder-quobyte-b993078b-907a-4048-ad10-9a156ffd168d-b9879c6a-ca3d-4134-ac0e-ad1c688ff919" released by "_create_volume_from_snapshot" :: held 11.657s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:03:20 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-5809e966-ebec-415e-a2fc-57ed8522cd59 tempest-SnapshotDependencyTests-546132345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.676s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:03:20 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-4d12eb07-fc33-4e4a-b455-7032d850f610 tempest-TestMinimumBasicScenario-1246116665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.626s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:03:20 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-4d12eb07-fc33-4e4a-b455-7032d850f610 tempest-TestMinimumBasicScenario-1246116665 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:03:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1359362408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcb72bca-705b-48f9-ba59-eb980ff0aa9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ede2668defa3477dae9646344f33f5be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:03:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:03:19Z,use_quota=True,user_id='f9307fbdfe354fc4abcce19c69f17f24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 16:03:20 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-4d12eb07-fc33-4e4a-b455-7032d850f610 tempest-TestMinimumBasicScenario-1246116665 None] Creating volume dcb72bca-705b-48f9-ba59-eb980ff0aa9c {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 16:03:20 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-4d12eb07-fc33-4e4a-b455-7032d850f610 tempest-TestMinimumBasicScenario-1246116665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:03:20 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-4d12eb07-fc33-4e4a-b455-7032d850f610 tempest-TestMinimumBasicScenario-1246116665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:03:20 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-4d12eb07-fc33-4e4a-b455-7032d850f610 tempest-TestMinimumBasicScenario-1246116665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:03:20 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-4d12eb07-fc33-4e4a-b455-7032d850f610 tempest-TestMinimumBasicScenario-1246116665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:03:20 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-4d12eb07-fc33-4e4a-b455-7032d850f610 tempest-TestMinimumBasicScenario-1246116665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:03:20 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-4d12eb07-fc33-4e4a-b455-7032d850f610 tempest-TestMinimumBasicScenario-1246116665 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 16:03:20 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-4d12eb07-fc33-4e4a-b455-7032d850f610 tempest-TestMinimumBasicScenario-1246116665 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 16:03:20 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4d12eb07-fc33-4e4a-b455-7032d850f610 tempest-TestMinimumBasicScenario-1246116665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-dcb72bca-705b-48f9-ba59-eb980ff0aa9c 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:03:20 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-5809e966-ebec-415e-a2fc-57ed8522cd59 tempest-SnapshotDependencyTests-546132345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31df55f2-ec5f-48be-88b5-2fe98f99d2d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9879c6a-ca3d-4134-ac0e-ad1c688ff919', 'volume_size': 1, 'snapshot_id': 'b993078b-907a-4048-ad10-9a156ffd168d'}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:03:20 devstack sudo[101041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-dcb72bca-705b-48f9-ba59-eb980ff0aa9c 1073741824 Jul 10 16:03:20 devstack sudo[101041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:03:20 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-5809e966-ebec-415e-a2fc-57ed8522cd59 tempest-SnapshotDependencyTests-546132345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e6450ca-7925-41ac-a313-59ae25f82e5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:03:20 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-5809e966-ebec-415e-a2fc-57ed8522cd59 tempest-SnapshotDependencyTests-546132345 None] Volume volume-b9879c6a-ca3d-4134-ac0e-ad1c688ff919 (b9879c6a-ca3d-4134-ac0e-ad1c688ff919): created successfully Jul 10 16:03:20 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-5809e966-ebec-415e-a2fc-57ed8522cd59 tempest-SnapshotDependencyTests-546132345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e6450ca-7925-41ac-a313-59ae25f82e5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:03:20 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-5809e966-ebec-415e-a2fc-57ed8522cd59 tempest-SnapshotDependencyTests-546132345 None] Flow 'volume_create_manager' (9bbdf8ff-4671-4fab-927c-9f9aa9174682) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:03:20 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-5809e966-ebec-415e-a2fc-57ed8522cd59 tempest-SnapshotDependencyTests-546132345 None] Created volume successfully. Jul 10 16:03:21 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-d8bbe614-18a0-47db-9976-de48286ada09 tempest-SnapshotDependencyTests-546132345 None] Acquiring lock "cinder-b993078b-907a-4048-ad10-9a156ffd168d-delete_snapshot" by "delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:03:21 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-d8bbe614-18a0-47db-9976-de48286ada09 tempest-SnapshotDependencyTests-546132345 None] Lock "cinder-b993078b-907a-4048-ad10-9a156ffd168d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:03:21 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-d8bbe614-18a0-47db-9976-de48286ada09 tempest-SnapshotDependencyTests-546132345 None] Acquiring lock "cinder-quobyte-b9ee5627-0bad-4c48-92ff-ad44ea82f806" by "delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:03:21 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-d8bbe614-18a0-47db-9976-de48286ada09 tempest-SnapshotDependencyTests-546132345 None] Lock "cinder-quobyte-b9ee5627-0bad-4c48-92ff-ad44ea82f806" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:03:21 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-d8bbe614-18a0-47db-9976-de48286ada09 tempest-SnapshotDependencyTests-546132345 None] Acquiring lock "cinder-quobyte-b993078b-907a-4048-ad10-9a156ffd168d" by "_delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:03:21 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-d8bbe614-18a0-47db-9976-de48286ada09 tempest-SnapshotDependencyTests-546132345 None] Lock "cinder-quobyte-b993078b-907a-4048-ad10-9a156ffd168d" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:03:21 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-d8bbe614-18a0-47db-9976-de48286ada09 tempest-SnapshotDependencyTests-546132345 None] Deleting offline snapshot b993078b-907a-4048-ad10-9a156ffd168d of volume b9ee5627-0bad-4c48-92ff-ad44ea82f806 {{(pid=87420) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 16:03:21 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-d8bbe614-18a0-47db-9976-de48286ada09 tempest-SnapshotDependencyTests-546132345 None] snapshot_file for this snap is: volume-b9ee5627-0bad-4c48-92ff-ad44ea82f806.b993078b-907a-4048-ad10-9a156ffd168d {{(pid=87420) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 16:03:21 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8d9f584-341e-4c2b-8837-508ab28423e4]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:03:21 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d8bbe614-18a0-47db-9976-de48286ada09 tempest-SnapshotDependencyTests-546132345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b9ee5627-0bad-4c48-92ff-ad44ea82f806.b993078b-907a-4048-ad10-9a156ffd168d {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:03:21 devstack sudo[101047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b9ee5627-0bad-4c48-92ff-ad44ea82f806.b993078b-907a-4048-ad10-9a156ffd168d Jul 10 16:03:21 devstack sudo[101047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:03:21 devstack sudo[101041]: pam_unix(sudo:session): session closed for user root Jul 10 16:03:21 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4d12eb07-fc33-4e4a-b455-7032d850f610 tempest-TestMinimumBasicScenario-1246116665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-dcb72bca-705b-48f9-ba59-eb980ff0aa9c 1073741824" returned: 0 in 1.352s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:03:21 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4d12eb07-fc33-4e4a-b455-7032d850f610 tempest-TestMinimumBasicScenario-1246116665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-dcb72bca-705b-48f9-ba59-eb980ff0aa9c {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:03:21 devstack sudo[101049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-dcb72bca-705b-48f9-ba59-eb980ff0aa9c Jul 10 16:03:21 devstack sudo[101049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:03:22 devstack sudo[101047]: pam_unix(sudo:session): session closed for user root Jul 10 16:03:22 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d8bbe614-18a0-47db-9976-de48286ada09 tempest-SnapshotDependencyTests-546132345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b9ee5627-0bad-4c48-92ff-ad44ea82f806.b993078b-907a-4048-ad10-9a156ffd168d" returned: 0 in 1.208s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:03:22 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-d8bbe614-18a0-47db-9976-de48286ada09 tempest-SnapshotDependencyTests-546132345 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9ee5627-0bad-4c48-92ff-ad44ea82f806(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87420) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 16:03:22 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[27b16c98-a5ac-456d-b9be-c9595149b3cd]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:03:22 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d8bbe614-18a0-47db-9976-de48286ada09 tempest-SnapshotDependencyTests-546132345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b9ee5627-0bad-4c48-92ff-ad44ea82f806 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:03:22 devstack sudo[101055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b9ee5627-0bad-4c48-92ff-ad44ea82f806 Jul 10 16:03:22 devstack sudo[101055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:03:22 devstack sudo[101049]: pam_unix(sudo:session): session closed for user root Jul 10 16:03:22 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4d12eb07-fc33-4e4a-b455-7032d850f610 tempest-TestMinimumBasicScenario-1246116665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-dcb72bca-705b-48f9-ba59-eb980ff0aa9c" returned: 0 in 1.210s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:03:22 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-4d12eb07-fc33-4e4a-b455-7032d850f610 tempest-TestMinimumBasicScenario-1246116665 None] <== create_volume: return (2658ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 16:03:22 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-4d12eb07-fc33-4e4a-b455-7032d850f610 tempest-TestMinimumBasicScenario-1246116665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.662s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:03:22 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-4d12eb07-fc33-4e4a-b455-7032d850f610 tempest-TestMinimumBasicScenario-1246116665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f44fea7f-166c-4fd4-8400-f3acd249d720) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dcb72bca-705b-48f9-ba59-eb980ff0aa9c', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:03:22 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-4d12eb07-fc33-4e4a-b455-7032d850f610 tempest-TestMinimumBasicScenario-1246116665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9822147-304d-48d8-83f4-1b74beaab732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:03:22 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-4d12eb07-fc33-4e4a-b455-7032d850f610 tempest-TestMinimumBasicScenario-1246116665 None] Volume volume-dcb72bca-705b-48f9-ba59-eb980ff0aa9c (dcb72bca-705b-48f9-ba59-eb980ff0aa9c): created successfully Jul 10 16:03:22 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-4d12eb07-fc33-4e4a-b455-7032d850f610 tempest-TestMinimumBasicScenario-1246116665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9822147-304d-48d8-83f4-1b74beaab732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:03:22 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-4d12eb07-fc33-4e4a-b455-7032d850f610 tempest-TestMinimumBasicScenario-1246116665 None] Flow 'volume_create_manager' (49e9af01-64ba-4798-9567-24c47555add5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:03:22 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-4d12eb07-fc33-4e4a-b455-7032d850f610 tempest-TestMinimumBasicScenario-1246116665 None] Created volume successfully. Jul 10 16:03:23 devstack sudo[101055]: pam_unix(sudo:session): session closed for user root Jul 10 16:03:23 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d8bbe614-18a0-47db-9976-de48286ada09 tempest-SnapshotDependencyTests-546132345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b9ee5627-0bad-4c48-92ff-ad44ea82f806" returned: 0 in 1.289s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:03:23 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d8bbe614-18a0-47db-9976-de48286ada09 tempest-SnapshotDependencyTests-546132345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b9ee5627-0bad-4c48-92ff-ad44ea82f806.b993078b-907a-4048-ad10-9a156ffd168d {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:03:23 devstack sudo[101062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b9ee5627-0bad-4c48-92ff-ad44ea82f806.b993078b-907a-4048-ad10-9a156ffd168d Jul 10 16:03:23 devstack sudo[101062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:03:24 devstack sudo[101062]: pam_unix(sudo:session): session closed for user root Jul 10 16:03:24 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d8bbe614-18a0-47db-9976-de48286ada09 tempest-SnapshotDependencyTests-546132345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b9ee5627-0bad-4c48-92ff-ad44ea82f806.b993078b-907a-4048-ad10-9a156ffd168d" returned: 0 in 0.963s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:03:24 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d8bbe614-18a0-47db-9976-de48286ada09 tempest-SnapshotDependencyTests-546132345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b9ee5627-0bad-4c48-92ff-ad44ea82f806.b993078b-907a-4048-ad10-9a156ffd168d {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:03:24 devstack sudo[101073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b9ee5627-0bad-4c48-92ff-ad44ea82f806.b993078b-907a-4048-ad10-9a156ffd168d Jul 10 16:03:24 devstack sudo[101073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:03:25 devstack sudo[101073]: pam_unix(sudo:session): session closed for user root Jul 10 16:03:25 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d8bbe614-18a0-47db-9976-de48286ada09 tempest-SnapshotDependencyTests-546132345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b9ee5627-0bad-4c48-92ff-ad44ea82f806.b993078b-907a-4048-ad10-9a156ffd168d" returned: 0 in 1.087s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:03:25 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-d8bbe614-18a0-47db-9976-de48286ada09 tempest-SnapshotDependencyTests-546132345 None] Lock "cinder-quobyte-b993078b-907a-4048-ad10-9a156ffd168d" released by "_delete_snapshot" :: held 4.734s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:03:25 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-d8bbe614-18a0-47db-9976-de48286ada09 tempest-SnapshotDependencyTests-546132345 None] Lock "cinder-quobyte-b9ee5627-0bad-4c48-92ff-ad44ea82f806" released by "delete_snapshot" :: held 4.769s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:03:25 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-d8bbe614-18a0-47db-9976-de48286ada09 tempest-SnapshotDependencyTests-546132345 None] Created reservations ['df25373b-07df-47d2-a23f-4403a4c5d1a7', '051bfc84-3e1d-49a3-be24-cf760607a659', '3bad37c9-1215-4d0c-8747-788febd67a9b', 'e6c91d9d-4cb9-4ba9-9caf-99ffbbefd033'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:03:26 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-d8bbe614-18a0-47db-9976-de48286ada09 tempest-SnapshotDependencyTests-546132345 None] Delete snapshot completed successfully. Jul 10 16:03:26 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-d8bbe614-18a0-47db-9976-de48286ada09 tempest-SnapshotDependencyTests-546132345 None] Lock "cinder-b993078b-907a-4048-ad10-9a156ffd168d-delete_snapshot" released by "delete_snapshot" :: held 4.934s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:03:26 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-94df64c2-c9ec-4e05-9b2e-10bd1471b815 tempest-SnapshotDependencyTests-546132345 None] Acquiring lock "cinder-b9ee5627-0bad-4c48-92ff-ad44ea82f806-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:03:26 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-94df64c2-c9ec-4e05-9b2e-10bd1471b815 tempest-SnapshotDependencyTests-546132345 None] Lock "cinder-b9ee5627-0bad-4c48-92ff-ad44ea82f806-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:03:26 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-94df64c2-c9ec-4e05-9b2e-10bd1471b815 tempest-SnapshotDependencyTests-546132345 None] Acquiring lock "cinder-quobyte-b9ee5627-0bad-4c48-92ff-ad44ea82f806" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:03:26 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-94df64c2-c9ec-4e05-9b2e-10bd1471b815 tempest-SnapshotDependencyTests-546132345 None] Lock "cinder-quobyte-b9ee5627-0bad-4c48-92ff-ad44ea82f806" acquired by "delete_volume" :: waited 0.030s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:03:26 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[75758de9-3e18-4dab-a381-9b7ad9eb8ff7]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:03:26 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-94df64c2-c9ec-4e05-9b2e-10bd1471b815 tempest-SnapshotDependencyTests-546132345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b9ee5627-0bad-4c48-92ff-ad44ea82f806 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:03:26 devstack sudo[101076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b9ee5627-0bad-4c48-92ff-ad44ea82f806 Jul 10 16:03:26 devstack sudo[101076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:03:27 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [req-a5b110c9-8489-4bed-89ce-b0c381110ee8 req-6b500116-85bc-4bb4-97dd-2a77b15415ed tempest-TestMinimumBasicScenario-1246116665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:03:27 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [req-a5b110c9-8489-4bed-89ce-b0c381110ee8 req-6b500116-85bc-4bb4-97dd-2a77b15415ed tempest-TestMinimumBasicScenario-1246116665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:03:27 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[55d12dde-1985-4014-831a-06a7854c6f47]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:03:27 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [req-a5b110c9-8489-4bed-89ce-b0c381110ee8 req-6b500116-85bc-4bb4-97dd-2a77b15415ed tempest-TestMinimumBasicScenario-1246116665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-dcb72bca-705b-48f9-ba59-eb980ff0aa9c {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:03:27 devstack sudo[101118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-dcb72bca-705b-48f9-ba59-eb980ff0aa9c Jul 10 16:03:27 devstack sudo[101118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:03:27 devstack sudo[101076]: pam_unix(sudo:session): session closed for user root Jul 10 16:03:27 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-94df64c2-c9ec-4e05-9b2e-10bd1471b815 tempest-SnapshotDependencyTests-546132345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b9ee5627-0bad-4c48-92ff-ad44ea82f806" returned: 0 in 1.014s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:03:27 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-94df64c2-c9ec-4e05-9b2e-10bd1471b815 tempest-SnapshotDependencyTests-546132345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b9ee5627-0bad-4c48-92ff-ad44ea82f806 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:03:27 devstack sudo[101121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b9ee5627-0bad-4c48-92ff-ad44ea82f806 Jul 10 16:03:27 devstack sudo[101121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:03:28 devstack sudo[101121]: pam_unix(sudo:session): session closed for user root Jul 10 16:03:28 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-94df64c2-c9ec-4e05-9b2e-10bd1471b815 tempest-SnapshotDependencyTests-546132345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b9ee5627-0bad-4c48-92ff-ad44ea82f806" returned: 0 in 0.735s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:03:28 devstack sudo[101118]: pam_unix(sudo:session): session closed for user root Jul 10 16:03:28 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-94df64c2-c9ec-4e05-9b2e-10bd1471b815 tempest-SnapshotDependencyTests-546132345 None] Lock "cinder-quobyte-b9ee5627-0bad-4c48-92ff-ad44ea82f806" released by "delete_volume" :: held 1.850s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:03:28 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [req-a5b110c9-8489-4bed-89ce-b0c381110ee8 req-6b500116-85bc-4bb4-97dd-2a77b15415ed tempest-TestMinimumBasicScenario-1246116665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-dcb72bca-705b-48f9-ba59-eb980ff0aa9c" returned: 0 in 0.944s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:03:28 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [req-a5b110c9-8489-4bed-89ce-b0c381110ee8 req-6b500116-85bc-4bb4-97dd-2a77b15415ed tempest-TestMinimumBasicScenario-1246116665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.965s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:03:28 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [req-a5b110c9-8489-4bed-89ce-b0c381110ee8 req-6b500116-85bc-4bb4-97dd-2a77b15415ed tempest-TestMinimumBasicScenario-1246116665 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80', 'name': 'volume-dcb72bca-705b-48f9-ba59-eb980ff0aa9c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e2110a0b-7d4c-466b-bd53-fcfcd5062dfd', 'enforce_multipath': True} {{(pid=87420) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 16:03:28 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-94df64c2-c9ec-4e05-9b2e-10bd1471b815 tempest-SnapshotDependencyTests-546132345 None] Created reservations ['06b80bcf-f8b3-46a8-804c-f779a6498881', 'cc186dca-94e4-447d-8c18-00ac663f2f8a', 'f741d02d-3d39-4c5f-a98d-1c4eee965cd9', 'a74a5821-bf67-4bc7-9a8a-3ab5e61c70d6'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:03:28 devstack cinder-volume[87420]: INFO cinder.volume.manager [req-a5b110c9-8489-4bed-89ce-b0c381110ee8 req-6b500116-85bc-4bb4-97dd-2a77b15415ed tempest-TestMinimumBasicScenario-1246116665 None] attachment_update completed successfully. Jul 10 16:03:28 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-94df64c2-c9ec-4e05-9b2e-10bd1471b815 tempest-SnapshotDependencyTests-546132345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:03:28 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-94df64c2-c9ec-4e05-9b2e-10bd1471b815 tempest-SnapshotDependencyTests-546132345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:03:28 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-94df64c2-c9ec-4e05-9b2e-10bd1471b815 tempest-SnapshotDependencyTests-546132345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:03:28 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-94df64c2-c9ec-4e05-9b2e-10bd1471b815 tempest-SnapshotDependencyTests-546132345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:03:28 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-94df64c2-c9ec-4e05-9b2e-10bd1471b815 tempest-SnapshotDependencyTests-546132345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:03:28 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-94df64c2-c9ec-4e05-9b2e-10bd1471b815 tempest-SnapshotDependencyTests-546132345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:03:28 devstack sudo[101127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:03:28 devstack sudo[101127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:03:28 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-2902dc51-e87b-43cd-a36d-96cbf09d3964 tempest-SnapshotDependencyTests-546132345 None] Acquiring lock "cinder-b9879c6a-ca3d-4134-ac0e-ad1c688ff919-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:03:28 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-2902dc51-e87b-43cd-a36d-96cbf09d3964 tempest-SnapshotDependencyTests-546132345 None] Lock "cinder-b9879c6a-ca3d-4134-ac0e-ad1c688ff919-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:03:28 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-2902dc51-e87b-43cd-a36d-96cbf09d3964 tempest-SnapshotDependencyTests-546132345 None] Acquiring lock "cinder-quobyte-b9879c6a-ca3d-4134-ac0e-ad1c688ff919" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:03:29 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-2902dc51-e87b-43cd-a36d-96cbf09d3964 tempest-SnapshotDependencyTests-546132345 None] Lock "cinder-quobyte-b9879c6a-ca3d-4134-ac0e-ad1c688ff919" acquired by "delete_volume" :: waited 0.020s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:03:29 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[be467982-7781-4d6c-a517-10b696c519b8]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:03:29 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-2902dc51-e87b-43cd-a36d-96cbf09d3964 tempest-SnapshotDependencyTests-546132345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b9879c6a-ca3d-4134-ac0e-ad1c688ff919 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:03:29 devstack sudo[101129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b9879c6a-ca3d-4134-ac0e-ad1c688ff919 Jul 10 16:03:29 devstack sudo[101129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:03:29 devstack sudo[101127]: pam_unix(sudo:session): session closed for user root Jul 10 16:03:29 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-94df64c2-c9ec-4e05-9b2e-10bd1471b815 tempest-SnapshotDependencyTests-546132345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.779s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:03:29 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-94df64c2-c9ec-4e05-9b2e-10bd1471b815 tempest-SnapshotDependencyTests-546132345 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:03:29 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-94df64c2-c9ec-4e05-9b2e-10bd1471b815 tempest-SnapshotDependencyTests-546132345 None] Deleted volume successfully. Jul 10 16:03:29 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-94df64c2-c9ec-4e05-9b2e-10bd1471b815 tempest-SnapshotDependencyTests-546132345 None] Lock "cinder-b9ee5627-0bad-4c48-92ff-ad44ea82f806-delete_volume" released by "delete_volume" :: held 2.946s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:03:29 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8e5fd69-7f29-40c6-98f8-9e685e4e10d7 tempest-TestInstancesWithCinderVolumes-307781406 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 16:03:29 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c8e5fd69-7f29-40c6-98f8-9e685e4e10d7 tempest-TestInstancesWithCinderVolumes-307781406 None] Flow 'volume_create_manager' (8e063f42-815a-49e7-9e79-2826c5378ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:03:29 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c8e5fd69-7f29-40c6-98f8-9e685e4e10d7 tempest-TestInstancesWithCinderVolumes-307781406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55f72977-cf88-46f8-b7e5-8c624dac05b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:03:29 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c8e5fd69-7f29-40c6-98f8-9e685e4e10d7 tempest-TestInstancesWithCinderVolumes-307781406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55f72977-cf88-46f8-b7e5-8c624dac05b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:03:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2060449516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca2ea565-bb26-41b8-aa98-4abe9a6ff98a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9754ab591ec04bcb94e71fac5a2cc0fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:03:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:03:30Z,use_quota=True,user_id='29d157c319544e52841406dd5473776f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d2362d18-a601-444f-8bd3-d7ce39a99b97),volume_type_id=d2362d18-a601-444f-8bd3-d7ce39a99b97)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:03:29 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c8e5fd69-7f29-40c6-98f8-9e685e4e10d7 tempest-TestInstancesWithCinderVolumes-307781406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72752368-b581-4daf-a40b-4b483e0f699a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:03:29 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c8e5fd69-7f29-40c6-98f8-9e685e4e10d7 tempest-TestInstancesWithCinderVolumes-307781406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72752368-b581-4daf-a40b-4b483e0f699a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:03:29 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c8e5fd69-7f29-40c6-98f8-9e685e4e10d7 tempest-TestInstancesWithCinderVolumes-307781406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6272e28b-c502-435b-8ecd-ee3613bd81a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:03:29 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c8e5fd69-7f29-40c6-98f8-9e685e4e10d7 tempest-TestInstancesWithCinderVolumes-307781406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6272e28b-c502-435b-8ecd-ee3613bd81a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca2ea565-bb26-41b8-aa98-4abe9a6ff98a', 'volume_name': 'volume-ca2ea565-bb26-41b8-aa98-4abe9a6ff98a', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:03:29 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c8e5fd69-7f29-40c6-98f8-9e685e4e10d7 tempest-TestInstancesWithCinderVolumes-307781406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb428ec3-60ad-4240-933a-ad6e672332f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:03:29 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c8e5fd69-7f29-40c6-98f8-9e685e4e10d7 tempest-TestInstancesWithCinderVolumes-307781406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb428ec3-60ad-4240-933a-ad6e672332f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:03:29 devstack sudo[101129]: pam_unix(sudo:session): session closed for user root Jul 10 16:03:29 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c8e5fd69-7f29-40c6-98f8-9e685e4e10d7 tempest-TestInstancesWithCinderVolumes-307781406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47ad4b49-58ee-402d-9bed-8d1d64883748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:03:29 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-c8e5fd69-7f29-40c6-98f8-9e685e4e10d7 tempest-TestInstancesWithCinderVolumes-307781406 None] Volume ca2ea565-bb26-41b8-aa98-4abe9a6ff98a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca2ea565-bb26-41b8-aa98-4abe9a6ff98a', 'volume_size': 1} Jul 10 16:03:29 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-c8e5fd69-7f29-40c6-98f8-9e685e4e10d7 tempest-TestInstancesWithCinderVolumes-307781406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:03:29 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-c8e5fd69-7f29-40c6-98f8-9e685e4e10d7 tempest-TestInstancesWithCinderVolumes-307781406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:03:29 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-c8e5fd69-7f29-40c6-98f8-9e685e4e10d7 tempest-TestInstancesWithCinderVolumes-307781406 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:03:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2060449516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca2ea565-bb26-41b8-aa98-4abe9a6ff98a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9754ab591ec04bcb94e71fac5a2cc0fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:03:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:03:30Z,use_quota=True,user_id='29d157c319544e52841406dd5473776f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d2362d18-a601-444f-8bd3-d7ce39a99b97),volume_type_id=d2362d18-a601-444f-8bd3-d7ce39a99b97)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 16:03:29 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-c8e5fd69-7f29-40c6-98f8-9e685e4e10d7 tempest-TestInstancesWithCinderVolumes-307781406 None] Creating volume ca2ea565-bb26-41b8-aa98-4abe9a6ff98a {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 16:03:29 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-c8e5fd69-7f29-40c6-98f8-9e685e4e10d7 tempest-TestInstancesWithCinderVolumes-307781406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:03:29 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-c8e5fd69-7f29-40c6-98f8-9e685e4e10d7 tempest-TestInstancesWithCinderVolumes-307781406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:03:29 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-c8e5fd69-7f29-40c6-98f8-9e685e4e10d7 tempest-TestInstancesWithCinderVolumes-307781406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:03:29 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-c8e5fd69-7f29-40c6-98f8-9e685e4e10d7 tempest-TestInstancesWithCinderVolumes-307781406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:03:29 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-c8e5fd69-7f29-40c6-98f8-9e685e4e10d7 tempest-TestInstancesWithCinderVolumes-307781406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:03:29 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-c8e5fd69-7f29-40c6-98f8-9e685e4e10d7 tempest-TestInstancesWithCinderVolumes-307781406 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 16:03:29 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-c8e5fd69-7f29-40c6-98f8-9e685e4e10d7 tempest-TestInstancesWithCinderVolumes-307781406 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 16:03:29 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c8e5fd69-7f29-40c6-98f8-9e685e4e10d7 tempest-TestInstancesWithCinderVolumes-307781406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ca2ea565-bb26-41b8-aa98-4abe9a6ff98a 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:03:29 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-2902dc51-e87b-43cd-a36d-96cbf09d3964 tempest-SnapshotDependencyTests-546132345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b9879c6a-ca3d-4134-ac0e-ad1c688ff919" returned: 0 in 0.919s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:03:29 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-2902dc51-e87b-43cd-a36d-96cbf09d3964 tempest-SnapshotDependencyTests-546132345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b9879c6a-ca3d-4134-ac0e-ad1c688ff919 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:03:29 devstack sudo[101516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ca2ea565-bb26-41b8-aa98-4abe9a6ff98a 1073741824 Jul 10 16:03:29 devstack sudo[101516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:03:30 devstack sudo[101517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b9879c6a-ca3d-4134-ac0e-ad1c688ff919 Jul 10 16:03:30 devstack sudo[101517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:03:30 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-86176d43-a4b5-4399-a016-de681afc1308 tempest-TestInstancesWithCinderVolumes-307781406 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 16:03:30 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-86176d43-a4b5-4399-a016-de681afc1308 tempest-TestInstancesWithCinderVolumes-307781406 None] Flow 'volume_create_manager' (f8acf70a-de7c-44cb-9dd1-6e0cf4ffe267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:03:30 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-86176d43-a4b5-4399-a016-de681afc1308 tempest-TestInstancesWithCinderVolumes-307781406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80b5b8ae-498d-4bc1-8639-e6110c9ecf6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:03:30 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-86176d43-a4b5-4399-a016-de681afc1308 tempest-TestInstancesWithCinderVolumes-307781406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80b5b8ae-498d-4bc1-8639-e6110c9ecf6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:03:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1844059121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d2fd772-ca7d-43c2-83cb-93505d505859,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9754ab591ec04bcb94e71fac5a2cc0fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:03:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:03:30Z,use_quota=True,user_id='29d157c319544e52841406dd5473776f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ffcf8557-44fd-4eaf-b49b-c23718706d53),volume_type_id=ffcf8557-44fd-4eaf-b49b-c23718706d53)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:03:30 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-86176d43-a4b5-4399-a016-de681afc1308 tempest-TestInstancesWithCinderVolumes-307781406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c4259c6-b735-4236-b0aa-de2059df8f96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:03:30 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-86176d43-a4b5-4399-a016-de681afc1308 tempest-TestInstancesWithCinderVolumes-307781406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c4259c6-b735-4236-b0aa-de2059df8f96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:03:30 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-86176d43-a4b5-4399-a016-de681afc1308 tempest-TestInstancesWithCinderVolumes-307781406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99d2ce08-ff52-4a1e-a8a7-93951e709029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:03:30 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-86176d43-a4b5-4399-a016-de681afc1308 tempest-TestInstancesWithCinderVolumes-307781406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99d2ce08-ff52-4a1e-a8a7-93951e709029) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d2fd772-ca7d-43c2-83cb-93505d505859', 'volume_name': 'volume-3d2fd772-ca7d-43c2-83cb-93505d505859', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:03:30 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-86176d43-a4b5-4399-a016-de681afc1308 tempest-TestInstancesWithCinderVolumes-307781406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6950c12-990a-431d-9081-2688fe0e892c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:03:30 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-86176d43-a4b5-4399-a016-de681afc1308 tempest-TestInstancesWithCinderVolumes-307781406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6950c12-990a-431d-9081-2688fe0e892c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:03:30 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-86176d43-a4b5-4399-a016-de681afc1308 tempest-TestInstancesWithCinderVolumes-307781406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85950117-ca19-4361-8549-e942ac02b8a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:03:30 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-86176d43-a4b5-4399-a016-de681afc1308 tempest-TestInstancesWithCinderVolumes-307781406 None] Volume 3d2fd772-ca7d-43c2-83cb-93505d505859: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d2fd772-ca7d-43c2-83cb-93505d505859', 'volume_size': 1} Jul 10 16:03:30 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-86176d43-a4b5-4399-a016-de681afc1308 tempest-TestInstancesWithCinderVolumes-307781406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:03:30 devstack sudo[101517]: pam_unix(sudo:session): session closed for user root Jul 10 16:03:30 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-2902dc51-e87b-43cd-a36d-96cbf09d3964 tempest-SnapshotDependencyTests-546132345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-b9879c6a-ca3d-4134-ac0e-ad1c688ff919" returned: 0 in 0.919s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:03:30 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-2902dc51-e87b-43cd-a36d-96cbf09d3964 tempest-SnapshotDependencyTests-546132345 None] Lock "cinder-quobyte-b9879c6a-ca3d-4134-ac0e-ad1c688ff919" released by "delete_volume" :: held 1.899s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:03:30 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-c84d50b0-ac03-4e36-8661-c929cd8a02de tempest-TestInstancesWithCinderVolumes-307781406 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 16:03:30 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c84d50b0-ac03-4e36-8661-c929cd8a02de tempest-TestInstancesWithCinderVolumes-307781406 None] Flow 'volume_create_manager' (d381f5e0-7f6e-484f-b1a7-6f7c204f77e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:03:30 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c84d50b0-ac03-4e36-8661-c929cd8a02de tempest-TestInstancesWithCinderVolumes-307781406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (450582e4-ef08-43bb-88f4-357ec804bad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:03:30 devstack sudo[101516]: pam_unix(sudo:session): session closed for user root Jul 10 16:03:31 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c84d50b0-ac03-4e36-8661-c929cd8a02de tempest-TestInstancesWithCinderVolumes-307781406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (450582e4-ef08-43bb-88f4-357ec804bad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:03:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1934514979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=deae5f30-e9e3-4ad1-bfbb-ae25e4854dc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9754ab591ec04bcb94e71fac5a2cc0fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:03:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:03:31Z,use_quota=True,user_id='29d157c319544e52841406dd5473776f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9cca6b9e-d82c-4e8b-ac86-d7961e54c56b),volume_type_id=9cca6b9e-d82c-4e8b-ac86-d7961e54c56b)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:03:31 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c84d50b0-ac03-4e36-8661-c929cd8a02de tempest-TestInstancesWithCinderVolumes-307781406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69b9698e-2cce-496b-98e8-31440c37eb39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:03:31 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c84d50b0-ac03-4e36-8661-c929cd8a02de tempest-TestInstancesWithCinderVolumes-307781406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69b9698e-2cce-496b-98e8-31440c37eb39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:03:31 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c84d50b0-ac03-4e36-8661-c929cd8a02de tempest-TestInstancesWithCinderVolumes-307781406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6d90c26-0873-4ec2-86e0-934a409de98a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:03:31 devstack cinder-volume[87420]: DEBUG cinder.image.glance [None req-c84d50b0-ac03-4e36-8661-c929cd8a02de tempest-TestInstancesWithCinderVolumes-307781406 None] Creating Keystone auth plugin from conf {{(pid=87420) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 10 16:03:31 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c8e5fd69-7f29-40c6-98f8-9e685e4e10d7 tempest-TestInstancesWithCinderVolumes-307781406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ca2ea565-bb26-41b8-aa98-4abe9a6ff98a 1073741824" returned: 0 in 1.080s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:03:31 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-2902dc51-e87b-43cd-a36d-96cbf09d3964 tempest-SnapshotDependencyTests-546132345 None] Created reservations ['242cddb0-416a-45b7-a641-bae08eb15fe7', '896faf73-56f8-46a5-9125-1a7e19e3cae9', '5425325d-e541-4559-9031-dbf0f54c4083', 'f4dd17df-6f5d-4b78-97da-67d0caf28b69'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:03:31 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c8e5fd69-7f29-40c6-98f8-9e685e4e10d7 tempest-TestInstancesWithCinderVolumes-307781406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ca2ea565-bb26-41b8-aa98-4abe9a6ff98a {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:03:31 devstack sudo[101526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ca2ea565-bb26-41b8-aa98-4abe9a6ff98a Jul 10 16:03:31 devstack sudo[101526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:03:31 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-2902dc51-e87b-43cd-a36d-96cbf09d3964 tempest-SnapshotDependencyTests-546132345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:03:31 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-2902dc51-e87b-43cd-a36d-96cbf09d3964 tempest-SnapshotDependencyTests-546132345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:03:31 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-2902dc51-e87b-43cd-a36d-96cbf09d3964 tempest-SnapshotDependencyTests-546132345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:03:31 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-2902dc51-e87b-43cd-a36d-96cbf09d3964 tempest-SnapshotDependencyTests-546132345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:03:31 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-2902dc51-e87b-43cd-a36d-96cbf09d3964 tempest-SnapshotDependencyTests-546132345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:03:31 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-2902dc51-e87b-43cd-a36d-96cbf09d3964 tempest-SnapshotDependencyTests-546132345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:03:31 devstack sudo[101528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:03:31 devstack sudo[101528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:03:31 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c84d50b0-ac03-4e36-8661-c929cd8a02de tempest-TestInstancesWithCinderVolumes-307781406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6d90c26-0873-4ec2-86e0-934a409de98a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'deae5f30-e9e3-4ad1-bfbb-ae25e4854dc8', 'volume_name': 'volume-deae5f30-e9e3-4ad1-bfbb-ae25e4854dc8', 'volume_size': 1, 'image_id': '96d21fa2-091f-4692-a58b-c8bf97eaaca6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/96d21fa2-091f-4692-a58b-c8bf97eaaca6', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1179636598', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9754ab591ec04bcb94e71fac5a2cc0fb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '96d21fa2-091f-4692-a58b-c8bf97eaaca6', 'created_at': datetime.datetime(2026, 7, 10, 14, 3, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 14, 3, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/96d21fa2-091f-4692-a58b-c8bf97eaaca6/file', 'properties': {}}, 'image_service': }' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:03:31 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c84d50b0-ac03-4e36-8661-c929cd8a02de tempest-TestInstancesWithCinderVolumes-307781406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7971b096-b9c5-4e0b-a6fa-c9f8bceacc34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:03:31 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c84d50b0-ac03-4e36-8661-c929cd8a02de tempest-TestInstancesWithCinderVolumes-307781406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7971b096-b9c5-4e0b-a6fa-c9f8bceacc34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:03:31 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c84d50b0-ac03-4e36-8661-c929cd8a02de tempest-TestInstancesWithCinderVolumes-307781406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (957fe318-a92c-4fdc-a7d4-be45b8b81674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:03:31 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-c84d50b0-ac03-4e36-8661-c929cd8a02de tempest-TestInstancesWithCinderVolumes-307781406 None] Volume deae5f30-e9e3-4ad1-bfbb-ae25e4854dc8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-deae5f30-e9e3-4ad1-bfbb-ae25e4854dc8', 'volume_size': 1, 'image_id': '96d21fa2-091f-4692-a58b-c8bf97eaaca6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/96d21fa2-091f-4692-a58b-c8bf97eaaca6', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1179636598', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9754ab591ec04bcb94e71fac5a2cc0fb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '96d21fa2-091f-4692-a58b-c8bf97eaaca6', 'created_at': datetime.datetime(2026, 7, 10, 14, 3, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 14, 3, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/96d21fa2-091f-4692-a58b-c8bf97eaaca6/file', 'properties': {}}, 'image_service': } Jul 10 16:03:31 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-c84d50b0-ac03-4e36-8661-c929cd8a02de tempest-TestInstancesWithCinderVolumes-307781406 None] Trying to clone deae5f30-e9e3-4ad1-bfbb-ae25e4854dc8 from image 96d21fa2-091f-4692-a58b-c8bf97eaaca6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/96d21fa2-091f-4692-a58b-c8bf97eaaca6', 'metadata': {}}]). {{(pid=87420) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 10 16:03:31 devstack sudo[101526]: pam_unix(sudo:session): session closed for user root Jul 10 16:03:31 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c8e5fd69-7f29-40c6-98f8-9e685e4e10d7 tempest-TestInstancesWithCinderVolumes-307781406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ca2ea565-bb26-41b8-aa98-4abe9a6ff98a" returned: 0 in 0.848s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:03:31 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-c8e5fd69-7f29-40c6-98f8-9e685e4e10d7 tempest-TestInstancesWithCinderVolumes-307781406 None] <== create_volume: return (1977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 16:03:31 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-c8e5fd69-7f29-40c6-98f8-9e685e4e10d7 tempest-TestInstancesWithCinderVolumes-307781406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.984s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:03:31 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-86176d43-a4b5-4399-a016-de681afc1308 tempest-TestInstancesWithCinderVolumes-307781406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.508s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:03:31 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-86176d43-a4b5-4399-a016-de681afc1308 tempest-TestInstancesWithCinderVolumes-307781406 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:03:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1844059121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d2fd772-ca7d-43c2-83cb-93505d505859,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9754ab591ec04bcb94e71fac5a2cc0fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:03:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:03:30Z,use_quota=True,user_id='29d157c319544e52841406dd5473776f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ffcf8557-44fd-4eaf-b49b-c23718706d53),volume_type_id=ffcf8557-44fd-4eaf-b49b-c23718706d53)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 16:03:31 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-86176d43-a4b5-4399-a016-de681afc1308 tempest-TestInstancesWithCinderVolumes-307781406 None] Creating volume 3d2fd772-ca7d-43c2-83cb-93505d505859 {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 16:03:31 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-86176d43-a4b5-4399-a016-de681afc1308 tempest-TestInstancesWithCinderVolumes-307781406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:03:31 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-86176d43-a4b5-4399-a016-de681afc1308 tempest-TestInstancesWithCinderVolumes-307781406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:03:31 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-86176d43-a4b5-4399-a016-de681afc1308 tempest-TestInstancesWithCinderVolumes-307781406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:03:31 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-86176d43-a4b5-4399-a016-de681afc1308 tempest-TestInstancesWithCinderVolumes-307781406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:03:31 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-86176d43-a4b5-4399-a016-de681afc1308 tempest-TestInstancesWithCinderVolumes-307781406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:03:31 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-86176d43-a4b5-4399-a016-de681afc1308 tempest-TestInstancesWithCinderVolumes-307781406 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 16:03:31 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-86176d43-a4b5-4399-a016-de681afc1308 tempest-TestInstancesWithCinderVolumes-307781406 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 16:03:31 devstack sudo[101528]: pam_unix(sudo:session): session closed for user root Jul 10 16:03:31 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-86176d43-a4b5-4399-a016-de681afc1308 tempest-TestInstancesWithCinderVolumes-307781406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3d2fd772-ca7d-43c2-83cb-93505d505859 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:03:31 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c8e5fd69-7f29-40c6-98f8-9e685e4e10d7 tempest-TestInstancesWithCinderVolumes-307781406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47ad4b49-58ee-402d-9bed-8d1d64883748) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca2ea565-bb26-41b8-aa98-4abe9a6ff98a', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:03:31 devstack sudo[101532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3d2fd772-ca7d-43c2-83cb-93505d505859 1073741824 Jul 10 16:03:31 devstack sudo[101532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:03:31 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c8e5fd69-7f29-40c6-98f8-9e685e4e10d7 tempest-TestInstancesWithCinderVolumes-307781406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eee926fb-08fc-4184-a24c-36c6dee16d62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:03:31 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-2902dc51-e87b-43cd-a36d-96cbf09d3964 tempest-SnapshotDependencyTests-546132345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.857s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:03:31 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-2902dc51-e87b-43cd-a36d-96cbf09d3964 tempest-SnapshotDependencyTests-546132345 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:03:32 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-c8e5fd69-7f29-40c6-98f8-9e685e4e10d7 tempest-TestInstancesWithCinderVolumes-307781406 None] Volume volume-ca2ea565-bb26-41b8-aa98-4abe9a6ff98a (ca2ea565-bb26-41b8-aa98-4abe9a6ff98a): created successfully Jul 10 16:03:32 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c8e5fd69-7f29-40c6-98f8-9e685e4e10d7 tempest-TestInstancesWithCinderVolumes-307781406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eee926fb-08fc-4184-a24c-36c6dee16d62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:03:32 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c8e5fd69-7f29-40c6-98f8-9e685e4e10d7 tempest-TestInstancesWithCinderVolumes-307781406 None] Flow 'volume_create_manager' (8e063f42-815a-49e7-9e79-2826c5378ee9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:03:32 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-2902dc51-e87b-43cd-a36d-96cbf09d3964 tempest-SnapshotDependencyTests-546132345 None] Deleted volume successfully. Jul 10 16:03:32 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-c8e5fd69-7f29-40c6-98f8-9e685e4e10d7 tempest-TestInstancesWithCinderVolumes-307781406 None] Created volume successfully. Jul 10 16:03:32 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-2902dc51-e87b-43cd-a36d-96cbf09d3964 tempest-SnapshotDependencyTests-546132345 None] Lock "cinder-b9879c6a-ca3d-4134-ac0e-ad1c688ff919-delete_volume" released by "delete_volume" :: held 3.109s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:03:32 devstack sudo[101532]: pam_unix(sudo:session): session closed for user root Jul 10 16:03:32 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-86176d43-a4b5-4399-a016-de681afc1308 tempest-TestInstancesWithCinderVolumes-307781406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3d2fd772-ca7d-43c2-83cb-93505d505859 1073741824" returned: 0 in 0.990s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:03:32 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-86176d43-a4b5-4399-a016-de681afc1308 tempest-TestInstancesWithCinderVolumes-307781406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3d2fd772-ca7d-43c2-83cb-93505d505859 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:03:33 devstack sudo[101539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3d2fd772-ca7d-43c2-83cb-93505d505859 Jul 10 16:03:33 devstack sudo[101539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:03:33 devstack sudo[101539]: pam_unix(sudo:session): session closed for user root Jul 10 16:03:33 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-86176d43-a4b5-4399-a016-de681afc1308 tempest-TestInstancesWithCinderVolumes-307781406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3d2fd772-ca7d-43c2-83cb-93505d505859" returned: 0 in 0.747s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:03:33 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-86176d43-a4b5-4399-a016-de681afc1308 tempest-TestInstancesWithCinderVolumes-307781406 None] <== create_volume: return (1794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 16:03:33 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-86176d43-a4b5-4399-a016-de681afc1308 tempest-TestInstancesWithCinderVolumes-307781406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.804s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:03:33 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-86176d43-a4b5-4399-a016-de681afc1308 tempest-TestInstancesWithCinderVolumes-307781406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85950117-ca19-4361-8549-e942ac02b8a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d2fd772-ca7d-43c2-83cb-93505d505859', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:03:33 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-86176d43-a4b5-4399-a016-de681afc1308 tempest-TestInstancesWithCinderVolumes-307781406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e65b20d-c370-4c84-b0ce-339a3e86c695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:03:33 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-86176d43-a4b5-4399-a016-de681afc1308 tempest-TestInstancesWithCinderVolumes-307781406 None] Volume volume-3d2fd772-ca7d-43c2-83cb-93505d505859 (3d2fd772-ca7d-43c2-83cb-93505d505859): created successfully Jul 10 16:03:33 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-86176d43-a4b5-4399-a016-de681afc1308 tempest-TestInstancesWithCinderVolumes-307781406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e65b20d-c370-4c84-b0ce-339a3e86c695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:03:33 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-86176d43-a4b5-4399-a016-de681afc1308 tempest-TestInstancesWithCinderVolumes-307781406 None] Flow 'volume_create_manager' (f8acf70a-de7c-44cb-9dd1-6e0cf4ffe267) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:03:33 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-86176d43-a4b5-4399-a016-de681afc1308 tempest-TestInstancesWithCinderVolumes-307781406 None] Created volume successfully. Jul 10 16:03:35 devstack cinder-volume[87420]: DEBUG cinder.image.image_utils [None req-c84d50b0-ac03-4e36-8661-c929cd8a02de tempest-TestInstancesWithCinderVolumes-307781406 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_96d21fa2-091f-4692-a58b-c8bf97eaaca6_g7mxmhj5devstack@QuobyteHD, size 20.69 MB, duration 4.03 sec {{(pid=87420) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 10 16:03:35 devstack cinder-volume[87420]: INFO cinder.image.image_utils [None req-c84d50b0-ac03-4e36-8661-c929cd8a02de tempest-TestInstancesWithCinderVolumes-307781406 None] Image download 20.69 MB at 5.14 MB/s Jul 10 16:03:35 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf9b66a6-7824-4add-bee5-4c148c08045e]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:03:35 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c84d50b0-ac03-4e36-8661-c929cd8a02de tempest-TestInstancesWithCinderVolumes-307781406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_96d21fa2-091f-4692-a58b-c8bf97eaaca6_g7mxmhj5devstack@QuobyteHD {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:03:35 devstack sudo[101578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_96d21fa2-091f-4692-a58b-c8bf97eaaca6_g7mxmhj5devstack@QuobyteHD Jul 10 16:03:35 devstack sudo[101578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:03:36 devstack sudo[101578]: pam_unix(sudo:session): session closed for user root Jul 10 16:03:36 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c84d50b0-ac03-4e36-8661-c929cd8a02de tempest-TestInstancesWithCinderVolumes-307781406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_96d21fa2-091f-4692-a58b-c8bf97eaaca6_g7mxmhj5devstack@QuobyteHD" returned: 0 in 0.824s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:03:36 devstack cinder-volume[87420]: DEBUG cinder.image.image_utils [None req-c84d50b0-ac03-4e36-8661-c929cd8a02de tempest-TestInstancesWithCinderVolumes-307781406 None] Temporary image 96d21fa2-091f-4692-a58b-c8bf97eaaca6 is fetched for user 29d157c319544e52841406dd5473776f. {{(pid=87420) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 10 16:03:36 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[a14a90ce-331d-4266-8ee1-cee4a379de22]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:03:36 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c84d50b0-ac03-4e36-8661-c929cd8a02de tempest-TestInstancesWithCinderVolumes-307781406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_96d21fa2-091f-4692-a58b-c8bf97eaaca6_g7mxmhj5devstack@QuobyteHD {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:03:36 devstack sudo[101585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_96d21fa2-091f-4692-a58b-c8bf97eaaca6_g7mxmhj5devstack@QuobyteHD Jul 10 16:03:36 devstack sudo[101585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:03:37 devstack sudo[101585]: pam_unix(sudo:session): session closed for user root Jul 10 16:03:37 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c84d50b0-ac03-4e36-8661-c929cd8a02de tempest-TestInstancesWithCinderVolumes-307781406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_96d21fa2-091f-4692-a58b-c8bf97eaaca6_g7mxmhj5devstack@QuobyteHD" returned: 0 in 0.877s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:03:37 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-c84d50b0-ac03-4e36-8661-c929cd8a02de tempest-TestInstancesWithCinderVolumes-307781406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:03:37 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-c84d50b0-ac03-4e36-8661-c929cd8a02de tempest-TestInstancesWithCinderVolumes-307781406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:03:37 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-c84d50b0-ac03-4e36-8661-c929cd8a02de tempest-TestInstancesWithCinderVolumes-307781406 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:03:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1934514979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=deae5f30-e9e3-4ad1-bfbb-ae25e4854dc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9754ab591ec04bcb94e71fac5a2cc0fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:03:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:03:31Z,use_quota=True,user_id='29d157c319544e52841406dd5473776f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9cca6b9e-d82c-4e8b-ac86-d7961e54c56b),volume_type_id=9cca6b9e-d82c-4e8b-ac86-d7961e54c56b)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 16:03:37 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-c84d50b0-ac03-4e36-8661-c929cd8a02de tempest-TestInstancesWithCinderVolumes-307781406 None] Creating volume deae5f30-e9e3-4ad1-bfbb-ae25e4854dc8 {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 16:03:37 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-c84d50b0-ac03-4e36-8661-c929cd8a02de tempest-TestInstancesWithCinderVolumes-307781406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:03:37 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-c84d50b0-ac03-4e36-8661-c929cd8a02de tempest-TestInstancesWithCinderVolumes-307781406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:03:37 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-c84d50b0-ac03-4e36-8661-c929cd8a02de tempest-TestInstancesWithCinderVolumes-307781406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:03:37 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-c84d50b0-ac03-4e36-8661-c929cd8a02de tempest-TestInstancesWithCinderVolumes-307781406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:03:37 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-c84d50b0-ac03-4e36-8661-c929cd8a02de tempest-TestInstancesWithCinderVolumes-307781406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:03:37 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-c84d50b0-ac03-4e36-8661-c929cd8a02de tempest-TestInstancesWithCinderVolumes-307781406 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 16:03:37 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-c84d50b0-ac03-4e36-8661-c929cd8a02de tempest-TestInstancesWithCinderVolumes-307781406 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 16:03:37 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c84d50b0-ac03-4e36-8661-c929cd8a02de tempest-TestInstancesWithCinderVolumes-307781406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-deae5f30-e9e3-4ad1-bfbb-ae25e4854dc8 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:03:37 devstack sudo[101594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-deae5f30-e9e3-4ad1-bfbb-ae25e4854dc8 1073741824 Jul 10 16:03:37 devstack sudo[101594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:03:38 devstack sudo[101594]: pam_unix(sudo:session): session closed for user root Jul 10 16:03:38 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c84d50b0-ac03-4e36-8661-c929cd8a02de tempest-TestInstancesWithCinderVolumes-307781406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-deae5f30-e9e3-4ad1-bfbb-ae25e4854dc8 1073741824" returned: 0 in 1.049s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:03:38 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c84d50b0-ac03-4e36-8661-c929cd8a02de tempest-TestInstancesWithCinderVolumes-307781406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-deae5f30-e9e3-4ad1-bfbb-ae25e4854dc8 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:03:38 devstack sudo[101606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-deae5f30-e9e3-4ad1-bfbb-ae25e4854dc8 Jul 10 16:03:38 devstack sudo[101606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:03:39 devstack sudo[101606]: pam_unix(sudo:session): session closed for user root Jul 10 16:03:39 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c84d50b0-ac03-4e36-8661-c929cd8a02de tempest-TestInstancesWithCinderVolumes-307781406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-deae5f30-e9e3-4ad1-bfbb-ae25e4854dc8" returned: 0 in 0.955s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:03:39 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-c84d50b0-ac03-4e36-8661-c929cd8a02de tempest-TestInstancesWithCinderVolumes-307781406 None] <== create_volume: return (2062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 16:03:39 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-c84d50b0-ac03-4e36-8661-c929cd8a02de tempest-TestInstancesWithCinderVolumes-307781406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.072s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:03:39 devstack cinder-volume[87420]: DEBUG cinder.volume.volume_utils [None req-c84d50b0-ac03-4e36-8661-c929cd8a02de tempest-TestInstancesWithCinderVolumes-307781406 None] Attempting download of 96d21fa2-091f-4692-a58b-c8bf97eaaca6 ((None, [{'url': 'file:///opt/stack/data/glance/images/96d21fa2-091f-4692-a58b-c8bf97eaaca6', 'metadata': {}}])) to volume deae5f30-e9e3-4ad1-bfbb-ae25e4854dc8. {{(pid=87420) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 10 16:03:39 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e208922-9893-42eb-8a22-aab5ff575958]: (4, 'raw') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:03:39 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c84d50b0-ac03-4e36-8661-c929cd8a02de tempest-TestInstancesWithCinderVolumes-307781406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_96d21fa2-091f-4692-a58b-c8bf97eaaca6_ksmi9v5f {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:03:39 devstack sudo[101609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_96d21fa2-091f-4692-a58b-c8bf97eaaca6_ksmi9v5f Jul 10 16:03:39 devstack sudo[101609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:03:40 devstack sudo[101609]: pam_unix(sudo:session): session closed for user root Jul 10 16:03:40 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c84d50b0-ac03-4e36-8661-c929cd8a02de tempest-TestInstancesWithCinderVolumes-307781406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_96d21fa2-091f-4692-a58b-c8bf97eaaca6_ksmi9v5f" returned: 0 in 0.886s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:03:40 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c84d50b0-ac03-4e36-8661-c929cd8a02de tempest-TestInstancesWithCinderVolumes-307781406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_96d21fa2-091f-4692-a58b-c8bf97eaaca6_ksmi9v5f {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:03:40 devstack sudo[101614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_96d21fa2-091f-4692-a58b-c8bf97eaaca6_ksmi9v5f Jul 10 16:03:40 devstack sudo[101614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:03:41 devstack sudo[101614]: pam_unix(sudo:session): session closed for user root Jul 10 16:03:41 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c84d50b0-ac03-4e36-8661-c929cd8a02de tempest-TestInstancesWithCinderVolumes-307781406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_96d21fa2-091f-4692-a58b-c8bf97eaaca6_ksmi9v5f" returned: 1 in 0.904s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:03:41 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c84d50b0-ac03-4e36-8661-c929cd8a02de tempest-TestInstancesWithCinderVolumes-307781406 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_96d21fa2-091f-4692-a58b-c8bf97eaaca6_ksmi9v5f' failed. Not Retrying. {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 16:03:41 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[75f775bb-78ba-417c-b303-8d3c2f13b7b8]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:03:41 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c84d50b0-ac03-4e36-8661-c929cd8a02de tempest-TestInstancesWithCinderVolumes-307781406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_96d21fa2-091f-4692-a58b-c8bf97eaaca6_g7mxmhj5devstack@QuobyteHD {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:03:41 devstack sudo[101619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_96d21fa2-091f-4692-a58b-c8bf97eaaca6_g7mxmhj5devstack@QuobyteHD Jul 10 16:03:41 devstack sudo[101619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:03:41 devstack sudo[101619]: pam_unix(sudo:session): session closed for user root Jul 10 16:03:41 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c84d50b0-ac03-4e36-8661-c929cd8a02de tempest-TestInstancesWithCinderVolumes-307781406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_96d21fa2-091f-4692-a58b-c8bf97eaaca6_g7mxmhj5devstack@QuobyteHD" returned: 0 in 0.804s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:03:41 devstack cinder-volume[87420]: DEBUG cinder.image.image_utils [None req-c84d50b0-ac03-4e36-8661-c929cd8a02de tempest-TestInstancesWithCinderVolumes-307781406 None] 96d21fa2-091f-4692-a58b-c8bf97eaaca6 was qcow2, converting to raw {{(pid=87420) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 10 16:03:42 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c84d50b0-ac03-4e36-8661-c929cd8a02de tempest-TestInstancesWithCinderVolumes-307781406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_96d21fa2-091f-4692-a58b-c8bf97eaaca6_g7mxmhj5devstack@QuobyteHD /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-deae5f30-e9e3-4ad1-bfbb-ae25e4854dc8 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:03:42 devstack sudo[101626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_96d21fa2-091f-4692-a58b-c8bf97eaaca6_g7mxmhj5devstack@QuobyteHD /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-deae5f30-e9e3-4ad1-bfbb-ae25e4854dc8 Jul 10 16:03:42 devstack sudo[101626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:03:43 devstack sudo[101626]: pam_unix(sudo:session): session closed for user root Jul 10 16:03:43 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c84d50b0-ac03-4e36-8661-c929cd8a02de tempest-TestInstancesWithCinderVolumes-307781406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_96d21fa2-091f-4692-a58b-c8bf97eaaca6_g7mxmhj5devstack@QuobyteHD /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-deae5f30-e9e3-4ad1-bfbb-ae25e4854dc8" returned: 0 in 1.879s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:03:43 devstack cinder-volume[87420]: DEBUG cinder.image.image_utils [None req-c84d50b0-ac03-4e36-8661-c929cd8a02de tempest-TestInstancesWithCinderVolumes-307781406 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_96d21fa2-091f-4692-a58b-c8bf97eaaca6_g7mxmhj5devstack@QuobyteHD, size 112.00 MB, duration 1.88 sec, destination /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-deae5f30-e9e3-4ad1-bfbb-ae25e4854dc8 {{(pid=87420) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 16:03:43 devstack cinder-volume[87420]: INFO cinder.image.image_utils [None req-c84d50b0-ac03-4e36-8661-c929cd8a02de tempest-TestInstancesWithCinderVolumes-307781406 None] Converted 112.00 MB image at 59.54 MB/s Jul 10 16:03:43 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c84d50b0-ac03-4e36-8661-c929cd8a02de tempest-TestInstancesWithCinderVolumes-307781406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-deae5f30-e9e3-4ad1-bfbb-ae25e4854dc8 1G {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:03:43 devstack sudo[101639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-deae5f30-e9e3-4ad1-bfbb-ae25e4854dc8 1G Jul 10 16:03:43 devstack sudo[101639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:03:44 devstack sudo[101639]: pam_unix(sudo:session): session closed for user root Jul 10 16:03:44 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c84d50b0-ac03-4e36-8661-c929cd8a02de tempest-TestInstancesWithCinderVolumes-307781406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-deae5f30-e9e3-4ad1-bfbb-ae25e4854dc8 1G" returned: 0 in 0.721s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:03:44 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[1912c00e-e22c-4b23-869f-04547ae03756]: (4, 'raw') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:03:44 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c84d50b0-ac03-4e36-8661-c929cd8a02de tempest-TestInstancesWithCinderVolumes-307781406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-deae5f30-e9e3-4ad1-bfbb-ae25e4854dc8 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:03:44 devstack sudo[101644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-deae5f30-e9e3-4ad1-bfbb-ae25e4854dc8 Jul 10 16:03:44 devstack sudo[101644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:03:45 devstack sudo[101644]: pam_unix(sudo:session): session closed for user root Jul 10 16:03:45 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c84d50b0-ac03-4e36-8661-c929cd8a02de tempest-TestInstancesWithCinderVolumes-307781406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-deae5f30-e9e3-4ad1-bfbb-ae25e4854dc8" returned: 0 in 0.767s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:03:45 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c84d50b0-ac03-4e36-8661-c929cd8a02de tempest-TestInstancesWithCinderVolumes-307781406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-deae5f30-e9e3-4ad1-bfbb-ae25e4854dc8 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:03:45 devstack sudo[101648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-deae5f30-e9e3-4ad1-bfbb-ae25e4854dc8 Jul 10 16:03:45 devstack sudo[101648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:03:46 devstack sudo[101648]: pam_unix(sudo:session): session closed for user root Jul 10 16:03:46 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c84d50b0-ac03-4e36-8661-c929cd8a02de tempest-TestInstancesWithCinderVolumes-307781406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-deae5f30-e9e3-4ad1-bfbb-ae25e4854dc8" returned: 1 in 0.775s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:03:46 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c84d50b0-ac03-4e36-8661-c929cd8a02de tempest-TestInstancesWithCinderVolumes-307781406 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-deae5f30-e9e3-4ad1-bfbb-ae25e4854dc8' failed. Not Retrying. {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 16:03:46 devstack cinder-volume[87420]: DEBUG cinder.volume.volume_utils [None req-c84d50b0-ac03-4e36-8661-c929cd8a02de tempest-TestInstancesWithCinderVolumes-307781406 None] Downloaded image 96d21fa2-091f-4692-a58b-c8bf97eaaca6 ((None, [{'url': 'file:///opt/stack/data/glance/images/96d21fa2-091f-4692-a58b-c8bf97eaaca6', 'metadata': {}}])) to volume deae5f30-e9e3-4ad1-bfbb-ae25e4854dc8 successfully. {{(pid=87420) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 10 16:03:46 devstack cinder-volume[87420]: DEBUG cinder.image.image_utils [None req-c84d50b0-ac03-4e36-8661-c929cd8a02de tempest-TestInstancesWithCinderVolumes-307781406 None] Temporary image 96d21fa2-091f-4692-a58b-c8bf97eaaca6 for user 29d157c319544e52841406dd5473776f is deleted. {{(pid=87420) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 10 16:03:46 devstack cinder-volume[87420]: DEBUG cinder.volume.volume_utils [None req-c84d50b0-ac03-4e36-8661-c929cd8a02de tempest-TestInstancesWithCinderVolumes-307781406 None] Marking volume deae5f30-e9e3-4ad1-bfbb-ae25e4854dc8 as bootable. {{(pid=87420) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 10 16:03:46 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-c84d50b0-ac03-4e36-8661-c929cd8a02de tempest-TestInstancesWithCinderVolumes-307781406 None] Copying metadata from image 96d21fa2-091f-4692-a58b-c8bf97eaaca6 to deae5f30-e9e3-4ad1-bfbb-ae25e4854dc8. {{(pid=87420) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 10 16:03:46 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-c84d50b0-ac03-4e36-8661-c929cd8a02de tempest-TestInstancesWithCinderVolumes-307781406 None] Creating volume glance metadata for volume deae5f30-e9e3-4ad1-bfbb-ae25e4854dc8 backed by image 96d21fa2-091f-4692-a58b-c8bf97eaaca6 with: {'image_id': '96d21fa2-091f-4692-a58b-c8bf97eaaca6', 'image_name': 'tempest-scenario-img--1179636598', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87420) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 10 16:03:46 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c84d50b0-ac03-4e36-8661-c929cd8a02de tempest-TestInstancesWithCinderVolumes-307781406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (957fe318-a92c-4fdc-a7d4-be45b8b81674) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-deae5f30-e9e3-4ad1-bfbb-ae25e4854dc8', 'volume_size': 1, 'image_id': '96d21fa2-091f-4692-a58b-c8bf97eaaca6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/96d21fa2-091f-4692-a58b-c8bf97eaaca6', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1179636598', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9754ab591ec04bcb94e71fac5a2cc0fb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '96d21fa2-091f-4692-a58b-c8bf97eaaca6', 'created_at': datetime.datetime(2026, 7, 10, 14, 3, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 14, 3, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/96d21fa2-091f-4692-a58b-c8bf97eaaca6/file', 'properties': {}}, 'image_service': }' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:03:46 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c84d50b0-ac03-4e36-8661-c929cd8a02de tempest-TestInstancesWithCinderVolumes-307781406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9055924f-beb0-48a0-845b-ba6340ece253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:03:46 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-c84d50b0-ac03-4e36-8661-c929cd8a02de tempest-TestInstancesWithCinderVolumes-307781406 None] Volume volume-deae5f30-e9e3-4ad1-bfbb-ae25e4854dc8 (deae5f30-e9e3-4ad1-bfbb-ae25e4854dc8): created successfully Jul 10 16:03:46 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c84d50b0-ac03-4e36-8661-c929cd8a02de tempest-TestInstancesWithCinderVolumes-307781406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9055924f-beb0-48a0-845b-ba6340ece253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:03:46 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c84d50b0-ac03-4e36-8661-c929cd8a02de tempest-TestInstancesWithCinderVolumes-307781406 None] Flow 'volume_create_manager' (d381f5e0-7f6e-484f-b1a7-6f7c204f77e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:03:46 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-c84d50b0-ac03-4e36-8661-c929cd8a02de tempest-TestInstancesWithCinderVolumes-307781406 None] Created volume successfully. Jul 10 16:03:54 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [req-2037d8e4-ff58-44dd-9724-408d8f9a4d08 req-fb23a271-0c12-441f-8eb3-378f7f32c906 tempest-TestInstancesWithCinderVolumes-307781406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:03:54 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [req-2037d8e4-ff58-44dd-9724-408d8f9a4d08 req-fb23a271-0c12-441f-8eb3-378f7f32c906 tempest-TestInstancesWithCinderVolumes-307781406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:03:54 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae68a89-3c55-427c-b780-d9a62f79171d]: (4, 'raw') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:03:54 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [req-2037d8e4-ff58-44dd-9724-408d8f9a4d08 req-fb23a271-0c12-441f-8eb3-378f7f32c906 tempest-TestInstancesWithCinderVolumes-307781406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-deae5f30-e9e3-4ad1-bfbb-ae25e4854dc8 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:03:54 devstack sudo[101723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-deae5f30-e9e3-4ad1-bfbb-ae25e4854dc8 Jul 10 16:03:54 devstack sudo[101723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:03:55 devstack sudo[101723]: pam_unix(sudo:session): session closed for user root Jul 10 16:03:55 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [req-2037d8e4-ff58-44dd-9724-408d8f9a4d08 req-fb23a271-0c12-441f-8eb3-378f7f32c906 tempest-TestInstancesWithCinderVolumes-307781406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-deae5f30-e9e3-4ad1-bfbb-ae25e4854dc8" returned: 0 in 0.862s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:03:55 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [req-2037d8e4-ff58-44dd-9724-408d8f9a4d08 req-fb23a271-0c12-441f-8eb3-378f7f32c906 tempest-TestInstancesWithCinderVolumes-307781406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-deae5f30-e9e3-4ad1-bfbb-ae25e4854dc8 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:03:55 devstack sudo[101730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-deae5f30-e9e3-4ad1-bfbb-ae25e4854dc8 Jul 10 16:03:55 devstack sudo[101730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:03:56 devstack sudo[101730]: pam_unix(sudo:session): session closed for user root Jul 10 16:03:56 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [req-2037d8e4-ff58-44dd-9724-408d8f9a4d08 req-fb23a271-0c12-441f-8eb3-378f7f32c906 tempest-TestInstancesWithCinderVolumes-307781406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-deae5f30-e9e3-4ad1-bfbb-ae25e4854dc8" returned: 1 in 0.835s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:03:56 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [req-2037d8e4-ff58-44dd-9724-408d8f9a4d08 req-fb23a271-0c12-441f-8eb3-378f7f32c906 tempest-TestInstancesWithCinderVolumes-307781406 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-deae5f30-e9e3-4ad1-bfbb-ae25e4854dc8' failed. Not Retrying. {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 16:03:56 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [req-2037d8e4-ff58-44dd-9724-408d8f9a4d08 req-fb23a271-0c12-441f-8eb3-378f7f32c906 tempest-TestInstancesWithCinderVolumes-307781406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.753s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:03:56 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [req-2037d8e4-ff58-44dd-9724-408d8f9a4d08 req-fb23a271-0c12-441f-8eb3-378f7f32c906 tempest-TestInstancesWithCinderVolumes-307781406 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80', 'name': 'volume-deae5f30-e9e3-4ad1-bfbb-ae25e4854dc8', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5a955eda-f5c6-423f-a73d-dd2d2f81ca5d', 'enforce_multipath': True} {{(pid=87420) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 16:03:56 devstack cinder-volume[87420]: INFO cinder.volume.manager [req-2037d8e4-ff58-44dd-9724-408d8f9a4d08 req-fb23a271-0c12-441f-8eb3-378f7f32c906 tempest-TestInstancesWithCinderVolumes-307781406 None] attachment_update completed successfully. Jul 10 16:04:06 devstack cinder-volume[87420]: DEBUG dbcounter [-] [87420] Writing DB stats cinder:UPDATE=38,cinder:SELECT=38,cinder:DELETE=5,cinder:INSERT=18 {{(pid=87420) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 16:04:06 devstack cinder-volume[87420]: DEBUG dbcounter [-] [87420] Writing DB stats cinder:SELECT=43,cinder:UPDATE=41,cinder:DELETE=2,cinder:INSERT=7 {{(pid=87420) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 16:04:17 devstack cinder-volume[87420]: DEBUG oslo_service.periodic_task [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87420) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 16:04:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:04:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:04:17 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:04:17 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:04:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:04:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:04:17 devstack sudo[101880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:04:17 devstack sudo[101880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:04:18 devstack sudo[101880]: pam_unix(sudo:session): session closed for user root Jul 10 16:04:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.765s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:04:18 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:04:18 devstack cinder-volume[87420]: DEBUG oslo_service.periodic_task [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Running periodic task VolumeManager._thread_info {{(pid=87420) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 16:04:18 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] thread count: 29 {{(pid=87420) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 16:04:18 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] thread info: [<_MainThread(MainThread, started 133639250378880)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87420) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 16:04:19 devstack cinder-volume[87420]: INFO cinder.volume.manager [req-2f77fde3-605f-422e-b972-2b784706774b req-172ed515-3de5-4a97-b1cc-c4aa45da4036 tempest-TestMinimumBasicScenario-1246116665 None] Terminate volume connection completed successfully. Jul 10 16:04:19 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [req-2f77fde3-605f-422e-b972-2b784706774b req-172ed515-3de5-4a97-b1cc-c4aa45da4036 tempest-TestMinimumBasicScenario-1246116665 None] Deleting attachment e2110a0b-7d4c-466b-bd53-fcfcd5062dfd. {{(pid=87420) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 16:04:21 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-8f5721c6-3944-4bb7-be33-d4dae287cda3 tempest-TestMinimumBasicScenario-1246116665 None] Acquiring lock "cinder-dcb72bca-705b-48f9-ba59-eb980ff0aa9c-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:04:21 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-8f5721c6-3944-4bb7-be33-d4dae287cda3 tempest-TestMinimumBasicScenario-1246116665 None] Lock "cinder-dcb72bca-705b-48f9-ba59-eb980ff0aa9c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:04:21 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-8f5721c6-3944-4bb7-be33-d4dae287cda3 tempest-TestMinimumBasicScenario-1246116665 None] Acquiring lock "cinder-quobyte-dcb72bca-705b-48f9-ba59-eb980ff0aa9c" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:04:21 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-8f5721c6-3944-4bb7-be33-d4dae287cda3 tempest-TestMinimumBasicScenario-1246116665 None] Lock "cinder-quobyte-dcb72bca-705b-48f9-ba59-eb980ff0aa9c" acquired by "delete_volume" :: waited 0.015s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:04:21 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[32998b78-5a15-467a-9159-9c96554d09b0]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:04:21 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8f5721c6-3944-4bb7-be33-d4dae287cda3 tempest-TestMinimumBasicScenario-1246116665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-dcb72bca-705b-48f9-ba59-eb980ff0aa9c {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:04:21 devstack sudo[101887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-dcb72bca-705b-48f9-ba59-eb980ff0aa9c Jul 10 16:04:21 devstack sudo[101887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:04:22 devstack sudo[101887]: pam_unix(sudo:session): session closed for user root Jul 10 16:04:22 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8f5721c6-3944-4bb7-be33-d4dae287cda3 tempest-TestMinimumBasicScenario-1246116665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-dcb72bca-705b-48f9-ba59-eb980ff0aa9c" returned: 0 in 0.752s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:04:22 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8f5721c6-3944-4bb7-be33-d4dae287cda3 tempest-TestMinimumBasicScenario-1246116665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-dcb72bca-705b-48f9-ba59-eb980ff0aa9c {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:04:22 devstack sudo[101893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-dcb72bca-705b-48f9-ba59-eb980ff0aa9c Jul 10 16:04:22 devstack sudo[101893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:04:22 devstack sudo[101893]: pam_unix(sudo:session): session closed for user root Jul 10 16:04:22 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8f5721c6-3944-4bb7-be33-d4dae287cda3 tempest-TestMinimumBasicScenario-1246116665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-dcb72bca-705b-48f9-ba59-eb980ff0aa9c" returned: 0 in 0.645s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:04:22 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-8f5721c6-3944-4bb7-be33-d4dae287cda3 tempest-TestMinimumBasicScenario-1246116665 None] Lock "cinder-quobyte-dcb72bca-705b-48f9-ba59-eb980ff0aa9c" released by "delete_volume" :: held 1.436s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:04:22 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-8f5721c6-3944-4bb7-be33-d4dae287cda3 tempest-TestMinimumBasicScenario-1246116665 None] Created reservations ['3e0f415c-7a45-4630-b4b4-a3ad923504c3', '5ae20d39-71bf-405f-9d34-9277ac8283de', '13b22370-2b96-4ec7-9b0c-447664dfd12f', '73eecdd3-a20e-4b08-9c52-908c1917628f'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:04:22 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-8f5721c6-3944-4bb7-be33-d4dae287cda3 tempest-TestMinimumBasicScenario-1246116665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:04:22 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-8f5721c6-3944-4bb7-be33-d4dae287cda3 tempest-TestMinimumBasicScenario-1246116665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:04:22 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-8f5721c6-3944-4bb7-be33-d4dae287cda3 tempest-TestMinimumBasicScenario-1246116665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:04:22 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-8f5721c6-3944-4bb7-be33-d4dae287cda3 tempest-TestMinimumBasicScenario-1246116665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:04:22 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-8f5721c6-3944-4bb7-be33-d4dae287cda3 tempest-TestMinimumBasicScenario-1246116665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:04:22 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8f5721c6-3944-4bb7-be33-d4dae287cda3 tempest-TestMinimumBasicScenario-1246116665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:04:22 devstack sudo[101896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:04:22 devstack sudo[101896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:04:23 devstack sudo[101896]: pam_unix(sudo:session): session closed for user root Jul 10 16:04:23 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8f5721c6-3944-4bb7-be33-d4dae287cda3 tempest-TestMinimumBasicScenario-1246116665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.639s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:04:23 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-8f5721c6-3944-4bb7-be33-d4dae287cda3 tempest-TestMinimumBasicScenario-1246116665 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:04:23 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-8f5721c6-3944-4bb7-be33-d4dae287cda3 tempest-TestMinimumBasicScenario-1246116665 None] Deleted volume successfully. Jul 10 16:04:23 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-8f5721c6-3944-4bb7-be33-d4dae287cda3 tempest-TestMinimumBasicScenario-1246116665 None] Lock "cinder-dcb72bca-705b-48f9-ba59-eb980ff0aa9c-delete_volume" released by "delete_volume" :: held 2.272s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:04:32 devstack cinder-volume[87420]: DEBUG dbcounter [-] [87420] Writing DB stats cinder:SELECT=6,cinder:INSERT=2,cinder:UPDATE=6 {{(pid=87420) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 16:04:32 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [req-d4e5d9b2-a808-45aa-8a5b-54081ca1b9d6 req-7c706a8a-386d-4170-9a39-7d0efbbd0d3e tempest-TestInstancesWithCinderVolumes-307781406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:04:32 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [req-d4e5d9b2-a808-45aa-8a5b-54081ca1b9d6 req-7c706a8a-386d-4170-9a39-7d0efbbd0d3e tempest-TestInstancesWithCinderVolumes-307781406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:04:32 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[a39a5f4d-54e9-4aa9-a686-5f95dbc49e31]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:04:32 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [req-d4e5d9b2-a808-45aa-8a5b-54081ca1b9d6 req-7c706a8a-386d-4170-9a39-7d0efbbd0d3e tempest-TestInstancesWithCinderVolumes-307781406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ca2ea565-bb26-41b8-aa98-4abe9a6ff98a {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:04:33 devstack sudo[101941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ca2ea565-bb26-41b8-aa98-4abe9a6ff98a Jul 10 16:04:33 devstack sudo[101941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:04:33 devstack cinder-volume[87420]: DEBUG dbcounter [-] [87420] Writing DB stats cinder:SELECT=6,cinder:UPDATE=10,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87420) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 16:04:33 devstack sudo[101941]: pam_unix(sudo:session): session closed for user root Jul 10 16:04:33 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [req-d4e5d9b2-a808-45aa-8a5b-54081ca1b9d6 req-7c706a8a-386d-4170-9a39-7d0efbbd0d3e tempest-TestInstancesWithCinderVolumes-307781406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ca2ea565-bb26-41b8-aa98-4abe9a6ff98a" returned: 0 in 0.863s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:04:33 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [req-d4e5d9b2-a808-45aa-8a5b-54081ca1b9d6 req-7c706a8a-386d-4170-9a39-7d0efbbd0d3e tempest-TestInstancesWithCinderVolumes-307781406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.885s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:04:33 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [req-d4e5d9b2-a808-45aa-8a5b-54081ca1b9d6 req-7c706a8a-386d-4170-9a39-7d0efbbd0d3e tempest-TestInstancesWithCinderVolumes-307781406 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80', 'name': 'volume-ca2ea565-bb26-41b8-aa98-4abe9a6ff98a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bfbf3f58-a1e0-42e4-9284-a7fdf138c560', 'enforce_multipath': True} {{(pid=87420) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 16:04:33 devstack cinder-volume[87420]: INFO cinder.volume.manager [req-d4e5d9b2-a808-45aa-8a5b-54081ca1b9d6 req-7c706a8a-386d-4170-9a39-7d0efbbd0d3e tempest-TestInstancesWithCinderVolumes-307781406 None] attachment_update completed successfully. Jul 10 16:04:41 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [req-eb61b9a2-186f-4e28-868f-8acee3391929 req-363a52d6-6efb-488e-bca6-780c24614daa tempest-TestInstancesWithCinderVolumes-307781406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:04:41 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [req-eb61b9a2-186f-4e28-868f-8acee3391929 req-363a52d6-6efb-488e-bca6-780c24614daa tempest-TestInstancesWithCinderVolumes-307781406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:04:41 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[4446147f-faf5-468c-84a1-e6ebd070af3a]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:04:41 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [req-eb61b9a2-186f-4e28-868f-8acee3391929 req-363a52d6-6efb-488e-bca6-780c24614daa tempest-TestInstancesWithCinderVolumes-307781406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3d2fd772-ca7d-43c2-83cb-93505d505859 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:04:41 devstack sudo[102005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3d2fd772-ca7d-43c2-83cb-93505d505859 Jul 10 16:04:41 devstack sudo[102005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:04:42 devstack sudo[102005]: pam_unix(sudo:session): session closed for user root Jul 10 16:04:42 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [req-eb61b9a2-186f-4e28-868f-8acee3391929 req-363a52d6-6efb-488e-bca6-780c24614daa tempest-TestInstancesWithCinderVolumes-307781406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3d2fd772-ca7d-43c2-83cb-93505d505859" returned: 0 in 0.803s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:04:42 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [req-eb61b9a2-186f-4e28-868f-8acee3391929 req-363a52d6-6efb-488e-bca6-780c24614daa tempest-TestInstancesWithCinderVolumes-307781406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.823s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:04:42 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [req-eb61b9a2-186f-4e28-868f-8acee3391929 req-363a52d6-6efb-488e-bca6-780c24614daa tempest-TestInstancesWithCinderVolumes-307781406 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80', 'name': 'volume-3d2fd772-ca7d-43c2-83cb-93505d505859', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a39406c1-6d10-4196-b03c-d00641f25ed6', 'enforce_multipath': True} {{(pid=87420) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 16:04:42 devstack cinder-volume[87420]: INFO cinder.volume.manager [req-eb61b9a2-186f-4e28-868f-8acee3391929 req-363a52d6-6efb-488e-bca6-780c24614daa tempest-TestInstancesWithCinderVolumes-307781406 None] attachment_update completed successfully. Jul 10 16:04:51 devstack cinder-volume[87420]: INFO cinder.volume.manager [req-ee831d83-0abc-4029-a776-2d92309c9250 req-c6f2ed8b-30a8-4692-8c16-1325db8948ba tempest-TestInstancesWithCinderVolumes-307781406 None] Terminate volume connection completed successfully. Jul 10 16:04:51 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [req-ee831d83-0abc-4029-a776-2d92309c9250 req-c6f2ed8b-30a8-4692-8c16-1325db8948ba tempest-TestInstancesWithCinderVolumes-307781406 None] Deleting attachment bfbf3f58-a1e0-42e4-9284-a7fdf138c560. {{(pid=87420) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 16:04:53 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-e2ab0514-8cb8-481d-9d45-739255b327fe tempest-TestInstancesWithCinderVolumes-307781406 None] Acquiring lock "cinder-ca2ea565-bb26-41b8-aa98-4abe9a6ff98a-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:04:53 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-e2ab0514-8cb8-481d-9d45-739255b327fe tempest-TestInstancesWithCinderVolumes-307781406 None] Lock "cinder-ca2ea565-bb26-41b8-aa98-4abe9a6ff98a-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:04:53 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-e2ab0514-8cb8-481d-9d45-739255b327fe tempest-TestInstancesWithCinderVolumes-307781406 None] Acquiring lock "cinder-quobyte-ca2ea565-bb26-41b8-aa98-4abe9a6ff98a" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:04:53 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-e2ab0514-8cb8-481d-9d45-739255b327fe tempest-TestInstancesWithCinderVolumes-307781406 None] Lock "cinder-quobyte-ca2ea565-bb26-41b8-aa98-4abe9a6ff98a" acquired by "delete_volume" :: waited 0.020s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:04:53 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d1eece-279b-48fe-8efd-537eef42fee8]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:04:53 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-e2ab0514-8cb8-481d-9d45-739255b327fe tempest-TestInstancesWithCinderVolumes-307781406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ca2ea565-bb26-41b8-aa98-4abe9a6ff98a {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:04:53 devstack sudo[102056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ca2ea565-bb26-41b8-aa98-4abe9a6ff98a Jul 10 16:04:53 devstack sudo[102056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:04:54 devstack sudo[102056]: pam_unix(sudo:session): session closed for user root Jul 10 16:04:54 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-e2ab0514-8cb8-481d-9d45-739255b327fe tempest-TestInstancesWithCinderVolumes-307781406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ca2ea565-bb26-41b8-aa98-4abe9a6ff98a" returned: 0 in 0.843s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:04:54 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-e2ab0514-8cb8-481d-9d45-739255b327fe tempest-TestInstancesWithCinderVolumes-307781406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ca2ea565-bb26-41b8-aa98-4abe9a6ff98a {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:04:54 devstack sudo[102062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ca2ea565-bb26-41b8-aa98-4abe9a6ff98a Jul 10 16:04:54 devstack sudo[102062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:04:55 devstack sudo[102062]: pam_unix(sudo:session): session closed for user root Jul 10 16:04:55 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-e2ab0514-8cb8-481d-9d45-739255b327fe tempest-TestInstancesWithCinderVolumes-307781406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ca2ea565-bb26-41b8-aa98-4abe9a6ff98a" returned: 0 in 0.813s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:04:55 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-e2ab0514-8cb8-481d-9d45-739255b327fe tempest-TestInstancesWithCinderVolumes-307781406 None] Lock "cinder-quobyte-ca2ea565-bb26-41b8-aa98-4abe9a6ff98a" released by "delete_volume" :: held 1.707s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:04:55 devstack cinder-volume[87420]: WARNING cinder.quota [None req-e2ab0514-8cb8-481d-9d45-739255b327fe tempest-TestInstancesWithCinderVolumes-307781406 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-470907192-414016833 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-470907192-414016833, it is now deprecated. Please use the default quota class for default quota. Jul 10 16:04:55 devstack cinder-volume[87420]: WARNING cinder.quota [None req-e2ab0514-8cb8-481d-9d45-739255b327fe tempest-TestInstancesWithCinderVolumes-307781406 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-470907192-414016833 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-470907192-414016833, it is now deprecated. Please use the default quota class for default quota. Jul 10 16:04:55 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-e2ab0514-8cb8-481d-9d45-739255b327fe tempest-TestInstancesWithCinderVolumes-307781406 None] Created reservations ['c6035e56-8d29-4c80-8397-c7a597787905', '87781cd6-103f-4329-b9d8-be02dbfcff11', 'fb6921df-3132-413a-98ae-f87b3a59ff0b', 'd75c379a-b95e-499e-a7a4-4374ac0c2469'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:04:55 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-e2ab0514-8cb8-481d-9d45-739255b327fe tempest-TestInstancesWithCinderVolumes-307781406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:04:55 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-e2ab0514-8cb8-481d-9d45-739255b327fe tempest-TestInstancesWithCinderVolumes-307781406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:04:55 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-e2ab0514-8cb8-481d-9d45-739255b327fe tempest-TestInstancesWithCinderVolumes-307781406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:04:55 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-e2ab0514-8cb8-481d-9d45-739255b327fe tempest-TestInstancesWithCinderVolumes-307781406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:04:55 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-e2ab0514-8cb8-481d-9d45-739255b327fe tempest-TestInstancesWithCinderVolumes-307781406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:04:55 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-e2ab0514-8cb8-481d-9d45-739255b327fe tempest-TestInstancesWithCinderVolumes-307781406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:04:55 devstack sudo[102065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:04:55 devstack sudo[102065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:04:56 devstack sudo[102065]: pam_unix(sudo:session): session closed for user root Jul 10 16:04:56 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-e2ab0514-8cb8-481d-9d45-739255b327fe tempest-TestInstancesWithCinderVolumes-307781406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.754s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:04:56 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-e2ab0514-8cb8-481d-9d45-739255b327fe tempest-TestInstancesWithCinderVolumes-307781406 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:04:56 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-e2ab0514-8cb8-481d-9d45-739255b327fe tempest-TestInstancesWithCinderVolumes-307781406 None] Deleted volume successfully. Jul 10 16:04:56 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-e2ab0514-8cb8-481d-9d45-739255b327fe tempest-TestInstancesWithCinderVolumes-307781406 None] Lock "cinder-ca2ea565-bb26-41b8-aa98-4abe9a6ff98a-delete_volume" released by "delete_volume" :: held 2.727s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:04:58 devstack cinder-volume[87420]: INFO cinder.volume.manager [req-29c55434-c1c9-467d-9eae-9c8a5300621f req-38f4cf60-0c69-4dd9-a88a-2aec6cbcaf02 tempest-TestInstancesWithCinderVolumes-307781406 None] Terminate volume connection completed successfully. Jul 10 16:04:58 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [req-29c55434-c1c9-467d-9eae-9c8a5300621f req-38f4cf60-0c69-4dd9-a88a-2aec6cbcaf02 tempest-TestInstancesWithCinderVolumes-307781406 None] Deleting attachment a39406c1-6d10-4196-b03c-d00641f25ed6. {{(pid=87420) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 16:05:00 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-4d5aa3ab-ea60-4ce9-a581-bde128d49cf4 tempest-TestInstancesWithCinderVolumes-307781406 None] Acquiring lock "cinder-3d2fd772-ca7d-43c2-83cb-93505d505859-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:05:00 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-4d5aa3ab-ea60-4ce9-a581-bde128d49cf4 tempest-TestInstancesWithCinderVolumes-307781406 None] Lock "cinder-3d2fd772-ca7d-43c2-83cb-93505d505859-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:05:00 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-4d5aa3ab-ea60-4ce9-a581-bde128d49cf4 tempest-TestInstancesWithCinderVolumes-307781406 None] Acquiring lock "cinder-quobyte-3d2fd772-ca7d-43c2-83cb-93505d505859" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:05:00 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-4d5aa3ab-ea60-4ce9-a581-bde128d49cf4 tempest-TestInstancesWithCinderVolumes-307781406 None] Lock "cinder-quobyte-3d2fd772-ca7d-43c2-83cb-93505d505859" acquired by "delete_volume" :: waited 0.025s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:05:00 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ea7777d-16c4-4e7c-8378-8a843a88d1ad]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:05:00 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4d5aa3ab-ea60-4ce9-a581-bde128d49cf4 tempest-TestInstancesWithCinderVolumes-307781406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3d2fd772-ca7d-43c2-83cb-93505d505859 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:05:00 devstack sudo[102092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3d2fd772-ca7d-43c2-83cb-93505d505859 Jul 10 16:05:00 devstack sudo[102092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:05:01 devstack sudo[102092]: pam_unix(sudo:session): session closed for user root Jul 10 16:05:01 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4d5aa3ab-ea60-4ce9-a581-bde128d49cf4 tempest-TestInstancesWithCinderVolumes-307781406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3d2fd772-ca7d-43c2-83cb-93505d505859" returned: 0 in 0.800s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:05:01 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4d5aa3ab-ea60-4ce9-a581-bde128d49cf4 tempest-TestInstancesWithCinderVolumes-307781406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3d2fd772-ca7d-43c2-83cb-93505d505859 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:05:01 devstack sudo[102098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3d2fd772-ca7d-43c2-83cb-93505d505859 Jul 10 16:05:01 devstack sudo[102098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:05:02 devstack sudo[102098]: pam_unix(sudo:session): session closed for user root Jul 10 16:05:02 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4d5aa3ab-ea60-4ce9-a581-bde128d49cf4 tempest-TestInstancesWithCinderVolumes-307781406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3d2fd772-ca7d-43c2-83cb-93505d505859" returned: 0 in 0.769s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:05:02 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-4d5aa3ab-ea60-4ce9-a581-bde128d49cf4 tempest-TestInstancesWithCinderVolumes-307781406 None] Lock "cinder-quobyte-3d2fd772-ca7d-43c2-83cb-93505d505859" released by "delete_volume" :: held 1.641s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:05:02 devstack cinder-volume[87420]: WARNING cinder.quota [None req-4d5aa3ab-ea60-4ce9-a581-bde128d49cf4 tempest-TestInstancesWithCinderVolumes-307781406 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1236013956-1472772946 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1236013956-1472772946, it is now deprecated. Please use the default quota class for default quota. Jul 10 16:05:02 devstack cinder-volume[87420]: WARNING cinder.quota [None req-4d5aa3ab-ea60-4ce9-a581-bde128d49cf4 tempest-TestInstancesWithCinderVolumes-307781406 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1236013956-1472772946 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1236013956-1472772946, it is now deprecated. Please use the default quota class for default quota. Jul 10 16:05:02 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-4d5aa3ab-ea60-4ce9-a581-bde128d49cf4 tempest-TestInstancesWithCinderVolumes-307781406 None] Created reservations ['6edc915c-d88a-456e-b4bb-56a379ddefb4', 'c3ca970b-8886-4170-8792-55d84219b5e1', '2876046b-d0c9-4630-a625-10b9031a354b', 'a8b28a39-f33a-4601-b672-3e3be910d3ea'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:05:02 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-4d5aa3ab-ea60-4ce9-a581-bde128d49cf4 tempest-TestInstancesWithCinderVolumes-307781406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:05:02 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-4d5aa3ab-ea60-4ce9-a581-bde128d49cf4 tempest-TestInstancesWithCinderVolumes-307781406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:05:02 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-4d5aa3ab-ea60-4ce9-a581-bde128d49cf4 tempest-TestInstancesWithCinderVolumes-307781406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:05:02 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-4d5aa3ab-ea60-4ce9-a581-bde128d49cf4 tempest-TestInstancesWithCinderVolumes-307781406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:05:02 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-4d5aa3ab-ea60-4ce9-a581-bde128d49cf4 tempest-TestInstancesWithCinderVolumes-307781406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:05:02 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4d5aa3ab-ea60-4ce9-a581-bde128d49cf4 tempest-TestInstancesWithCinderVolumes-307781406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:05:02 devstack sudo[102105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:05:02 devstack sudo[102105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:05:03 devstack sudo[102105]: pam_unix(sudo:session): session closed for user root Jul 10 16:05:03 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4d5aa3ab-ea60-4ce9-a581-bde128d49cf4 tempest-TestInstancesWithCinderVolumes-307781406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.877s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:05:03 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-4d5aa3ab-ea60-4ce9-a581-bde128d49cf4 tempest-TestInstancesWithCinderVolumes-307781406 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:05:03 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-4d5aa3ab-ea60-4ce9-a581-bde128d49cf4 tempest-TestInstancesWithCinderVolumes-307781406 None] Deleted volume successfully. Jul 10 16:05:03 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-4d5aa3ab-ea60-4ce9-a581-bde128d49cf4 tempest-TestInstancesWithCinderVolumes-307781406 None] Lock "cinder-3d2fd772-ca7d-43c2-83cb-93505d505859-delete_volume" released by "delete_volume" :: held 2.786s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:05:07 devstack cinder-volume[87420]: INFO cinder.volume.manager [req-6ea52307-af8b-40b3-bb4c-156b61c88f6f req-677d923c-a25f-45df-a74a-b630f37ceaef tempest-TestInstancesWithCinderVolumes-307781406 None] Terminate volume connection completed successfully. Jul 10 16:05:07 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [req-6ea52307-af8b-40b3-bb4c-156b61c88f6f req-677d923c-a25f-45df-a74a-b630f37ceaef tempest-TestInstancesWithCinderVolumes-307781406 None] Deleting attachment 5a955eda-f5c6-423f-a73d-dd2d2f81ca5d. {{(pid=87420) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 16:05:10 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-6e942a5d-4f6f-4305-a269-26c7ed0e1e6e tempest-TestInstancesWithCinderVolumes-307781406 None] Acquiring lock "cinder-deae5f30-e9e3-4ad1-bfbb-ae25e4854dc8-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:05:10 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-6e942a5d-4f6f-4305-a269-26c7ed0e1e6e tempest-TestInstancesWithCinderVolumes-307781406 None] Lock "cinder-deae5f30-e9e3-4ad1-bfbb-ae25e4854dc8-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:05:10 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-6e942a5d-4f6f-4305-a269-26c7ed0e1e6e tempest-TestInstancesWithCinderVolumes-307781406 None] Acquiring lock "cinder-quobyte-deae5f30-e9e3-4ad1-bfbb-ae25e4854dc8" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:05:10 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-6e942a5d-4f6f-4305-a269-26c7ed0e1e6e tempest-TestInstancesWithCinderVolumes-307781406 None] Lock "cinder-quobyte-deae5f30-e9e3-4ad1-bfbb-ae25e4854dc8" acquired by "delete_volume" :: waited 0.015s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:05:10 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[c065e1c3-c966-4510-ae76-796aacb640d4]: (4, 'raw') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:05:10 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6e942a5d-4f6f-4305-a269-26c7ed0e1e6e tempest-TestInstancesWithCinderVolumes-307781406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-deae5f30-e9e3-4ad1-bfbb-ae25e4854dc8 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:05:10 devstack sudo[102154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-deae5f30-e9e3-4ad1-bfbb-ae25e4854dc8 Jul 10 16:05:10 devstack sudo[102154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:05:11 devstack sudo[102154]: pam_unix(sudo:session): session closed for user root Jul 10 16:05:11 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6e942a5d-4f6f-4305-a269-26c7ed0e1e6e tempest-TestInstancesWithCinderVolumes-307781406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-deae5f30-e9e3-4ad1-bfbb-ae25e4854dc8" returned: 0 in 0.783s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:05:11 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6e942a5d-4f6f-4305-a269-26c7ed0e1e6e tempest-TestInstancesWithCinderVolumes-307781406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-deae5f30-e9e3-4ad1-bfbb-ae25e4854dc8 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:05:11 devstack sudo[102158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-deae5f30-e9e3-4ad1-bfbb-ae25e4854dc8 Jul 10 16:05:11 devstack sudo[102158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:05:12 devstack sudo[102158]: pam_unix(sudo:session): session closed for user root Jul 10 16:05:12 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6e942a5d-4f6f-4305-a269-26c7ed0e1e6e tempest-TestInstancesWithCinderVolumes-307781406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-deae5f30-e9e3-4ad1-bfbb-ae25e4854dc8" returned: 1 in 0.765s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:05:12 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6e942a5d-4f6f-4305-a269-26c7ed0e1e6e tempest-TestInstancesWithCinderVolumes-307781406 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-deae5f30-e9e3-4ad1-bfbb-ae25e4854dc8' failed. Not Retrying. {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 16:05:12 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6e942a5d-4f6f-4305-a269-26c7ed0e1e6e tempest-TestInstancesWithCinderVolumes-307781406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-deae5f30-e9e3-4ad1-bfbb-ae25e4854dc8 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:05:12 devstack sudo[102167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-deae5f30-e9e3-4ad1-bfbb-ae25e4854dc8 Jul 10 16:05:12 devstack sudo[102167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:05:13 devstack sudo[102167]: pam_unix(sudo:session): session closed for user root Jul 10 16:05:13 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6e942a5d-4f6f-4305-a269-26c7ed0e1e6e tempest-TestInstancesWithCinderVolumes-307781406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-deae5f30-e9e3-4ad1-bfbb-ae25e4854dc8" returned: 0 in 0.858s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:05:13 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-6e942a5d-4f6f-4305-a269-26c7ed0e1e6e tempest-TestInstancesWithCinderVolumes-307781406 None] Lock "cinder-quobyte-deae5f30-e9e3-4ad1-bfbb-ae25e4854dc8" released by "delete_volume" :: held 2.480s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:05:13 devstack cinder-volume[87420]: WARNING cinder.quota [None req-6e942a5d-4f6f-4305-a269-26c7ed0e1e6e tempest-TestInstancesWithCinderVolumes-307781406 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-29742076-135453327 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-29742076-135453327, it is now deprecated. Please use the default quota class for default quota. Jul 10 16:05:13 devstack cinder-volume[87420]: WARNING cinder.quota [None req-6e942a5d-4f6f-4305-a269-26c7ed0e1e6e tempest-TestInstancesWithCinderVolumes-307781406 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-29742076-135453327 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-29742076-135453327, it is now deprecated. Please use the default quota class for default quota. Jul 10 16:05:13 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-6e942a5d-4f6f-4305-a269-26c7ed0e1e6e tempest-TestInstancesWithCinderVolumes-307781406 None] Created reservations ['3a1cd363-da3b-4d1e-b364-e1eece61fddc', '22be58a8-3b22-4562-ba0d-3dca78a3fbcd', '39a3cc21-908a-4fe9-aee4-221d1ef17e99', '46001b74-8f1f-4c17-877f-96ea93651d78'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:05:13 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-6e942a5d-4f6f-4305-a269-26c7ed0e1e6e tempest-TestInstancesWithCinderVolumes-307781406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:05:13 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-6e942a5d-4f6f-4305-a269-26c7ed0e1e6e tempest-TestInstancesWithCinderVolumes-307781406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:05:13 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-6e942a5d-4f6f-4305-a269-26c7ed0e1e6e tempest-TestInstancesWithCinderVolumes-307781406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:05:13 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-6e942a5d-4f6f-4305-a269-26c7ed0e1e6e tempest-TestInstancesWithCinderVolumes-307781406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:05:13 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-6e942a5d-4f6f-4305-a269-26c7ed0e1e6e tempest-TestInstancesWithCinderVolumes-307781406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:05:13 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6e942a5d-4f6f-4305-a269-26c7ed0e1e6e tempest-TestInstancesWithCinderVolumes-307781406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:05:13 devstack sudo[102209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:05:13 devstack sudo[102209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:05:13 devstack sudo[102209]: pam_unix(sudo:session): session closed for user root Jul 10 16:05:13 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6e942a5d-4f6f-4305-a269-26c7ed0e1e6e tempest-TestInstancesWithCinderVolumes-307781406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.699s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:05:13 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-6e942a5d-4f6f-4305-a269-26c7ed0e1e6e tempest-TestInstancesWithCinderVolumes-307781406 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:05:13 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-6e942a5d-4f6f-4305-a269-26c7ed0e1e6e tempest-TestInstancesWithCinderVolumes-307781406 None] Deleted volume successfully. Jul 10 16:05:13 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-6e942a5d-4f6f-4305-a269-26c7ed0e1e6e tempest-TestInstancesWithCinderVolumes-307781406 None] Lock "cinder-deae5f30-e9e3-4ad1-bfbb-ae25e4854dc8-delete_volume" released by "delete_volume" :: held 3.412s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:05:17 devstack cinder-volume[87420]: DEBUG oslo_service.periodic_task [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87420) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 16:05:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:05:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:05:17 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:05:17 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:05:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:05:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:05:17 devstack sudo[102242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:05:17 devstack sudo[102242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:05:18 devstack sudo[102242]: pam_unix(sudo:session): session closed for user root Jul 10 16:05:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.900s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:05:18 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:05:18 devstack cinder-volume[87420]: DEBUG oslo_service.periodic_task [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Running periodic task VolumeManager._thread_info {{(pid=87420) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 16:05:18 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] thread count: 29 {{(pid=87420) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 16:05:18 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] thread info: [<_MainThread(MainThread, started 133639250378880)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87420) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 16:05:23 devstack cinder-volume[87420]: DEBUG dbcounter [-] [87420] Writing DB stats cinder:SELECT=25,cinder:UPDATE=28,cinder:INSERT=9,cinder:DELETE=2 {{(pid=87420) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 16:05:23 devstack cinder-volume[87420]: DEBUG dbcounter [-] [87420] Writing DB stats cinder:SELECT=34,cinder:UPDATE=27,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87420) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 16:05:40 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-7dd9d8c0-060d-489a-9cb7-d749d2530655 tempest-TestServerVolumeAttachScenarioOldVersion-1102919422 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 16:05:40 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-7dd9d8c0-060d-489a-9cb7-d749d2530655 tempest-TestServerVolumeAttachScenarioOldVersion-1102919422 None] Flow 'volume_create_manager' (edd3a922-00a3-4c64-a85b-98990cd8b125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:05:40 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-7dd9d8c0-060d-489a-9cb7-d749d2530655 tempest-TestServerVolumeAttachScenarioOldVersion-1102919422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78050abb-0050-4d4e-9e9f-4604ae95725d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:05:40 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-7dd9d8c0-060d-489a-9cb7-d749d2530655 tempest-TestServerVolumeAttachScenarioOldVersion-1102919422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78050abb-0050-4d4e-9e9f-4604ae95725d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:05:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-449303219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c44a29b-f522-4300-b1ee-9163aaa6d6ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fb767dd2d2f4224af60c2be9cdf6676',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:05:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:05:40Z,use_quota=True,user_id='36918ea055ae414c9a598347302f2c8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:05:40 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-7dd9d8c0-060d-489a-9cb7-d749d2530655 tempest-TestServerVolumeAttachScenarioOldVersion-1102919422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c45be4f4-69a7-4ad7-92dc-78a0fd48fee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:05:40 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-7dd9d8c0-060d-489a-9cb7-d749d2530655 tempest-TestServerVolumeAttachScenarioOldVersion-1102919422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c45be4f4-69a7-4ad7-92dc-78a0fd48fee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:05:40 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-7dd9d8c0-060d-489a-9cb7-d749d2530655 tempest-TestServerVolumeAttachScenarioOldVersion-1102919422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cdcc1c5-3647-4a33-a1ec-a75b0510662b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:05:40 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-7dd9d8c0-060d-489a-9cb7-d749d2530655 tempest-TestServerVolumeAttachScenarioOldVersion-1102919422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cdcc1c5-3647-4a33-a1ec-a75b0510662b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c44a29b-f522-4300-b1ee-9163aaa6d6ad', 'volume_name': 'volume-9c44a29b-f522-4300-b1ee-9163aaa6d6ad', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:05:40 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-7dd9d8c0-060d-489a-9cb7-d749d2530655 tempest-TestServerVolumeAttachScenarioOldVersion-1102919422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e638785f-e2d6-4d23-ad56-59f602b84e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:05:40 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-7dd9d8c0-060d-489a-9cb7-d749d2530655 tempest-TestServerVolumeAttachScenarioOldVersion-1102919422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e638785f-e2d6-4d23-ad56-59f602b84e4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:05:40 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-7dd9d8c0-060d-489a-9cb7-d749d2530655 tempest-TestServerVolumeAttachScenarioOldVersion-1102919422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cdf92c9-2456-4ab5-89e6-c2756a8a7fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:05:40 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-7dd9d8c0-060d-489a-9cb7-d749d2530655 tempest-TestServerVolumeAttachScenarioOldVersion-1102919422 None] Volume 9c44a29b-f522-4300-b1ee-9163aaa6d6ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c44a29b-f522-4300-b1ee-9163aaa6d6ad', 'volume_size': 1} Jul 10 16:05:40 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-7dd9d8c0-060d-489a-9cb7-d749d2530655 tempest-TestServerVolumeAttachScenarioOldVersion-1102919422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:05:40 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-7dd9d8c0-060d-489a-9cb7-d749d2530655 tempest-TestServerVolumeAttachScenarioOldVersion-1102919422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:05:40 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-7dd9d8c0-060d-489a-9cb7-d749d2530655 tempest-TestServerVolumeAttachScenarioOldVersion-1102919422 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:05:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-449303219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c44a29b-f522-4300-b1ee-9163aaa6d6ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fb767dd2d2f4224af60c2be9cdf6676',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:05:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:05:40Z,use_quota=True,user_id='36918ea055ae414c9a598347302f2c8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 16:05:40 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-7dd9d8c0-060d-489a-9cb7-d749d2530655 tempest-TestServerVolumeAttachScenarioOldVersion-1102919422 None] Creating volume 9c44a29b-f522-4300-b1ee-9163aaa6d6ad {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 16:05:40 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-7dd9d8c0-060d-489a-9cb7-d749d2530655 tempest-TestServerVolumeAttachScenarioOldVersion-1102919422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:05:40 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-7dd9d8c0-060d-489a-9cb7-d749d2530655 tempest-TestServerVolumeAttachScenarioOldVersion-1102919422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:05:40 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-7dd9d8c0-060d-489a-9cb7-d749d2530655 tempest-TestServerVolumeAttachScenarioOldVersion-1102919422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:05:40 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-7dd9d8c0-060d-489a-9cb7-d749d2530655 tempest-TestServerVolumeAttachScenarioOldVersion-1102919422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:05:40 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-7dd9d8c0-060d-489a-9cb7-d749d2530655 tempest-TestServerVolumeAttachScenarioOldVersion-1102919422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:05:40 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-7dd9d8c0-060d-489a-9cb7-d749d2530655 tempest-TestServerVolumeAttachScenarioOldVersion-1102919422 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 16:05:40 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-7dd9d8c0-060d-489a-9cb7-d749d2530655 tempest-TestServerVolumeAttachScenarioOldVersion-1102919422 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 16:05:40 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-7dd9d8c0-060d-489a-9cb7-d749d2530655 tempest-TestServerVolumeAttachScenarioOldVersion-1102919422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-9c44a29b-f522-4300-b1ee-9163aaa6d6ad 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:05:40 devstack sudo[102314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-9c44a29b-f522-4300-b1ee-9163aaa6d6ad 1073741824 Jul 10 16:05:40 devstack sudo[102314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:05:41 devstack sudo[102314]: pam_unix(sudo:session): session closed for user root Jul 10 16:05:41 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-7dd9d8c0-060d-489a-9cb7-d749d2530655 tempest-TestServerVolumeAttachScenarioOldVersion-1102919422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-9c44a29b-f522-4300-b1ee-9163aaa6d6ad 1073741824" returned: 0 in 0.832s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:05:41 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-7dd9d8c0-060d-489a-9cb7-d749d2530655 tempest-TestServerVolumeAttachScenarioOldVersion-1102919422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-9c44a29b-f522-4300-b1ee-9163aaa6d6ad {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:05:41 devstack sudo[102319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-9c44a29b-f522-4300-b1ee-9163aaa6d6ad Jul 10 16:05:41 devstack sudo[102319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:05:41 devstack sudo[102319]: pam_unix(sudo:session): session closed for user root Jul 10 16:05:41 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-7dd9d8c0-060d-489a-9cb7-d749d2530655 tempest-TestServerVolumeAttachScenarioOldVersion-1102919422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-9c44a29b-f522-4300-b1ee-9163aaa6d6ad" returned: 0 in 0.679s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:05:41 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-7dd9d8c0-060d-489a-9cb7-d749d2530655 tempest-TestServerVolumeAttachScenarioOldVersion-1102919422 None] <== create_volume: return (1558ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 16:05:41 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-7dd9d8c0-060d-489a-9cb7-d749d2530655 tempest-TestServerVolumeAttachScenarioOldVersion-1102919422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.561s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:05:41 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-7dd9d8c0-060d-489a-9cb7-d749d2530655 tempest-TestServerVolumeAttachScenarioOldVersion-1102919422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cdf92c9-2456-4ab5-89e6-c2756a8a7fc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c44a29b-f522-4300-b1ee-9163aaa6d6ad', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:05:41 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-7dd9d8c0-060d-489a-9cb7-d749d2530655 tempest-TestServerVolumeAttachScenarioOldVersion-1102919422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49843ab4-89f6-4ff9-8907-11e4221a0767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:05:42 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-7dd9d8c0-060d-489a-9cb7-d749d2530655 tempest-TestServerVolumeAttachScenarioOldVersion-1102919422 None] Volume volume-9c44a29b-f522-4300-b1ee-9163aaa6d6ad (9c44a29b-f522-4300-b1ee-9163aaa6d6ad): created successfully Jul 10 16:05:42 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-7dd9d8c0-060d-489a-9cb7-d749d2530655 tempest-TestServerVolumeAttachScenarioOldVersion-1102919422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49843ab4-89f6-4ff9-8907-11e4221a0767) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:05:42 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-7dd9d8c0-060d-489a-9cb7-d749d2530655 tempest-TestServerVolumeAttachScenarioOldVersion-1102919422 None] Flow 'volume_create_manager' (edd3a922-00a3-4c64-a85b-98990cd8b125) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:05:42 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-7dd9d8c0-060d-489a-9cb7-d749d2530655 tempest-TestServerVolumeAttachScenarioOldVersion-1102919422 None] Created volume successfully. Jul 10 16:05:43 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-957d989b-d139-4621-a550-68f3c71d8ab5 tempest-TestServerVolumeAttachmentScenario-1220265420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 16:05:43 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-957d989b-d139-4621-a550-68f3c71d8ab5 tempest-TestServerVolumeAttachmentScenario-1220265420 None] Flow 'volume_create_manager' (fecaf2be-bd65-498b-a6e4-950c53f69dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:05:43 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-957d989b-d139-4621-a550-68f3c71d8ab5 tempest-TestServerVolumeAttachmentScenario-1220265420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da219d22-df4a-4978-917f-31738ab5c6b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:05:43 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-957d989b-d139-4621-a550-68f3c71d8ab5 tempest-TestServerVolumeAttachmentScenario-1220265420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da219d22-df4a-4978-917f-31738ab5c6b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:05:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1163293788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8526896-b45f-4a0a-9868-72084cef4f10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06c6f50aa2704658bcba87bff2d61ae1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:05:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:05:43Z,use_quota=True,user_id='11274a62f42e49f5a5cbed73243dc396',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:05:43 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-957d989b-d139-4621-a550-68f3c71d8ab5 tempest-TestServerVolumeAttachmentScenario-1220265420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14b836c7-c833-4da6-a160-b673c0729eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:05:43 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-957d989b-d139-4621-a550-68f3c71d8ab5 tempest-TestServerVolumeAttachmentScenario-1220265420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14b836c7-c833-4da6-a160-b673c0729eaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:05:43 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-957d989b-d139-4621-a550-68f3c71d8ab5 tempest-TestServerVolumeAttachmentScenario-1220265420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc61f5cb-43cf-4523-a8c5-7ceeabd85835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:05:43 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-957d989b-d139-4621-a550-68f3c71d8ab5 tempest-TestServerVolumeAttachmentScenario-1220265420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc61f5cb-43cf-4523-a8c5-7ceeabd85835) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8526896-b45f-4a0a-9868-72084cef4f10', 'volume_name': 'volume-e8526896-b45f-4a0a-9868-72084cef4f10', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:05:43 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-957d989b-d139-4621-a550-68f3c71d8ab5 tempest-TestServerVolumeAttachmentScenario-1220265420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95b11873-e049-4da3-a430-02e1d678b4f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:05:43 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-957d989b-d139-4621-a550-68f3c71d8ab5 tempest-TestServerVolumeAttachmentScenario-1220265420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95b11873-e049-4da3-a430-02e1d678b4f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:05:43 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-957d989b-d139-4621-a550-68f3c71d8ab5 tempest-TestServerVolumeAttachmentScenario-1220265420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d795f980-ac11-4fec-b09d-57dbdfa701f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:05:43 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-957d989b-d139-4621-a550-68f3c71d8ab5 tempest-TestServerVolumeAttachmentScenario-1220265420 None] Volume e8526896-b45f-4a0a-9868-72084cef4f10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8526896-b45f-4a0a-9868-72084cef4f10', 'volume_size': 1} Jul 10 16:05:43 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-957d989b-d139-4621-a550-68f3c71d8ab5 tempest-TestServerVolumeAttachmentScenario-1220265420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:05:43 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-957d989b-d139-4621-a550-68f3c71d8ab5 tempest-TestServerVolumeAttachmentScenario-1220265420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:05:43 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-957d989b-d139-4621-a550-68f3c71d8ab5 tempest-TestServerVolumeAttachmentScenario-1220265420 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:05:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1163293788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8526896-b45f-4a0a-9868-72084cef4f10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06c6f50aa2704658bcba87bff2d61ae1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:05:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:05:43Z,use_quota=True,user_id='11274a62f42e49f5a5cbed73243dc396',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 16:05:43 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-957d989b-d139-4621-a550-68f3c71d8ab5 tempest-TestServerVolumeAttachmentScenario-1220265420 None] Creating volume e8526896-b45f-4a0a-9868-72084cef4f10 {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 16:05:43 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-957d989b-d139-4621-a550-68f3c71d8ab5 tempest-TestServerVolumeAttachmentScenario-1220265420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:05:43 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-957d989b-d139-4621-a550-68f3c71d8ab5 tempest-TestServerVolumeAttachmentScenario-1220265420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:05:43 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-957d989b-d139-4621-a550-68f3c71d8ab5 tempest-TestServerVolumeAttachmentScenario-1220265420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:05:43 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-957d989b-d139-4621-a550-68f3c71d8ab5 tempest-TestServerVolumeAttachmentScenario-1220265420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:05:43 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-957d989b-d139-4621-a550-68f3c71d8ab5 tempest-TestServerVolumeAttachmentScenario-1220265420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:05:43 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-957d989b-d139-4621-a550-68f3c71d8ab5 tempest-TestServerVolumeAttachmentScenario-1220265420 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 16:05:43 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-957d989b-d139-4621-a550-68f3c71d8ab5 tempest-TestServerVolumeAttachmentScenario-1220265420 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 16:05:43 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-957d989b-d139-4621-a550-68f3c71d8ab5 tempest-TestServerVolumeAttachmentScenario-1220265420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-e8526896-b45f-4a0a-9868-72084cef4f10 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:05:43 devstack sudo[102325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-e8526896-b45f-4a0a-9868-72084cef4f10 1073741824 Jul 10 16:05:43 devstack sudo[102325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:05:43 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-eef0caba-ce44-43eb-8353-9dc8c0b889ad tempest-TestServerVolumeAttachmentScenario-1220265420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 16:05:43 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-eef0caba-ce44-43eb-8353-9dc8c0b889ad tempest-TestServerVolumeAttachmentScenario-1220265420 None] Flow 'volume_create_manager' (68e7ff6d-3c35-4797-815a-47b8cb5f44ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:05:43 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-eef0caba-ce44-43eb-8353-9dc8c0b889ad tempest-TestServerVolumeAttachmentScenario-1220265420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b112cf3-2c47-4a42-ba85-468a47c0aea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:05:43 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-eef0caba-ce44-43eb-8353-9dc8c0b889ad tempest-TestServerVolumeAttachmentScenario-1220265420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b112cf3-2c47-4a42-ba85-468a47c0aea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:05:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-415237366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9f2242a-c99d-4b84-817f-8abda1033a0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06c6f50aa2704658bcba87bff2d61ae1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:05:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:05:43Z,use_quota=True,user_id='11274a62f42e49f5a5cbed73243dc396',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:05:43 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-eef0caba-ce44-43eb-8353-9dc8c0b889ad tempest-TestServerVolumeAttachmentScenario-1220265420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55b20db0-0c46-4a75-b4bf-98fa947cce82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:05:43 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-eef0caba-ce44-43eb-8353-9dc8c0b889ad tempest-TestServerVolumeAttachmentScenario-1220265420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55b20db0-0c46-4a75-b4bf-98fa947cce82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:05:43 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-eef0caba-ce44-43eb-8353-9dc8c0b889ad tempest-TestServerVolumeAttachmentScenario-1220265420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb71a95f-d6df-4f18-bd12-00814d8a517e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:05:43 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-eef0caba-ce44-43eb-8353-9dc8c0b889ad tempest-TestServerVolumeAttachmentScenario-1220265420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb71a95f-d6df-4f18-bd12-00814d8a517e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9f2242a-c99d-4b84-817f-8abda1033a0e', 'volume_name': 'volume-e9f2242a-c99d-4b84-817f-8abda1033a0e', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:05:43 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-eef0caba-ce44-43eb-8353-9dc8c0b889ad tempest-TestServerVolumeAttachmentScenario-1220265420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab52b90c-d431-44ae-bbf3-6cb3811054ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:05:43 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-eef0caba-ce44-43eb-8353-9dc8c0b889ad tempest-TestServerVolumeAttachmentScenario-1220265420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab52b90c-d431-44ae-bbf3-6cb3811054ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:05:43 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-eef0caba-ce44-43eb-8353-9dc8c0b889ad tempest-TestServerVolumeAttachmentScenario-1220265420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a3639c9-b189-497e-b130-932c39971a8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:05:43 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-eef0caba-ce44-43eb-8353-9dc8c0b889ad tempest-TestServerVolumeAttachmentScenario-1220265420 None] Volume e9f2242a-c99d-4b84-817f-8abda1033a0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9f2242a-c99d-4b84-817f-8abda1033a0e', 'volume_size': 1} Jul 10 16:05:43 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-eef0caba-ce44-43eb-8353-9dc8c0b889ad tempest-TestServerVolumeAttachmentScenario-1220265420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:05:44 devstack sudo[102325]: pam_unix(sudo:session): session closed for user root Jul 10 16:05:44 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-957d989b-d139-4621-a550-68f3c71d8ab5 tempest-TestServerVolumeAttachmentScenario-1220265420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-e8526896-b45f-4a0a-9868-72084cef4f10 1073741824" returned: 0 in 0.930s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:05:44 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-957d989b-d139-4621-a550-68f3c71d8ab5 tempest-TestServerVolumeAttachmentScenario-1220265420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-e8526896-b45f-4a0a-9868-72084cef4f10 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:05:44 devstack sudo[102332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-e8526896-b45f-4a0a-9868-72084cef4f10 Jul 10 16:05:44 devstack sudo[102332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:05:44 devstack sudo[102332]: pam_unix(sudo:session): session closed for user root Jul 10 16:05:44 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-957d989b-d139-4621-a550-68f3c71d8ab5 tempest-TestServerVolumeAttachmentScenario-1220265420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-e8526896-b45f-4a0a-9868-72084cef4f10" returned: 0 in 0.682s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:05:44 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-957d989b-d139-4621-a550-68f3c71d8ab5 tempest-TestServerVolumeAttachmentScenario-1220265420 None] <== create_volume: return (1657ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 16:05:44 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-957d989b-d139-4621-a550-68f3c71d8ab5 tempest-TestServerVolumeAttachmentScenario-1220265420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.660s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:05:44 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-eef0caba-ce44-43eb-8353-9dc8c0b889ad tempest-TestServerVolumeAttachmentScenario-1220265420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.304s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:05:44 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-eef0caba-ce44-43eb-8353-9dc8c0b889ad tempest-TestServerVolumeAttachmentScenario-1220265420 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:05:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-415237366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9f2242a-c99d-4b84-817f-8abda1033a0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06c6f50aa2704658bcba87bff2d61ae1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:05:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:05:43Z,use_quota=True,user_id='11274a62f42e49f5a5cbed73243dc396',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 16:05:44 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-eef0caba-ce44-43eb-8353-9dc8c0b889ad tempest-TestServerVolumeAttachmentScenario-1220265420 None] Creating volume e9f2242a-c99d-4b84-817f-8abda1033a0e {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 16:05:44 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-eef0caba-ce44-43eb-8353-9dc8c0b889ad tempest-TestServerVolumeAttachmentScenario-1220265420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:05:44 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-eef0caba-ce44-43eb-8353-9dc8c0b889ad tempest-TestServerVolumeAttachmentScenario-1220265420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:05:44 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-eef0caba-ce44-43eb-8353-9dc8c0b889ad tempest-TestServerVolumeAttachmentScenario-1220265420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:05:44 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-eef0caba-ce44-43eb-8353-9dc8c0b889ad tempest-TestServerVolumeAttachmentScenario-1220265420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:05:44 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-eef0caba-ce44-43eb-8353-9dc8c0b889ad tempest-TestServerVolumeAttachmentScenario-1220265420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:05:44 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-eef0caba-ce44-43eb-8353-9dc8c0b889ad tempest-TestServerVolumeAttachmentScenario-1220265420 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 16:05:44 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-eef0caba-ce44-43eb-8353-9dc8c0b889ad tempest-TestServerVolumeAttachmentScenario-1220265420 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 16:05:44 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-eef0caba-ce44-43eb-8353-9dc8c0b889ad tempest-TestServerVolumeAttachmentScenario-1220265420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-e9f2242a-c99d-4b84-817f-8abda1033a0e 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:05:44 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-957d989b-d139-4621-a550-68f3c71d8ab5 tempest-TestServerVolumeAttachmentScenario-1220265420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d795f980-ac11-4fec-b09d-57dbdfa701f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8526896-b45f-4a0a-9868-72084cef4f10', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:05:44 devstack sudo[102335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-e9f2242a-c99d-4b84-817f-8abda1033a0e 1073741824 Jul 10 16:05:44 devstack sudo[102335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:05:44 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-957d989b-d139-4621-a550-68f3c71d8ab5 tempest-TestServerVolumeAttachmentScenario-1220265420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (117752a7-2f82-43ec-a5c1-9ac9638f7f1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:05:45 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-957d989b-d139-4621-a550-68f3c71d8ab5 tempest-TestServerVolumeAttachmentScenario-1220265420 None] Volume volume-e8526896-b45f-4a0a-9868-72084cef4f10 (e8526896-b45f-4a0a-9868-72084cef4f10): created successfully Jul 10 16:05:45 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-957d989b-d139-4621-a550-68f3c71d8ab5 tempest-TestServerVolumeAttachmentScenario-1220265420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (117752a7-2f82-43ec-a5c1-9ac9638f7f1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:05:45 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-957d989b-d139-4621-a550-68f3c71d8ab5 tempest-TestServerVolumeAttachmentScenario-1220265420 None] Flow 'volume_create_manager' (fecaf2be-bd65-498b-a6e4-950c53f69dc6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:05:45 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-957d989b-d139-4621-a550-68f3c71d8ab5 tempest-TestServerVolumeAttachmentScenario-1220265420 None] Created volume successfully. Jul 10 16:05:45 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [req-9271a334-dffd-4a23-b6a9-dd48db6e0437 req-a143fc51-c196-46f4-9f65-7f855ccf74bb tempest-TestServerVolumeAttachScenarioOldVersion-1102919422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:05:45 devstack sudo[102335]: pam_unix(sudo:session): session closed for user root Jul 10 16:05:45 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-eef0caba-ce44-43eb-8353-9dc8c0b889ad tempest-TestServerVolumeAttachmentScenario-1220265420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-e9f2242a-c99d-4b84-817f-8abda1033a0e 1073741824" returned: 0 in 0.941s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:05:45 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-eef0caba-ce44-43eb-8353-9dc8c0b889ad tempest-TestServerVolumeAttachmentScenario-1220265420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-e9f2242a-c99d-4b84-817f-8abda1033a0e {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:05:45 devstack sudo[102354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-e9f2242a-c99d-4b84-817f-8abda1033a0e Jul 10 16:05:45 devstack sudo[102354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:05:46 devstack sudo[102354]: pam_unix(sudo:session): session closed for user root Jul 10 16:05:46 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-eef0caba-ce44-43eb-8353-9dc8c0b889ad tempest-TestServerVolumeAttachmentScenario-1220265420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-e9f2242a-c99d-4b84-817f-8abda1033a0e" returned: 0 in 0.674s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:05:46 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-eef0caba-ce44-43eb-8353-9dc8c0b889ad tempest-TestServerVolumeAttachmentScenario-1220265420 None] <== create_volume: return (1659ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 16:05:46 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-eef0caba-ce44-43eb-8353-9dc8c0b889ad tempest-TestServerVolumeAttachmentScenario-1220265420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.663s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:05:46 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [req-9271a334-dffd-4a23-b6a9-dd48db6e0437 req-a143fc51-c196-46f4-9f65-7f855ccf74bb tempest-TestServerVolumeAttachScenarioOldVersion-1102919422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.923s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:05:46 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-eef0caba-ce44-43eb-8353-9dc8c0b889ad tempest-TestServerVolumeAttachmentScenario-1220265420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a3639c9-b189-497e-b130-932c39971a8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9f2242a-c99d-4b84-817f-8abda1033a0e', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:05:46 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-eef0caba-ce44-43eb-8353-9dc8c0b889ad tempest-TestServerVolumeAttachmentScenario-1220265420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba8d2748-b6ba-4bfd-bf6f-ce14a0b5e205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:05:46 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c1f33eb-aeed-4caf-875e-bcb9976e92d8]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:05:46 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [req-9271a334-dffd-4a23-b6a9-dd48db6e0437 req-a143fc51-c196-46f4-9f65-7f855ccf74bb tempest-TestServerVolumeAttachScenarioOldVersion-1102919422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-9c44a29b-f522-4300-b1ee-9163aaa6d6ad {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:05:46 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-eef0caba-ce44-43eb-8353-9dc8c0b889ad tempest-TestServerVolumeAttachmentScenario-1220265420 None] Volume volume-e9f2242a-c99d-4b84-817f-8abda1033a0e (e9f2242a-c99d-4b84-817f-8abda1033a0e): created successfully Jul 10 16:05:46 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-eef0caba-ce44-43eb-8353-9dc8c0b889ad tempest-TestServerVolumeAttachmentScenario-1220265420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba8d2748-b6ba-4bfd-bf6f-ce14a0b5e205) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:05:46 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-eef0caba-ce44-43eb-8353-9dc8c0b889ad tempest-TestServerVolumeAttachmentScenario-1220265420 None] Flow 'volume_create_manager' (68e7ff6d-3c35-4797-815a-47b8cb5f44ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:05:46 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-eef0caba-ce44-43eb-8353-9dc8c0b889ad tempest-TestServerVolumeAttachmentScenario-1220265420 None] Created volume successfully. Jul 10 16:05:46 devstack sudo[102360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-9c44a29b-f522-4300-b1ee-9163aaa6d6ad Jul 10 16:05:46 devstack sudo[102360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:05:47 devstack sudo[102360]: pam_unix(sudo:session): session closed for user root Jul 10 16:05:47 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [req-9271a334-dffd-4a23-b6a9-dd48db6e0437 req-a143fc51-c196-46f4-9f65-7f855ccf74bb tempest-TestServerVolumeAttachScenarioOldVersion-1102919422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-9c44a29b-f522-4300-b1ee-9163aaa6d6ad" returned: 0 in 0.779s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:05:47 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [req-9271a334-dffd-4a23-b6a9-dd48db6e0437 req-a143fc51-c196-46f4-9f65-7f855ccf74bb tempest-TestServerVolumeAttachScenarioOldVersion-1102919422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.809s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:05:47 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [req-9271a334-dffd-4a23-b6a9-dd48db6e0437 req-a143fc51-c196-46f4-9f65-7f855ccf74bb tempest-TestServerVolumeAttachScenarioOldVersion-1102919422 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80', 'name': 'volume-9c44a29b-f522-4300-b1ee-9163aaa6d6ad', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8a0a299a-d4c4-4ad4-81a5-b30770cf63a5', 'enforce_multipath': True} {{(pid=87420) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 16:05:47 devstack cinder-volume[87420]: INFO cinder.volume.manager [req-9271a334-dffd-4a23-b6a9-dd48db6e0437 req-a143fc51-c196-46f4-9f65-7f855ccf74bb tempest-TestServerVolumeAttachScenarioOldVersion-1102919422 None] attachment_update completed successfully. Jul 10 16:05:54 devstack cinder-volume[87420]: INFO cinder.volume.manager [req-cb0665ff-5e4c-48d1-9fde-f7f363afcaf5 req-8590a509-c450-4976-abca-5113e463457c tempest-TestServerVolumeAttachScenarioOldVersion-1102919422 None] Terminate volume connection completed successfully. Jul 10 16:05:54 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [req-cb0665ff-5e4c-48d1-9fde-f7f363afcaf5 req-8590a509-c450-4976-abca-5113e463457c tempest-TestServerVolumeAttachScenarioOldVersion-1102919422 None] Deleting attachment 8a0a299a-d4c4-4ad4-81a5-b30770cf63a5. {{(pid=87420) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 16:05:56 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-53cd28fb-7a16-471b-bd10-75f3dd18a12b tempest-TestServerVolumeAttachScenarioOldVersion-1102919422 None] Acquiring lock "cinder-9c44a29b-f522-4300-b1ee-9163aaa6d6ad-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:05:56 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-53cd28fb-7a16-471b-bd10-75f3dd18a12b tempest-TestServerVolumeAttachScenarioOldVersion-1102919422 None] Lock "cinder-9c44a29b-f522-4300-b1ee-9163aaa6d6ad-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:05:56 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-53cd28fb-7a16-471b-bd10-75f3dd18a12b tempest-TestServerVolumeAttachScenarioOldVersion-1102919422 None] Acquiring lock "cinder-quobyte-9c44a29b-f522-4300-b1ee-9163aaa6d6ad" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:05:56 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-53cd28fb-7a16-471b-bd10-75f3dd18a12b tempest-TestServerVolumeAttachScenarioOldVersion-1102919422 None] Lock "cinder-quobyte-9c44a29b-f522-4300-b1ee-9163aaa6d6ad" acquired by "delete_volume" :: waited 0.018s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:05:56 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[f21e233f-0163-4e84-9e35-f5ecfb02e16d]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:05:56 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-53cd28fb-7a16-471b-bd10-75f3dd18a12b tempest-TestServerVolumeAttachScenarioOldVersion-1102919422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-9c44a29b-f522-4300-b1ee-9163aaa6d6ad {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:05:56 devstack sudo[102837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-9c44a29b-f522-4300-b1ee-9163aaa6d6ad Jul 10 16:05:56 devstack sudo[102837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:05:57 devstack sudo[102837]: pam_unix(sudo:session): session closed for user root Jul 10 16:05:57 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-53cd28fb-7a16-471b-bd10-75f3dd18a12b tempest-TestServerVolumeAttachScenarioOldVersion-1102919422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-9c44a29b-f522-4300-b1ee-9163aaa6d6ad" returned: 0 in 0.764s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:05:57 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-53cd28fb-7a16-471b-bd10-75f3dd18a12b tempest-TestServerVolumeAttachScenarioOldVersion-1102919422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-9c44a29b-f522-4300-b1ee-9163aaa6d6ad {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:05:57 devstack sudo[102844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-9c44a29b-f522-4300-b1ee-9163aaa6d6ad Jul 10 16:05:57 devstack sudo[102844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:05:57 devstack sudo[102844]: pam_unix(sudo:session): session closed for user root Jul 10 16:05:57 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-53cd28fb-7a16-471b-bd10-75f3dd18a12b tempest-TestServerVolumeAttachScenarioOldVersion-1102919422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-9c44a29b-f522-4300-b1ee-9163aaa6d6ad" returned: 0 in 0.662s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:05:57 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-53cd28fb-7a16-471b-bd10-75f3dd18a12b tempest-TestServerVolumeAttachScenarioOldVersion-1102919422 None] Lock "cinder-quobyte-9c44a29b-f522-4300-b1ee-9163aaa6d6ad" released by "delete_volume" :: held 1.472s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:05:58 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-53cd28fb-7a16-471b-bd10-75f3dd18a12b tempest-TestServerVolumeAttachScenarioOldVersion-1102919422 None] Created reservations ['0a893d05-268c-44a6-8d74-50d9f82e04e5', 'a8516a1f-6a22-4496-bd89-9291793b67d6', '95ec5e96-697e-4137-9a23-4b10053fcc68', '53c98ad6-dcc8-4434-afc0-2a9be4ba8356'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:05:58 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-53cd28fb-7a16-471b-bd10-75f3dd18a12b tempest-TestServerVolumeAttachScenarioOldVersion-1102919422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:05:58 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-53cd28fb-7a16-471b-bd10-75f3dd18a12b tempest-TestServerVolumeAttachScenarioOldVersion-1102919422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:05:58 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-53cd28fb-7a16-471b-bd10-75f3dd18a12b tempest-TestServerVolumeAttachScenarioOldVersion-1102919422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:05:58 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-53cd28fb-7a16-471b-bd10-75f3dd18a12b tempest-TestServerVolumeAttachScenarioOldVersion-1102919422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:05:58 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-53cd28fb-7a16-471b-bd10-75f3dd18a12b tempest-TestServerVolumeAttachScenarioOldVersion-1102919422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:05:58 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-53cd28fb-7a16-471b-bd10-75f3dd18a12b tempest-TestServerVolumeAttachScenarioOldVersion-1102919422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:05:58 devstack sudo[102866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:05:58 devstack sudo[102866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:05:58 devstack sudo[102866]: pam_unix(sudo:session): session closed for user root Jul 10 16:05:58 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-53cd28fb-7a16-471b-bd10-75f3dd18a12b tempest-TestServerVolumeAttachScenarioOldVersion-1102919422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.764s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:05:58 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-53cd28fb-7a16-471b-bd10-75f3dd18a12b tempest-TestServerVolumeAttachScenarioOldVersion-1102919422 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:05:58 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-53cd28fb-7a16-471b-bd10-75f3dd18a12b tempest-TestServerVolumeAttachScenarioOldVersion-1102919422 None] Deleted volume successfully. Jul 10 16:05:58 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-53cd28fb-7a16-471b-bd10-75f3dd18a12b tempest-TestServerVolumeAttachScenarioOldVersion-1102919422 None] Lock "cinder-9c44a29b-f522-4300-b1ee-9163aaa6d6ad-delete_volume" released by "delete_volume" :: held 2.489s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:06:08 devstack cinder-volume[87420]: DEBUG dbcounter [-] [87420] Writing DB stats cinder:SELECT=17,cinder:UPDATE=18,cinder:INSERT=4,cinder:DELETE=1 {{(pid=87420) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 16:06:08 devstack cinder-volume[87420]: DEBUG dbcounter [-] [87420] Writing DB stats cinder:UPDATE=19,cinder:SELECT=18,cinder:DELETE=3,cinder:INSERT=3 {{(pid=87420) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 16:06:17 devstack cinder-volume[87420]: DEBUG oslo_service.periodic_task [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87420) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 16:06:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:06:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:06:17 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:06:17 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:06:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:06:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:06:17 devstack sudo[102932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:06:17 devstack sudo[102932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:06:18 devstack sudo[102932]: pam_unix(sudo:session): session closed for user root Jul 10 16:06:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.678s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:06:18 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:06:18 devstack cinder-volume[87420]: DEBUG oslo_service.periodic_task [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Running periodic task VolumeManager._thread_info {{(pid=87420) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 16:06:18 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] thread count: 29 {{(pid=87420) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 16:06:18 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] thread info: [<_MainThread(MainThread, started 133639250378880)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87420) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 16:06:19 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-7510a3fe-d1cf-4a3c-8382-428d8f0d3fac tempest-VolumeImageDependencyTests-231511863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 16:06:19 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-7510a3fe-d1cf-4a3c-8382-428d8f0d3fac tempest-VolumeImageDependencyTests-231511863 None] Flow 'volume_create_manager' (47888821-3a40-42ae-8097-3caace01e1b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:06:19 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-7510a3fe-d1cf-4a3c-8382-428d8f0d3fac tempest-VolumeImageDependencyTests-231511863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99fcc04b-960f-4a63-a7d0-ab1b5011e445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:06:19 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-7510a3fe-d1cf-4a3c-8382-428d8f0d3fac tempest-VolumeImageDependencyTests-231511863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99fcc04b-960f-4a63-a7d0-ab1b5011e445) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:06:19Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a6f02a3-adb2-4ade-a49b-58006f05e41e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95f43c8fb61642c8bb9fb3b9d278b5bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:06:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:06:19Z,use_quota=True,user_id='3b4e0674cc004ecaa9f41c1ea3988ddc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:06:19 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-7510a3fe-d1cf-4a3c-8382-428d8f0d3fac tempest-VolumeImageDependencyTests-231511863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c479a336-cb55-410d-9769-0dcfe4263bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:06:19 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-7510a3fe-d1cf-4a3c-8382-428d8f0d3fac tempest-VolumeImageDependencyTests-231511863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c479a336-cb55-410d-9769-0dcfe4263bd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:06:19 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-7510a3fe-d1cf-4a3c-8382-428d8f0d3fac tempest-VolumeImageDependencyTests-231511863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c412fbc-5652-49dd-b448-853ddf09e9c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:06:19 devstack cinder-volume[87420]: DEBUG cinder.image.glance [None req-7510a3fe-d1cf-4a3c-8382-428d8f0d3fac tempest-VolumeImageDependencyTests-231511863 None] Creating Keystone auth plugin from conf {{(pid=87420) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 10 16:06:19 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-7510a3fe-d1cf-4a3c-8382-428d8f0d3fac tempest-VolumeImageDependencyTests-231511863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c412fbc-5652-49dd-b448-853ddf09e9c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2a6f02a3-adb2-4ade-a49b-58006f05e41e', 'volume_name': 'volume-2a6f02a3-adb2-4ade-a49b-58006f05e41e', 'volume_size': 1, 'image_id': 'ae19e9e8-8458-4498-82a9-8dc9ce45d455', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ae19e9e8-8458-4498-82a9-8dc9ce45d455', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'de557f739c773e9feeafe4e97264ab8d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '95f43c8fb61642c8bb9fb3b9d278b5bd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1f9680194996323969c09c298e2bf326f0ebd08b8021d8747c32d1e4fcec589ba1d498d0cca762338f21588d6147fac42369d30b836c302a1d08f33042ae2de5', 'id': 'ae19e9e8-8458-4498-82a9-8dc9ce45d455', 'created_at': datetime.datetime(2026, 7, 10, 14, 6, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 14, 6, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ae19e9e8-8458-4498-82a9-8dc9ce45d455/file', 'properties': {}}, 'image_service': }' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:06:19 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-7510a3fe-d1cf-4a3c-8382-428d8f0d3fac tempest-VolumeImageDependencyTests-231511863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79136ec5-b134-4539-a4cb-027ecb5fa465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:06:19 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-7510a3fe-d1cf-4a3c-8382-428d8f0d3fac tempest-VolumeImageDependencyTests-231511863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79136ec5-b134-4539-a4cb-027ecb5fa465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:06:19 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-7510a3fe-d1cf-4a3c-8382-428d8f0d3fac tempest-VolumeImageDependencyTests-231511863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2545a37-546e-4972-9455-c1fe0d37674c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:06:19 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-7510a3fe-d1cf-4a3c-8382-428d8f0d3fac tempest-VolumeImageDependencyTests-231511863 None] Volume 2a6f02a3-adb2-4ade-a49b-58006f05e41e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2a6f02a3-adb2-4ade-a49b-58006f05e41e', 'volume_size': 1, 'image_id': 'ae19e9e8-8458-4498-82a9-8dc9ce45d455', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ae19e9e8-8458-4498-82a9-8dc9ce45d455', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'de557f739c773e9feeafe4e97264ab8d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '95f43c8fb61642c8bb9fb3b9d278b5bd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1f9680194996323969c09c298e2bf326f0ebd08b8021d8747c32d1e4fcec589ba1d498d0cca762338f21588d6147fac42369d30b836c302a1d08f33042ae2de5', 'id': 'ae19e9e8-8458-4498-82a9-8dc9ce45d455', 'created_at': datetime.datetime(2026, 7, 10, 14, 6, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 14, 6, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ae19e9e8-8458-4498-82a9-8dc9ce45d455/file', 'properties': {}}, 'image_service': } Jul 10 16:06:19 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-7510a3fe-d1cf-4a3c-8382-428d8f0d3fac tempest-VolumeImageDependencyTests-231511863 None] Trying to clone 2a6f02a3-adb2-4ade-a49b-58006f05e41e from image ae19e9e8-8458-4498-82a9-8dc9ce45d455 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ae19e9e8-8458-4498-82a9-8dc9ce45d455', 'metadata': {}}]). {{(pid=87420) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 10 16:06:19 devstack cinder-volume[87420]: DEBUG cinder.image.image_utils [None req-7510a3fe-d1cf-4a3c-8382-428d8f0d3fac tempest-VolumeImageDependencyTests-231511863 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ae19e9e8-8458-4498-82a9-8dc9ce45d455_m5e2i6tddevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87420) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 10 16:06:19 devstack cinder-volume[87420]: INFO cinder.image.image_utils [None req-7510a3fe-d1cf-4a3c-8382-428d8f0d3fac tempest-VolumeImageDependencyTests-231511863 None] Image download 0.00 MB at 0.00 MB/s Jul 10 16:06:19 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9819c7f-b139-4111-afb6-5d326816d667]: (4, 'raw') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:06:19 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-7510a3fe-d1cf-4a3c-8382-428d8f0d3fac tempest-VolumeImageDependencyTests-231511863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ae19e9e8-8458-4498-82a9-8dc9ce45d455_m5e2i6tddevstack@QuobyteHD {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:06:19 devstack sudo[102935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ae19e9e8-8458-4498-82a9-8dc9ce45d455_m5e2i6tddevstack@QuobyteHD Jul 10 16:06:19 devstack sudo[102935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:06:20 devstack sudo[102935]: pam_unix(sudo:session): session closed for user root Jul 10 16:06:20 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-7510a3fe-d1cf-4a3c-8382-428d8f0d3fac tempest-VolumeImageDependencyTests-231511863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ae19e9e8-8458-4498-82a9-8dc9ce45d455_m5e2i6tddevstack@QuobyteHD" returned: 0 in 0.732s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:06:20 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-7510a3fe-d1cf-4a3c-8382-428d8f0d3fac tempest-VolumeImageDependencyTests-231511863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ae19e9e8-8458-4498-82a9-8dc9ce45d455_m5e2i6tddevstack@QuobyteHD {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:06:20 devstack sudo[102939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ae19e9e8-8458-4498-82a9-8dc9ce45d455_m5e2i6tddevstack@QuobyteHD Jul 10 16:06:20 devstack sudo[102939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:06:21 devstack sudo[102939]: pam_unix(sudo:session): session closed for user root Jul 10 16:06:21 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-7510a3fe-d1cf-4a3c-8382-428d8f0d3fac tempest-VolumeImageDependencyTests-231511863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ae19e9e8-8458-4498-82a9-8dc9ce45d455_m5e2i6tddevstack@QuobyteHD" returned: 1 in 0.730s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:06:21 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-7510a3fe-d1cf-4a3c-8382-428d8f0d3fac tempest-VolumeImageDependencyTests-231511863 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ae19e9e8-8458-4498-82a9-8dc9ce45d455_m5e2i6tddevstack@QuobyteHD' failed. Not Retrying. {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 16:06:21 devstack cinder-volume[87420]: DEBUG cinder.image.image_utils [None req-7510a3fe-d1cf-4a3c-8382-428d8f0d3fac tempest-VolumeImageDependencyTests-231511863 None] Temporary image ae19e9e8-8458-4498-82a9-8dc9ce45d455 is fetched for user 3b4e0674cc004ecaa9f41c1ea3988ddc. {{(pid=87420) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 10 16:06:21 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[08df97aa-d84d-456d-8087-01280e07ae26]: (4, 'raw') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:06:21 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-7510a3fe-d1cf-4a3c-8382-428d8f0d3fac tempest-VolumeImageDependencyTests-231511863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ae19e9e8-8458-4498-82a9-8dc9ce45d455_m5e2i6tddevstack@QuobyteHD {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:06:21 devstack sudo[102944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ae19e9e8-8458-4498-82a9-8dc9ce45d455_m5e2i6tddevstack@QuobyteHD Jul 10 16:06:21 devstack sudo[102944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:06:21 devstack sudo[102944]: pam_unix(sudo:session): session closed for user root Jul 10 16:06:21 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-7510a3fe-d1cf-4a3c-8382-428d8f0d3fac tempest-VolumeImageDependencyTests-231511863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ae19e9e8-8458-4498-82a9-8dc9ce45d455_m5e2i6tddevstack@QuobyteHD" returned: 0 in 0.707s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:06:21 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-7510a3fe-d1cf-4a3c-8382-428d8f0d3fac tempest-VolumeImageDependencyTests-231511863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ae19e9e8-8458-4498-82a9-8dc9ce45d455_m5e2i6tddevstack@QuobyteHD {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:06:22 devstack sudo[102949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ae19e9e8-8458-4498-82a9-8dc9ce45d455_m5e2i6tddevstack@QuobyteHD Jul 10 16:06:22 devstack sudo[102949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:06:22 devstack sudo[102949]: pam_unix(sudo:session): session closed for user root Jul 10 16:06:22 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-7510a3fe-d1cf-4a3c-8382-428d8f0d3fac tempest-VolumeImageDependencyTests-231511863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ae19e9e8-8458-4498-82a9-8dc9ce45d455_m5e2i6tddevstack@QuobyteHD" returned: 1 in 0.724s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:06:22 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-7510a3fe-d1cf-4a3c-8382-428d8f0d3fac tempest-VolumeImageDependencyTests-231511863 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ae19e9e8-8458-4498-82a9-8dc9ce45d455_m5e2i6tddevstack@QuobyteHD' failed. Not Retrying. {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 16:06:22 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-7510a3fe-d1cf-4a3c-8382-428d8f0d3fac tempest-VolumeImageDependencyTests-231511863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:06:22 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-7510a3fe-d1cf-4a3c-8382-428d8f0d3fac tempest-VolumeImageDependencyTests-231511863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:06:22 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-7510a3fe-d1cf-4a3c-8382-428d8f0d3fac tempest-VolumeImageDependencyTests-231511863 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:06:19Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a6f02a3-adb2-4ade-a49b-58006f05e41e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95f43c8fb61642c8bb9fb3b9d278b5bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:06:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:06:19Z,use_quota=True,user_id='3b4e0674cc004ecaa9f41c1ea3988ddc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 16:06:22 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-7510a3fe-d1cf-4a3c-8382-428d8f0d3fac tempest-VolumeImageDependencyTests-231511863 None] Creating volume 2a6f02a3-adb2-4ade-a49b-58006f05e41e {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 16:06:22 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-7510a3fe-d1cf-4a3c-8382-428d8f0d3fac tempest-VolumeImageDependencyTests-231511863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:06:22 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-7510a3fe-d1cf-4a3c-8382-428d8f0d3fac tempest-VolumeImageDependencyTests-231511863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:06:22 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-7510a3fe-d1cf-4a3c-8382-428d8f0d3fac tempest-VolumeImageDependencyTests-231511863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:06:22 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-7510a3fe-d1cf-4a3c-8382-428d8f0d3fac tempest-VolumeImageDependencyTests-231511863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:06:22 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-7510a3fe-d1cf-4a3c-8382-428d8f0d3fac tempest-VolumeImageDependencyTests-231511863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:06:22 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-7510a3fe-d1cf-4a3c-8382-428d8f0d3fac tempest-VolumeImageDependencyTests-231511863 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 16:06:22 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-7510a3fe-d1cf-4a3c-8382-428d8f0d3fac tempest-VolumeImageDependencyTests-231511863 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 16:06:22 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-7510a3fe-d1cf-4a3c-8382-428d8f0d3fac tempest-VolumeImageDependencyTests-231511863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-2a6f02a3-adb2-4ade-a49b-58006f05e41e 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:06:22 devstack sudo[102956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-2a6f02a3-adb2-4ade-a49b-58006f05e41e 1073741824 Jul 10 16:06:22 devstack sudo[102956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:06:23 devstack sudo[102956]: pam_unix(sudo:session): session closed for user root Jul 10 16:06:23 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-7510a3fe-d1cf-4a3c-8382-428d8f0d3fac tempest-VolumeImageDependencyTests-231511863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-2a6f02a3-adb2-4ade-a49b-58006f05e41e 1073741824" returned: 0 in 0.851s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:06:23 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-7510a3fe-d1cf-4a3c-8382-428d8f0d3fac tempest-VolumeImageDependencyTests-231511863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-2a6f02a3-adb2-4ade-a49b-58006f05e41e {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:06:23 devstack sudo[102966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-2a6f02a3-adb2-4ade-a49b-58006f05e41e Jul 10 16:06:23 devstack sudo[102966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:06:24 devstack sudo[102966]: pam_unix(sudo:session): session closed for user root Jul 10 16:06:24 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-7510a3fe-d1cf-4a3c-8382-428d8f0d3fac tempest-VolumeImageDependencyTests-231511863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-2a6f02a3-adb2-4ade-a49b-58006f05e41e" returned: 0 in 0.693s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:06:24 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-7510a3fe-d1cf-4a3c-8382-428d8f0d3fac tempest-VolumeImageDependencyTests-231511863 None] <== create_volume: return (1591ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 16:06:24 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-7510a3fe-d1cf-4a3c-8382-428d8f0d3fac tempest-VolumeImageDependencyTests-231511863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.594s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:06:24 devstack cinder-volume[87420]: DEBUG cinder.volume.volume_utils [None req-7510a3fe-d1cf-4a3c-8382-428d8f0d3fac tempest-VolumeImageDependencyTests-231511863 None] Attempting download of ae19e9e8-8458-4498-82a9-8dc9ce45d455 ((None, [{'url': 'file:///opt/stack/data/glance/images/ae19e9e8-8458-4498-82a9-8dc9ce45d455', 'metadata': {}}])) to volume 2a6f02a3-adb2-4ade-a49b-58006f05e41e. {{(pid=87420) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 10 16:06:24 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc7385e2-0914-40f2-aa6a-ebe2fbd8f175]: (4, 'raw') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:06:24 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-7510a3fe-d1cf-4a3c-8382-428d8f0d3fac tempest-VolumeImageDependencyTests-231511863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ae19e9e8-8458-4498-82a9-8dc9ce45d455_r_k6ew52 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:06:24 devstack sudo[102969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ae19e9e8-8458-4498-82a9-8dc9ce45d455_r_k6ew52 Jul 10 16:06:24 devstack sudo[102969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:06:25 devstack sudo[102969]: pam_unix(sudo:session): session closed for user root Jul 10 16:06:25 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-7510a3fe-d1cf-4a3c-8382-428d8f0d3fac tempest-VolumeImageDependencyTests-231511863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ae19e9e8-8458-4498-82a9-8dc9ce45d455_r_k6ew52" returned: 0 in 0.727s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:06:25 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-7510a3fe-d1cf-4a3c-8382-428d8f0d3fac tempest-VolumeImageDependencyTests-231511863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ae19e9e8-8458-4498-82a9-8dc9ce45d455_r_k6ew52 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:06:25 devstack sudo[102975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ae19e9e8-8458-4498-82a9-8dc9ce45d455_r_k6ew52 Jul 10 16:06:25 devstack sudo[102975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:06:25 devstack sudo[102975]: pam_unix(sudo:session): session closed for user root Jul 10 16:06:25 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-7510a3fe-d1cf-4a3c-8382-428d8f0d3fac tempest-VolumeImageDependencyTests-231511863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ae19e9e8-8458-4498-82a9-8dc9ce45d455_r_k6ew52" returned: 1 in 0.724s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:06:25 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-7510a3fe-d1cf-4a3c-8382-428d8f0d3fac tempest-VolumeImageDependencyTests-231511863 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ae19e9e8-8458-4498-82a9-8dc9ce45d455_r_k6ew52' failed. Not Retrying. {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 16:06:25 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[9490ff4b-4208-46d1-8990-fcdc80bca382]: (4, 'raw') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:06:25 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-7510a3fe-d1cf-4a3c-8382-428d8f0d3fac tempest-VolumeImageDependencyTests-231511863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ae19e9e8-8458-4498-82a9-8dc9ce45d455_m5e2i6tddevstack@QuobyteHD {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:06:25 devstack sudo[102985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ae19e9e8-8458-4498-82a9-8dc9ce45d455_m5e2i6tddevstack@QuobyteHD Jul 10 16:06:25 devstack sudo[102985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:06:25 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [req-c7df6bae-8517-4199-a678-ab4c2a4ec995 req-88ec70b4-d357-4858-b854-eed541e2db29 tempest-TestServerVolumeAttachmentScenario-1220265420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:06:25 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [req-c7df6bae-8517-4199-a678-ab4c2a4ec995 req-88ec70b4-d357-4858-b854-eed541e2db29 tempest-TestServerVolumeAttachmentScenario-1220265420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:06:25 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ca485ac-40ca-44ef-ad9b-49064d15292a]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:06:25 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [req-c7df6bae-8517-4199-a678-ab4c2a4ec995 req-88ec70b4-d357-4858-b854-eed541e2db29 tempest-TestServerVolumeAttachmentScenario-1220265420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-e8526896-b45f-4a0a-9868-72084cef4f10 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:06:26 devstack sudo[102989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-e8526896-b45f-4a0a-9868-72084cef4f10 Jul 10 16:06:26 devstack sudo[102989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:06:26 devstack sudo[102985]: pam_unix(sudo:session): session closed for user root Jul 10 16:06:26 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-7510a3fe-d1cf-4a3c-8382-428d8f0d3fac tempest-VolumeImageDependencyTests-231511863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ae19e9e8-8458-4498-82a9-8dc9ce45d455_m5e2i6tddevstack@QuobyteHD" returned: 0 in 0.749s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:06:26 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-7510a3fe-d1cf-4a3c-8382-428d8f0d3fac tempest-VolumeImageDependencyTests-231511863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ae19e9e8-8458-4498-82a9-8dc9ce45d455_m5e2i6tddevstack@QuobyteHD {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:06:26 devstack sudo[102993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ae19e9e8-8458-4498-82a9-8dc9ce45d455_m5e2i6tddevstack@QuobyteHD Jul 10 16:06:26 devstack sudo[102993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:06:26 devstack sudo[102989]: pam_unix(sudo:session): session closed for user root Jul 10 16:06:26 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [req-c7df6bae-8517-4199-a678-ab4c2a4ec995 req-88ec70b4-d357-4858-b854-eed541e2db29 tempest-TestServerVolumeAttachmentScenario-1220265420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-e8526896-b45f-4a0a-9868-72084cef4f10" returned: 0 in 0.793s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:06:26 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [req-c7df6bae-8517-4199-a678-ab4c2a4ec995 req-88ec70b4-d357-4858-b854-eed541e2db29 tempest-TestServerVolumeAttachmentScenario-1220265420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.812s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:06:26 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [req-c7df6bae-8517-4199-a678-ab4c2a4ec995 req-88ec70b4-d357-4858-b854-eed541e2db29 tempest-TestServerVolumeAttachmentScenario-1220265420 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80', 'name': 'volume-e8526896-b45f-4a0a-9868-72084cef4f10', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8fa2923e-366f-4c5f-9121-8cffdfc95eb9', 'enforce_multipath': True} {{(pid=87420) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 16:06:26 devstack cinder-volume[87420]: INFO cinder.volume.manager [req-c7df6bae-8517-4199-a678-ab4c2a4ec995 req-88ec70b4-d357-4858-b854-eed541e2db29 tempest-TestServerVolumeAttachmentScenario-1220265420 None] attachment_update completed successfully. Jul 10 16:06:27 devstack sudo[102993]: pam_unix(sudo:session): session closed for user root Jul 10 16:06:27 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-7510a3fe-d1cf-4a3c-8382-428d8f0d3fac tempest-VolumeImageDependencyTests-231511863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ae19e9e8-8458-4498-82a9-8dc9ce45d455_m5e2i6tddevstack@QuobyteHD" returned: 1 in 0.749s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:06:27 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-7510a3fe-d1cf-4a3c-8382-428d8f0d3fac tempest-VolumeImageDependencyTests-231511863 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ae19e9e8-8458-4498-82a9-8dc9ce45d455_m5e2i6tddevstack@QuobyteHD' failed. Not Retrying. {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 16:06:27 devstack cinder-volume[87420]: DEBUG cinder.image.image_utils [None req-7510a3fe-d1cf-4a3c-8382-428d8f0d3fac tempest-VolumeImageDependencyTests-231511863 None] ae19e9e8-8458-4498-82a9-8dc9ce45d455 was raw, converting to raw {{(pid=87420) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 10 16:06:27 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-7510a3fe-d1cf-4a3c-8382-428d8f0d3fac tempest-VolumeImageDependencyTests-231511863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_ae19e9e8-8458-4498-82a9-8dc9ce45d455_m5e2i6tddevstack@QuobyteHD /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-2a6f02a3-adb2-4ade-a49b-58006f05e41e {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:06:27 devstack sudo[103068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_ae19e9e8-8458-4498-82a9-8dc9ce45d455_m5e2i6tddevstack@QuobyteHD /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-2a6f02a3-adb2-4ade-a49b-58006f05e41e Jul 10 16:06:27 devstack sudo[103068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:06:28 devstack sudo[103068]: pam_unix(sudo:session): session closed for user root Jul 10 16:06:28 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-7510a3fe-d1cf-4a3c-8382-428d8f0d3fac tempest-VolumeImageDependencyTests-231511863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_ae19e9e8-8458-4498-82a9-8dc9ce45d455_m5e2i6tddevstack@QuobyteHD /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-2a6f02a3-adb2-4ade-a49b-58006f05e41e" returned: 0 in 0.744s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:06:28 devstack cinder-volume[87420]: DEBUG cinder.image.image_utils [None req-7510a3fe-d1cf-4a3c-8382-428d8f0d3fac tempest-VolumeImageDependencyTests-231511863 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ae19e9e8-8458-4498-82a9-8dc9ce45d455_m5e2i6tddevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-2a6f02a3-adb2-4ade-a49b-58006f05e41e {{(pid=87420) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 16:06:28 devstack cinder-volume[87420]: INFO cinder.image.image_utils [None req-7510a3fe-d1cf-4a3c-8382-428d8f0d3fac tempest-VolumeImageDependencyTests-231511863 None] Converted 0.00 MB image at 0.00 MB/s Jul 10 16:06:28 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-7510a3fe-d1cf-4a3c-8382-428d8f0d3fac tempest-VolumeImageDependencyTests-231511863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-2a6f02a3-adb2-4ade-a49b-58006f05e41e 1G {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:06:28 devstack sudo[103389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-2a6f02a3-adb2-4ade-a49b-58006f05e41e 1G Jul 10 16:06:28 devstack sudo[103389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:06:28 devstack sudo[103389]: pam_unix(sudo:session): session closed for user root Jul 10 16:06:28 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-7510a3fe-d1cf-4a3c-8382-428d8f0d3fac tempest-VolumeImageDependencyTests-231511863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-2a6f02a3-adb2-4ade-a49b-58006f05e41e 1G" returned: 0 in 0.685s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:06:28 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[98d118dd-416e-4a6c-ae6d-8a064ef5f80e]: (4, 'raw') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:06:28 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-7510a3fe-d1cf-4a3c-8382-428d8f0d3fac tempest-VolumeImageDependencyTests-231511863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-2a6f02a3-adb2-4ade-a49b-58006f05e41e {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:06:28 devstack sudo[103394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-2a6f02a3-adb2-4ade-a49b-58006f05e41e Jul 10 16:06:28 devstack sudo[103394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:06:29 devstack sudo[103394]: pam_unix(sudo:session): session closed for user root Jul 10 16:06:29 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-7510a3fe-d1cf-4a3c-8382-428d8f0d3fac tempest-VolumeImageDependencyTests-231511863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-2a6f02a3-adb2-4ade-a49b-58006f05e41e" returned: 0 in 0.795s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:06:29 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-7510a3fe-d1cf-4a3c-8382-428d8f0d3fac tempest-VolumeImageDependencyTests-231511863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-2a6f02a3-adb2-4ade-a49b-58006f05e41e {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:06:29 devstack sudo[103398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-2a6f02a3-adb2-4ade-a49b-58006f05e41e Jul 10 16:06:29 devstack sudo[103398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:06:30 devstack sudo[103398]: pam_unix(sudo:session): session closed for user root Jul 10 16:06:30 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-7510a3fe-d1cf-4a3c-8382-428d8f0d3fac tempest-VolumeImageDependencyTests-231511863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-2a6f02a3-adb2-4ade-a49b-58006f05e41e" returned: 1 in 0.750s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:06:30 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-7510a3fe-d1cf-4a3c-8382-428d8f0d3fac tempest-VolumeImageDependencyTests-231511863 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-2a6f02a3-adb2-4ade-a49b-58006f05e41e' failed. Not Retrying. {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 16:06:30 devstack cinder-volume[87420]: DEBUG cinder.volume.volume_utils [None req-7510a3fe-d1cf-4a3c-8382-428d8f0d3fac tempest-VolumeImageDependencyTests-231511863 None] Downloaded image ae19e9e8-8458-4498-82a9-8dc9ce45d455 ((None, [{'url': 'file:///opt/stack/data/glance/images/ae19e9e8-8458-4498-82a9-8dc9ce45d455', 'metadata': {}}])) to volume 2a6f02a3-adb2-4ade-a49b-58006f05e41e successfully. {{(pid=87420) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 10 16:06:30 devstack cinder-volume[87420]: DEBUG cinder.image.image_utils [None req-7510a3fe-d1cf-4a3c-8382-428d8f0d3fac tempest-VolumeImageDependencyTests-231511863 None] Temporary image ae19e9e8-8458-4498-82a9-8dc9ce45d455 for user 3b4e0674cc004ecaa9f41c1ea3988ddc is deleted. {{(pid=87420) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 10 16:06:30 devstack cinder-volume[87420]: DEBUG cinder.volume.volume_utils [None req-7510a3fe-d1cf-4a3c-8382-428d8f0d3fac tempest-VolumeImageDependencyTests-231511863 None] Marking volume 2a6f02a3-adb2-4ade-a49b-58006f05e41e as bootable. {{(pid=87420) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 10 16:06:30 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-7510a3fe-d1cf-4a3c-8382-428d8f0d3fac tempest-VolumeImageDependencyTests-231511863 None] Copying metadata from image ae19e9e8-8458-4498-82a9-8dc9ce45d455 to 2a6f02a3-adb2-4ade-a49b-58006f05e41e. {{(pid=87420) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 10 16:06:30 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-7510a3fe-d1cf-4a3c-8382-428d8f0d3fac tempest-VolumeImageDependencyTests-231511863 None] Creating volume glance metadata for volume 2a6f02a3-adb2-4ade-a49b-58006f05e41e backed by image ae19e9e8-8458-4498-82a9-8dc9ce45d455 with: {'image_id': 'ae19e9e8-8458-4498-82a9-8dc9ce45d455', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'de557f739c773e9feeafe4e97264ab8d', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87420) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 10 16:06:30 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-7510a3fe-d1cf-4a3c-8382-428d8f0d3fac tempest-VolumeImageDependencyTests-231511863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2545a37-546e-4972-9455-c1fe0d37674c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a6f02a3-adb2-4ade-a49b-58006f05e41e', 'volume_size': 1, 'image_id': 'ae19e9e8-8458-4498-82a9-8dc9ce45d455', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ae19e9e8-8458-4498-82a9-8dc9ce45d455', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'de557f739c773e9feeafe4e97264ab8d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '95f43c8fb61642c8bb9fb3b9d278b5bd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1f9680194996323969c09c298e2bf326f0ebd08b8021d8747c32d1e4fcec589ba1d498d0cca762338f21588d6147fac42369d30b836c302a1d08f33042ae2de5', 'id': 'ae19e9e8-8458-4498-82a9-8dc9ce45d455', 'created_at': datetime.datetime(2026, 7, 10, 14, 6, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 14, 6, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ae19e9e8-8458-4498-82a9-8dc9ce45d455/file', 'properties': {}}, 'image_service': }' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:06:30 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-7510a3fe-d1cf-4a3c-8382-428d8f0d3fac tempest-VolumeImageDependencyTests-231511863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d7f3757-2866-4167-964d-bf9f15bdc980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:06:30 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-7510a3fe-d1cf-4a3c-8382-428d8f0d3fac tempest-VolumeImageDependencyTests-231511863 None] Volume volume-2a6f02a3-adb2-4ade-a49b-58006f05e41e (2a6f02a3-adb2-4ade-a49b-58006f05e41e): created successfully Jul 10 16:06:30 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-7510a3fe-d1cf-4a3c-8382-428d8f0d3fac tempest-VolumeImageDependencyTests-231511863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d7f3757-2866-4167-964d-bf9f15bdc980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:06:30 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-7510a3fe-d1cf-4a3c-8382-428d8f0d3fac tempest-VolumeImageDependencyTests-231511863 None] Flow 'volume_create_manager' (47888821-3a40-42ae-8097-3caace01e1b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:06:30 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-7510a3fe-d1cf-4a3c-8382-428d8f0d3fac tempest-VolumeImageDependencyTests-231511863 None] Created volume successfully. Jul 10 16:06:30 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-663db258-3c7b-42c2-ac62-c087f8bddbc5 tempest-VolumeImageDependencyTests-231511863 None] Acquiring lock "cinder-2a6f02a3-adb2-4ade-a49b-58006f05e41e-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:06:30 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-663db258-3c7b-42c2-ac62-c087f8bddbc5 tempest-VolumeImageDependencyTests-231511863 None] Lock "cinder-2a6f02a3-adb2-4ade-a49b-58006f05e41e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:06:30 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-663db258-3c7b-42c2-ac62-c087f8bddbc5 tempest-VolumeImageDependencyTests-231511863 None] Acquiring lock "cinder-quobyte-2a6f02a3-adb2-4ade-a49b-58006f05e41e" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:06:30 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-663db258-3c7b-42c2-ac62-c087f8bddbc5 tempest-VolumeImageDependencyTests-231511863 None] Lock "cinder-quobyte-2a6f02a3-adb2-4ade-a49b-58006f05e41e" acquired by "delete_volume" :: waited 0.024s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:06:31 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[df7f7fb7-c363-48b0-bdd7-038a9d351848]: (4, 'raw') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:06:31 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-663db258-3c7b-42c2-ac62-c087f8bddbc5 tempest-VolumeImageDependencyTests-231511863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-2a6f02a3-adb2-4ade-a49b-58006f05e41e {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:06:31 devstack sudo[103403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-2a6f02a3-adb2-4ade-a49b-58006f05e41e Jul 10 16:06:31 devstack sudo[103403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:06:31 devstack sudo[103403]: pam_unix(sudo:session): session closed for user root Jul 10 16:06:31 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-663db258-3c7b-42c2-ac62-c087f8bddbc5 tempest-VolumeImageDependencyTests-231511863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-2a6f02a3-adb2-4ade-a49b-58006f05e41e" returned: 0 in 0.778s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:06:31 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-663db258-3c7b-42c2-ac62-c087f8bddbc5 tempest-VolumeImageDependencyTests-231511863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-2a6f02a3-adb2-4ade-a49b-58006f05e41e {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:06:31 devstack sudo[103407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-2a6f02a3-adb2-4ade-a49b-58006f05e41e Jul 10 16:06:31 devstack sudo[103407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:06:32 devstack sudo[103407]: pam_unix(sudo:session): session closed for user root Jul 10 16:06:32 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-663db258-3c7b-42c2-ac62-c087f8bddbc5 tempest-VolumeImageDependencyTests-231511863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-2a6f02a3-adb2-4ade-a49b-58006f05e41e" returned: 1 in 0.800s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:06:32 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-663db258-3c7b-42c2-ac62-c087f8bddbc5 tempest-VolumeImageDependencyTests-231511863 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-2a6f02a3-adb2-4ade-a49b-58006f05e41e' failed. Not Retrying. {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 16:06:32 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-663db258-3c7b-42c2-ac62-c087f8bddbc5 tempest-VolumeImageDependencyTests-231511863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-2a6f02a3-adb2-4ade-a49b-58006f05e41e {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:06:32 devstack sudo[103412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-2a6f02a3-adb2-4ade-a49b-58006f05e41e Jul 10 16:06:32 devstack sudo[103412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:06:33 devstack sudo[103412]: pam_unix(sudo:session): session closed for user root Jul 10 16:06:33 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-663db258-3c7b-42c2-ac62-c087f8bddbc5 tempest-VolumeImageDependencyTests-231511863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-2a6f02a3-adb2-4ade-a49b-58006f05e41e" returned: 0 in 0.668s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:06:33 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-663db258-3c7b-42c2-ac62-c087f8bddbc5 tempest-VolumeImageDependencyTests-231511863 None] Lock "cinder-quobyte-2a6f02a3-adb2-4ade-a49b-58006f05e41e" released by "delete_volume" :: held 2.326s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:06:33 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-663db258-3c7b-42c2-ac62-c087f8bddbc5 tempest-VolumeImageDependencyTests-231511863 None] Created reservations ['10852a3f-97b6-493c-9a3f-c7e6edf94373', 'dfdf83cd-d3b4-40cf-8efb-26f20170d9b8', 'ffc0db87-6297-49de-b654-781eae676f71', '8d8c12d9-fdde-4a89-817f-045e9ee0dbf3'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:06:33 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-663db258-3c7b-42c2-ac62-c087f8bddbc5 tempest-VolumeImageDependencyTests-231511863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:06:33 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-663db258-3c7b-42c2-ac62-c087f8bddbc5 tempest-VolumeImageDependencyTests-231511863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:06:33 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-663db258-3c7b-42c2-ac62-c087f8bddbc5 tempest-VolumeImageDependencyTests-231511863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:06:33 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-663db258-3c7b-42c2-ac62-c087f8bddbc5 tempest-VolumeImageDependencyTests-231511863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:06:33 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-663db258-3c7b-42c2-ac62-c087f8bddbc5 tempest-VolumeImageDependencyTests-231511863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:06:33 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-663db258-3c7b-42c2-ac62-c087f8bddbc5 tempest-VolumeImageDependencyTests-231511863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:06:33 devstack sudo[103419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:06:33 devstack sudo[103419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:06:34 devstack sudo[103419]: pam_unix(sudo:session): session closed for user root Jul 10 16:06:34 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-663db258-3c7b-42c2-ac62-c087f8bddbc5 tempest-VolumeImageDependencyTests-231511863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.651s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:06:34 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-663db258-3c7b-42c2-ac62-c087f8bddbc5 tempest-VolumeImageDependencyTests-231511863 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:06:34 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-663db258-3c7b-42c2-ac62-c087f8bddbc5 tempest-VolumeImageDependencyTests-231511863 None] Deleted volume successfully. Jul 10 16:06:34 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-663db258-3c7b-42c2-ac62-c087f8bddbc5 tempest-VolumeImageDependencyTests-231511863 None] Lock "cinder-2a6f02a3-adb2-4ade-a49b-58006f05e41e-delete_volume" released by "delete_volume" :: held 3.229s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:06:35 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [req-3939a2e6-43b0-4910-99a8-dec66b5bd41e req-6c5ce274-016e-46a0-85d7-c44585b20861 tempest-TestServerVolumeAttachmentScenario-1220265420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:06:35 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [req-3939a2e6-43b0-4910-99a8-dec66b5bd41e req-6c5ce274-016e-46a0-85d7-c44585b20861 tempest-TestServerVolumeAttachmentScenario-1220265420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:06:35 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8fa7ae1-e927-48f8-b94e-1caebc7bd1c5]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:06:36 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [req-3939a2e6-43b0-4910-99a8-dec66b5bd41e req-6c5ce274-016e-46a0-85d7-c44585b20861 tempest-TestServerVolumeAttachmentScenario-1220265420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-e9f2242a-c99d-4b84-817f-8abda1033a0e {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:06:36 devstack sudo[103430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-e9f2242a-c99d-4b84-817f-8abda1033a0e Jul 10 16:06:36 devstack sudo[103430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:06:36 devstack sudo[103430]: pam_unix(sudo:session): session closed for user root Jul 10 16:06:36 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [req-3939a2e6-43b0-4910-99a8-dec66b5bd41e req-6c5ce274-016e-46a0-85d7-c44585b20861 tempest-TestServerVolumeAttachmentScenario-1220265420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-e9f2242a-c99d-4b84-817f-8abda1033a0e" returned: 0 in 0.778s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:06:36 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [req-3939a2e6-43b0-4910-99a8-dec66b5bd41e req-6c5ce274-016e-46a0-85d7-c44585b20861 tempest-TestServerVolumeAttachmentScenario-1220265420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.800s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:06:36 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [req-3939a2e6-43b0-4910-99a8-dec66b5bd41e req-6c5ce274-016e-46a0-85d7-c44585b20861 tempest-TestServerVolumeAttachmentScenario-1220265420 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80', 'name': 'volume-e9f2242a-c99d-4b84-817f-8abda1033a0e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '04c9239f-adb1-4ce3-aac7-ef6ed5eeeb95', 'enforce_multipath': True} {{(pid=87420) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 16:06:36 devstack cinder-volume[87420]: INFO cinder.volume.manager [req-3939a2e6-43b0-4910-99a8-dec66b5bd41e req-6c5ce274-016e-46a0-85d7-c44585b20861 tempest-TestServerVolumeAttachmentScenario-1220265420 None] attachment_update completed successfully. Jul 10 16:06:41 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-01f377ab-d8fc-47a0-b256-e5efa0edb871 tempest-ProjectReaderTests-1450192889 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 16:06:41 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-01f377ab-d8fc-47a0-b256-e5efa0edb871 tempest-ProjectReaderTests-1450192889 None] Flow 'volume_create_manager' (2124c182-2a6f-44c7-9ed5-404db0a58d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:06:41 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-01f377ab-d8fc-47a0-b256-e5efa0edb871 tempest-ProjectReaderTests-1450192889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c041bb7e-650d-4848-a235-d45d26528ac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:06:41 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-01f377ab-d8fc-47a0-b256-e5efa0edb871 tempest-ProjectReaderTests-1450192889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c041bb7e-650d-4848-a235-d45d26528ac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:06:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-844800294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fac1d35-1d71-4e96-8a9b-123de58487ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c5b04d641164d0b829712969aaeac13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:06:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:06:42Z,use_quota=True,user_id='f4b68bb8cef84cd08cca03eee3f0ab38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:06:41 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-01f377ab-d8fc-47a0-b256-e5efa0edb871 tempest-ProjectReaderTests-1450192889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cddc78c8-3c25-4e92-a3a4-19ee50f972f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:06:41 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-01f377ab-d8fc-47a0-b256-e5efa0edb871 tempest-ProjectReaderTests-1450192889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cddc78c8-3c25-4e92-a3a4-19ee50f972f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:06:41 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-01f377ab-d8fc-47a0-b256-e5efa0edb871 tempest-ProjectReaderTests-1450192889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (addfbe38-915b-493c-84df-4578caa275c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:06:41 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-01f377ab-d8fc-47a0-b256-e5efa0edb871 tempest-ProjectReaderTests-1450192889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (addfbe38-915b-493c-84df-4578caa275c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fac1d35-1d71-4e96-8a9b-123de58487ca', 'volume_name': 'volume-5fac1d35-1d71-4e96-8a9b-123de58487ca', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:06:41 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-01f377ab-d8fc-47a0-b256-e5efa0edb871 tempest-ProjectReaderTests-1450192889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66cfe107-4c6d-4dff-899f-26b753501138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:06:41 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-01f377ab-d8fc-47a0-b256-e5efa0edb871 tempest-ProjectReaderTests-1450192889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66cfe107-4c6d-4dff-899f-26b753501138) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:06:41 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-01f377ab-d8fc-47a0-b256-e5efa0edb871 tempest-ProjectReaderTests-1450192889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d61b650f-c4cd-4e4b-b178-e85829be8e2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:06:41 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-01f377ab-d8fc-47a0-b256-e5efa0edb871 tempest-ProjectReaderTests-1450192889 None] Volume 5fac1d35-1d71-4e96-8a9b-123de58487ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fac1d35-1d71-4e96-8a9b-123de58487ca', 'volume_size': 1} Jul 10 16:06:41 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-01f377ab-d8fc-47a0-b256-e5efa0edb871 tempest-ProjectReaderTests-1450192889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:06:41 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-01f377ab-d8fc-47a0-b256-e5efa0edb871 tempest-ProjectReaderTests-1450192889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:06:41 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-01f377ab-d8fc-47a0-b256-e5efa0edb871 tempest-ProjectReaderTests-1450192889 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:06:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-844800294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fac1d35-1d71-4e96-8a9b-123de58487ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c5b04d641164d0b829712969aaeac13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:06:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:06:42Z,use_quota=True,user_id='f4b68bb8cef84cd08cca03eee3f0ab38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 16:06:41 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-01f377ab-d8fc-47a0-b256-e5efa0edb871 tempest-ProjectReaderTests-1450192889 None] Creating volume 5fac1d35-1d71-4e96-8a9b-123de58487ca {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 16:06:41 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-01f377ab-d8fc-47a0-b256-e5efa0edb871 tempest-ProjectReaderTests-1450192889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:06:41 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-01f377ab-d8fc-47a0-b256-e5efa0edb871 tempest-ProjectReaderTests-1450192889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:06:41 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-01f377ab-d8fc-47a0-b256-e5efa0edb871 tempest-ProjectReaderTests-1450192889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:06:41 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-01f377ab-d8fc-47a0-b256-e5efa0edb871 tempest-ProjectReaderTests-1450192889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:06:41 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-01f377ab-d8fc-47a0-b256-e5efa0edb871 tempest-ProjectReaderTests-1450192889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:06:41 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-01f377ab-d8fc-47a0-b256-e5efa0edb871 tempest-ProjectReaderTests-1450192889 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 16:06:41 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-01f377ab-d8fc-47a0-b256-e5efa0edb871 tempest-ProjectReaderTests-1450192889 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 16:06:41 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-01f377ab-d8fc-47a0-b256-e5efa0edb871 tempest-ProjectReaderTests-1450192889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-5fac1d35-1d71-4e96-8a9b-123de58487ca 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:06:41 devstack sudo[103473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-5fac1d35-1d71-4e96-8a9b-123de58487ca 1073741824 Jul 10 16:06:41 devstack sudo[103473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:06:42 devstack cinder-volume[87420]: INFO cinder.volume.manager [req-f5a3092e-fc47-444d-b4c5-d880f0e9c7d8 req-c490b3be-d374-4db1-80b0-6216e49946e5 tempest-TestServerVolumeAttachmentScenario-1220265420 None] Terminate volume connection completed successfully. Jul 10 16:06:42 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [req-f5a3092e-fc47-444d-b4c5-d880f0e9c7d8 req-c490b3be-d374-4db1-80b0-6216e49946e5 tempest-TestServerVolumeAttachmentScenario-1220265420 None] Deleting attachment 04c9239f-adb1-4ce3-aac7-ef6ed5eeeb95. {{(pid=87420) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 16:06:42 devstack sudo[103473]: pam_unix(sudo:session): session closed for user root Jul 10 16:06:42 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-01f377ab-d8fc-47a0-b256-e5efa0edb871 tempest-ProjectReaderTests-1450192889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-5fac1d35-1d71-4e96-8a9b-123de58487ca 1073741824" returned: 0 in 0.847s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:06:42 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-01f377ab-d8fc-47a0-b256-e5efa0edb871 tempest-ProjectReaderTests-1450192889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-5fac1d35-1d71-4e96-8a9b-123de58487ca {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:06:42 devstack sudo[103481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-5fac1d35-1d71-4e96-8a9b-123de58487ca Jul 10 16:06:42 devstack sudo[103481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:06:43 devstack sudo[103481]: pam_unix(sudo:session): session closed for user root Jul 10 16:06:43 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-01f377ab-d8fc-47a0-b256-e5efa0edb871 tempest-ProjectReaderTests-1450192889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-5fac1d35-1d71-4e96-8a9b-123de58487ca" returned: 0 in 0.639s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:06:43 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-01f377ab-d8fc-47a0-b256-e5efa0edb871 tempest-ProjectReaderTests-1450192889 None] <== create_volume: return (1524ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 16:06:43 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-01f377ab-d8fc-47a0-b256-e5efa0edb871 tempest-ProjectReaderTests-1450192889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.527s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:06:43 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-01f377ab-d8fc-47a0-b256-e5efa0edb871 tempest-ProjectReaderTests-1450192889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d61b650f-c4cd-4e4b-b178-e85829be8e2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fac1d35-1d71-4e96-8a9b-123de58487ca', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:06:43 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-01f377ab-d8fc-47a0-b256-e5efa0edb871 tempest-ProjectReaderTests-1450192889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d99c0bb8-90d9-4ab7-b79b-ef7e133d2a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:06:43 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-01f377ab-d8fc-47a0-b256-e5efa0edb871 tempest-ProjectReaderTests-1450192889 None] Volume volume-5fac1d35-1d71-4e96-8a9b-123de58487ca (5fac1d35-1d71-4e96-8a9b-123de58487ca): created successfully Jul 10 16:06:43 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-01f377ab-d8fc-47a0-b256-e5efa0edb871 tempest-ProjectReaderTests-1450192889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d99c0bb8-90d9-4ab7-b79b-ef7e133d2a1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:06:43 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-01f377ab-d8fc-47a0-b256-e5efa0edb871 tempest-ProjectReaderTests-1450192889 None] Flow 'volume_create_manager' (2124c182-2a6f-44c7-9ed5-404db0a58d91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:06:43 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-01f377ab-d8fc-47a0-b256-e5efa0edb871 tempest-ProjectReaderTests-1450192889 None] Created volume successfully. Jul 10 16:06:43 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-cee3d534-470b-41c0-8183-7b270d026cce tempest-ProjectReaderTests-1450192889 None] Acquiring lock "cinder-5fac1d35-1d71-4e96-8a9b-123de58487ca-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:06:43 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-cee3d534-470b-41c0-8183-7b270d026cce tempest-ProjectReaderTests-1450192889 None] Lock "cinder-5fac1d35-1d71-4e96-8a9b-123de58487ca-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:06:44 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-cee3d534-470b-41c0-8183-7b270d026cce tempest-ProjectReaderTests-1450192889 None] Acquiring lock "cinder-quobyte-5fac1d35-1d71-4e96-8a9b-123de58487ca" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:06:44 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-cee3d534-470b-41c0-8183-7b270d026cce tempest-ProjectReaderTests-1450192889 None] Lock "cinder-quobyte-5fac1d35-1d71-4e96-8a9b-123de58487ca" acquired by "delete_volume" :: waited 0.015s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:06:44 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[b89d8dcf-1bac-492b-ac3c-6fb990c72a63]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:06:44 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-cee3d534-470b-41c0-8183-7b270d026cce tempest-ProjectReaderTests-1450192889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-5fac1d35-1d71-4e96-8a9b-123de58487ca {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:06:44 devstack sudo[103485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-5fac1d35-1d71-4e96-8a9b-123de58487ca Jul 10 16:06:44 devstack sudo[103485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:06:44 devstack sudo[103485]: pam_unix(sudo:session): session closed for user root Jul 10 16:06:44 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-cee3d534-470b-41c0-8183-7b270d026cce tempest-ProjectReaderTests-1450192889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-5fac1d35-1d71-4e96-8a9b-123de58487ca" returned: 0 in 0.776s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:06:44 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-cee3d534-470b-41c0-8183-7b270d026cce tempest-ProjectReaderTests-1450192889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-5fac1d35-1d71-4e96-8a9b-123de58487ca {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:06:44 devstack sudo[103490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-5fac1d35-1d71-4e96-8a9b-123de58487ca Jul 10 16:06:44 devstack sudo[103490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:06:45 devstack sudo[103490]: pam_unix(sudo:session): session closed for user root Jul 10 16:06:45 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-cee3d534-470b-41c0-8183-7b270d026cce tempest-ProjectReaderTests-1450192889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-5fac1d35-1d71-4e96-8a9b-123de58487ca" returned: 0 in 0.661s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:06:45 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-cee3d534-470b-41c0-8183-7b270d026cce tempest-ProjectReaderTests-1450192889 None] Lock "cinder-quobyte-5fac1d35-1d71-4e96-8a9b-123de58487ca" released by "delete_volume" :: held 1.475s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:06:45 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-cee3d534-470b-41c0-8183-7b270d026cce tempest-ProjectReaderTests-1450192889 None] Created reservations ['54bea11c-2b2a-44e4-b15e-6048b789b7c7', '6c376dd7-98f0-4437-8378-80cbe42078d4', '0ec47f2e-47f7-4db2-b658-c3e3b442de84', '72c5d529-62c5-4605-b0dd-3b7219ad51bd'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:06:45 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-cee3d534-470b-41c0-8183-7b270d026cce tempest-ProjectReaderTests-1450192889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:06:45 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-cee3d534-470b-41c0-8183-7b270d026cce tempest-ProjectReaderTests-1450192889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:06:45 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-cee3d534-470b-41c0-8183-7b270d026cce tempest-ProjectReaderTests-1450192889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:06:45 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-cee3d534-470b-41c0-8183-7b270d026cce tempest-ProjectReaderTests-1450192889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:06:45 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-cee3d534-470b-41c0-8183-7b270d026cce tempest-ProjectReaderTests-1450192889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:06:45 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-cee3d534-470b-41c0-8183-7b270d026cce tempest-ProjectReaderTests-1450192889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:06:45 devstack sudo[103493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:06:45 devstack sudo[103493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:06:46 devstack cinder-volume[87420]: INFO cinder.volume.manager [req-de36808e-a373-4233-9fde-a24153bd43b8 req-6a930393-5dfd-4f98-93d8-2e4e11285952 tempest-TestServerVolumeAttachmentScenario-1220265420 None] Terminate volume connection completed successfully. Jul 10 16:06:46 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [req-de36808e-a373-4233-9fde-a24153bd43b8 req-6a930393-5dfd-4f98-93d8-2e4e11285952 tempest-TestServerVolumeAttachmentScenario-1220265420 None] Deleting attachment 8fa2923e-366f-4c5f-9121-8cffdfc95eb9. {{(pid=87420) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 16:06:46 devstack sudo[103493]: pam_unix(sudo:session): session closed for user root Jul 10 16:06:46 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-cee3d534-470b-41c0-8183-7b270d026cce tempest-ProjectReaderTests-1450192889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.723s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:06:46 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-cee3d534-470b-41c0-8183-7b270d026cce tempest-ProjectReaderTests-1450192889 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:06:46 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-cee3d534-470b-41c0-8183-7b270d026cce tempest-ProjectReaderTests-1450192889 None] Deleted volume successfully. Jul 10 16:06:46 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-cee3d534-470b-41c0-8183-7b270d026cce tempest-ProjectReaderTests-1450192889 None] Lock "cinder-5fac1d35-1d71-4e96-8a9b-123de58487ca-delete_volume" released by "delete_volume" :: held 2.389s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:06:46 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-b969fb25-c19b-438e-b763-61e33d7ec3d7 tempest-ProjectReaderTests-1450192889 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 16:06:46 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b969fb25-c19b-438e-b763-61e33d7ec3d7 tempest-ProjectReaderTests-1450192889 None] Flow 'volume_create_manager' (7727052d-4162-40ed-9637-dc5e40c549f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:06:46 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b969fb25-c19b-438e-b763-61e33d7ec3d7 tempest-ProjectReaderTests-1450192889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48d6a436-4bbe-4b17-81e5-79966338300b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:06:46 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b969fb25-c19b-438e-b763-61e33d7ec3d7 tempest-ProjectReaderTests-1450192889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48d6a436-4bbe-4b17-81e5-79966338300b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:06:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-909896893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ded7e5e-7f49-412f-a8ac-ea5caed87831,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c5b04d641164d0b829712969aaeac13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:06:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:06:47Z,use_quota=True,user_id='f4b68bb8cef84cd08cca03eee3f0ab38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:06:46 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b969fb25-c19b-438e-b763-61e33d7ec3d7 tempest-ProjectReaderTests-1450192889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dda81ce-8c73-40c7-915e-59ab9a1b1eae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:06:46 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b969fb25-c19b-438e-b763-61e33d7ec3d7 tempest-ProjectReaderTests-1450192889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dda81ce-8c73-40c7-915e-59ab9a1b1eae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:06:46 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b969fb25-c19b-438e-b763-61e33d7ec3d7 tempest-ProjectReaderTests-1450192889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33cefc43-3b8b-43bd-950e-ed7287b94e01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:06:46 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b969fb25-c19b-438e-b763-61e33d7ec3d7 tempest-ProjectReaderTests-1450192889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33cefc43-3b8b-43bd-950e-ed7287b94e01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ded7e5e-7f49-412f-a8ac-ea5caed87831', 'volume_name': 'volume-6ded7e5e-7f49-412f-a8ac-ea5caed87831', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:06:46 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b969fb25-c19b-438e-b763-61e33d7ec3d7 tempest-ProjectReaderTests-1450192889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7f1dea3-31cc-4195-a0c5-73109de6a409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:06:46 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b969fb25-c19b-438e-b763-61e33d7ec3d7 tempest-ProjectReaderTests-1450192889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7f1dea3-31cc-4195-a0c5-73109de6a409) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:06:46 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b969fb25-c19b-438e-b763-61e33d7ec3d7 tempest-ProjectReaderTests-1450192889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63560fb0-9c35-4e67-821b-31867a567146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:06:46 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-b969fb25-c19b-438e-b763-61e33d7ec3d7 tempest-ProjectReaderTests-1450192889 None] Volume 6ded7e5e-7f49-412f-a8ac-ea5caed87831: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ded7e5e-7f49-412f-a8ac-ea5caed87831', 'volume_size': 1} Jul 10 16:06:46 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-b969fb25-c19b-438e-b763-61e33d7ec3d7 tempest-ProjectReaderTests-1450192889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:06:46 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-b969fb25-c19b-438e-b763-61e33d7ec3d7 tempest-ProjectReaderTests-1450192889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:06:46 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-b969fb25-c19b-438e-b763-61e33d7ec3d7 tempest-ProjectReaderTests-1450192889 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:06:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-909896893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ded7e5e-7f49-412f-a8ac-ea5caed87831,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c5b04d641164d0b829712969aaeac13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:06:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:06:47Z,use_quota=True,user_id='f4b68bb8cef84cd08cca03eee3f0ab38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 16:06:46 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-b969fb25-c19b-438e-b763-61e33d7ec3d7 tempest-ProjectReaderTests-1450192889 None] Creating volume 6ded7e5e-7f49-412f-a8ac-ea5caed87831 {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 16:06:46 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-b969fb25-c19b-438e-b763-61e33d7ec3d7 tempest-ProjectReaderTests-1450192889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:06:46 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-b969fb25-c19b-438e-b763-61e33d7ec3d7 tempest-ProjectReaderTests-1450192889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:06:46 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-b969fb25-c19b-438e-b763-61e33d7ec3d7 tempest-ProjectReaderTests-1450192889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:06:46 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-b969fb25-c19b-438e-b763-61e33d7ec3d7 tempest-ProjectReaderTests-1450192889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:06:46 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-b969fb25-c19b-438e-b763-61e33d7ec3d7 tempest-ProjectReaderTests-1450192889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:06:46 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-b969fb25-c19b-438e-b763-61e33d7ec3d7 tempest-ProjectReaderTests-1450192889 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 16:06:46 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-b969fb25-c19b-438e-b763-61e33d7ec3d7 tempest-ProjectReaderTests-1450192889 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 16:06:46 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-b969fb25-c19b-438e-b763-61e33d7ec3d7 tempest-ProjectReaderTests-1450192889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6ded7e5e-7f49-412f-a8ac-ea5caed87831 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:06:46 devstack sudo[103529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6ded7e5e-7f49-412f-a8ac-ea5caed87831 1073741824 Jul 10 16:06:46 devstack sudo[103529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:06:47 devstack sudo[103529]: pam_unix(sudo:session): session closed for user root Jul 10 16:06:47 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-b969fb25-c19b-438e-b763-61e33d7ec3d7 tempest-ProjectReaderTests-1450192889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6ded7e5e-7f49-412f-a8ac-ea5caed87831 1073741824" returned: 0 in 0.834s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:06:47 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-b969fb25-c19b-438e-b763-61e33d7ec3d7 tempest-ProjectReaderTests-1450192889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6ded7e5e-7f49-412f-a8ac-ea5caed87831 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:06:47 devstack sudo[103535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6ded7e5e-7f49-412f-a8ac-ea5caed87831 Jul 10 16:06:47 devstack sudo[103535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:06:48 devstack sudo[103535]: pam_unix(sudo:session): session closed for user root Jul 10 16:06:48 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-b969fb25-c19b-438e-b763-61e33d7ec3d7 tempest-ProjectReaderTests-1450192889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6ded7e5e-7f49-412f-a8ac-ea5caed87831" returned: 0 in 0.676s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:06:48 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-b969fb25-c19b-438e-b763-61e33d7ec3d7 tempest-ProjectReaderTests-1450192889 None] <== create_volume: return (1553ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 16:06:48 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-b969fb25-c19b-438e-b763-61e33d7ec3d7 tempest-ProjectReaderTests-1450192889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.557s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:06:48 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b969fb25-c19b-438e-b763-61e33d7ec3d7 tempest-ProjectReaderTests-1450192889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63560fb0-9c35-4e67-821b-31867a567146) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ded7e5e-7f49-412f-a8ac-ea5caed87831', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:06:48 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b969fb25-c19b-438e-b763-61e33d7ec3d7 tempest-ProjectReaderTests-1450192889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ec55d30-5f33-46cd-b340-f68ad07f80aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:06:48 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-b969fb25-c19b-438e-b763-61e33d7ec3d7 tempest-ProjectReaderTests-1450192889 None] Volume volume-6ded7e5e-7f49-412f-a8ac-ea5caed87831 (6ded7e5e-7f49-412f-a8ac-ea5caed87831): created successfully Jul 10 16:06:48 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b969fb25-c19b-438e-b763-61e33d7ec3d7 tempest-ProjectReaderTests-1450192889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ec55d30-5f33-46cd-b340-f68ad07f80aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:06:48 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b969fb25-c19b-438e-b763-61e33d7ec3d7 tempest-ProjectReaderTests-1450192889 None] Flow 'volume_create_manager' (7727052d-4162-40ed-9637-dc5e40c549f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:06:48 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-b969fb25-c19b-438e-b763-61e33d7ec3d7 tempest-ProjectReaderTests-1450192889 None] Created volume successfully. Jul 10 16:06:48 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-cd0bf66f-df0f-4ad8-a3f9-5229d485d994 tempest-ProjectReaderTests-1450192889 None] Acquiring lock "cinder-6ded7e5e-7f49-412f-a8ac-ea5caed87831-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:06:48 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-cd0bf66f-df0f-4ad8-a3f9-5229d485d994 tempest-ProjectReaderTests-1450192889 None] Lock "cinder-6ded7e5e-7f49-412f-a8ac-ea5caed87831-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:06:48 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-cd0bf66f-df0f-4ad8-a3f9-5229d485d994 tempest-ProjectReaderTests-1450192889 None] Acquiring lock "cinder-quobyte-6ded7e5e-7f49-412f-a8ac-ea5caed87831" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:06:48 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-cd0bf66f-df0f-4ad8-a3f9-5229d485d994 tempest-ProjectReaderTests-1450192889 None] Lock "cinder-quobyte-6ded7e5e-7f49-412f-a8ac-ea5caed87831" acquired by "delete_volume" :: waited 0.018s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:06:48 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[23f4ed97-f801-4ed9-a692-eefc67cf1c36]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:06:48 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-cd0bf66f-df0f-4ad8-a3f9-5229d485d994 tempest-ProjectReaderTests-1450192889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6ded7e5e-7f49-412f-a8ac-ea5caed87831 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:06:49 devstack sudo[103538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6ded7e5e-7f49-412f-a8ac-ea5caed87831 Jul 10 16:06:49 devstack sudo[103538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:06:49 devstack sudo[103538]: pam_unix(sudo:session): session closed for user root Jul 10 16:06:49 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-cd0bf66f-df0f-4ad8-a3f9-5229d485d994 tempest-ProjectReaderTests-1450192889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6ded7e5e-7f49-412f-a8ac-ea5caed87831" returned: 0 in 0.787s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:06:49 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-cd0bf66f-df0f-4ad8-a3f9-5229d485d994 tempest-ProjectReaderTests-1450192889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6ded7e5e-7f49-412f-a8ac-ea5caed87831 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:06:49 devstack sudo[103549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6ded7e5e-7f49-412f-a8ac-ea5caed87831 Jul 10 16:06:49 devstack sudo[103549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:06:50 devstack sudo[103549]: pam_unix(sudo:session): session closed for user root Jul 10 16:06:50 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-cd0bf66f-df0f-4ad8-a3f9-5229d485d994 tempest-ProjectReaderTests-1450192889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6ded7e5e-7f49-412f-a8ac-ea5caed87831" returned: 0 in 0.740s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:06:50 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-cd0bf66f-df0f-4ad8-a3f9-5229d485d994 tempest-ProjectReaderTests-1450192889 None] Lock "cinder-quobyte-6ded7e5e-7f49-412f-a8ac-ea5caed87831" released by "delete_volume" :: held 1.570s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:06:50 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-cd0bf66f-df0f-4ad8-a3f9-5229d485d994 tempest-ProjectReaderTests-1450192889 None] Created reservations ['a76e84d7-52d3-44cd-a667-8756ef29fd9a', '640a51cc-e7ab-42f5-927f-7a4abe27508f', '89b8f6a2-3a6a-44b3-99c9-52e27559c952', '8e257de7-b386-46c2-8ca0-9908dacf9b9c'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:06:50 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-cd0bf66f-df0f-4ad8-a3f9-5229d485d994 tempest-ProjectReaderTests-1450192889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:06:50 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-cd0bf66f-df0f-4ad8-a3f9-5229d485d994 tempest-ProjectReaderTests-1450192889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:06:50 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-cd0bf66f-df0f-4ad8-a3f9-5229d485d994 tempest-ProjectReaderTests-1450192889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:06:50 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-cd0bf66f-df0f-4ad8-a3f9-5229d485d994 tempest-ProjectReaderTests-1450192889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:06:50 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-cd0bf66f-df0f-4ad8-a3f9-5229d485d994 tempest-ProjectReaderTests-1450192889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:06:50 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-cd0bf66f-df0f-4ad8-a3f9-5229d485d994 tempest-ProjectReaderTests-1450192889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:06:50 devstack sudo[103567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:06:50 devstack sudo[103567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:06:51 devstack sudo[103567]: pam_unix(sudo:session): session closed for user root Jul 10 16:06:51 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-cd0bf66f-df0f-4ad8-a3f9-5229d485d994 tempest-ProjectReaderTests-1450192889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.780s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:06:51 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-cd0bf66f-df0f-4ad8-a3f9-5229d485d994 tempest-ProjectReaderTests-1450192889 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:06:51 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-cd0bf66f-df0f-4ad8-a3f9-5229d485d994 tempest-ProjectReaderTests-1450192889 None] Deleted volume successfully. Jul 10 16:06:51 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-cd0bf66f-df0f-4ad8-a3f9-5229d485d994 tempest-ProjectReaderTests-1450192889 None] Lock "cinder-6ded7e5e-7f49-412f-a8ac-ea5caed87831-delete_volume" released by "delete_volume" :: held 2.601s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:06:51 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8b21545-0ac6-4345-bdc6-8396520fea5f tempest-ProjectReaderTests-1450192889 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 16:06:51 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b8b21545-0ac6-4345-bdc6-8396520fea5f tempest-ProjectReaderTests-1450192889 None] Flow 'volume_create_manager' (01b21642-157c-4c12-b69d-d1838fdca05a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:06:51 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b8b21545-0ac6-4345-bdc6-8396520fea5f tempest-ProjectReaderTests-1450192889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82816441-3372-4598-9e80-b3adf736627d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:06:51 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b8b21545-0ac6-4345-bdc6-8396520fea5f tempest-ProjectReaderTests-1450192889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82816441-3372-4598-9e80-b3adf736627d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:06:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-8750211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25b3df1e-e9c2-4ea8-b9d3-12c0d06b906d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c5b04d641164d0b829712969aaeac13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:06:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:06:52Z,use_quota=True,user_id='f4b68bb8cef84cd08cca03eee3f0ab38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:06:51 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b8b21545-0ac6-4345-bdc6-8396520fea5f tempest-ProjectReaderTests-1450192889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4199b954-cc05-4aaf-9ba2-d4722cc74cfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:06:51 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b8b21545-0ac6-4345-bdc6-8396520fea5f tempest-ProjectReaderTests-1450192889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4199b954-cc05-4aaf-9ba2-d4722cc74cfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:06:51 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b8b21545-0ac6-4345-bdc6-8396520fea5f tempest-ProjectReaderTests-1450192889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36c086c7-8cf3-473c-a6df-130092a221bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:06:51 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b8b21545-0ac6-4345-bdc6-8396520fea5f tempest-ProjectReaderTests-1450192889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36c086c7-8cf3-473c-a6df-130092a221bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25b3df1e-e9c2-4ea8-b9d3-12c0d06b906d', 'volume_name': 'volume-25b3df1e-e9c2-4ea8-b9d3-12c0d06b906d', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:06:51 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b8b21545-0ac6-4345-bdc6-8396520fea5f tempest-ProjectReaderTests-1450192889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9aeaa9f9-ceda-4be9-9d20-3858d1f1370a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:06:51 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b8b21545-0ac6-4345-bdc6-8396520fea5f tempest-ProjectReaderTests-1450192889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9aeaa9f9-ceda-4be9-9d20-3858d1f1370a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:06:51 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b8b21545-0ac6-4345-bdc6-8396520fea5f tempest-ProjectReaderTests-1450192889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b442aea0-7878-4ab0-b342-e0236b9bb886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:06:51 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-b8b21545-0ac6-4345-bdc6-8396520fea5f tempest-ProjectReaderTests-1450192889 None] Volume 25b3df1e-e9c2-4ea8-b9d3-12c0d06b906d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25b3df1e-e9c2-4ea8-b9d3-12c0d06b906d', 'volume_size': 1} Jul 10 16:06:51 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-b8b21545-0ac6-4345-bdc6-8396520fea5f tempest-ProjectReaderTests-1450192889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:06:51 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-b8b21545-0ac6-4345-bdc6-8396520fea5f tempest-ProjectReaderTests-1450192889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:06:51 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-b8b21545-0ac6-4345-bdc6-8396520fea5f tempest-ProjectReaderTests-1450192889 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:06:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-8750211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25b3df1e-e9c2-4ea8-b9d3-12c0d06b906d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c5b04d641164d0b829712969aaeac13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:06:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:06:52Z,use_quota=True,user_id='f4b68bb8cef84cd08cca03eee3f0ab38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 16:06:51 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-b8b21545-0ac6-4345-bdc6-8396520fea5f tempest-ProjectReaderTests-1450192889 None] Creating volume 25b3df1e-e9c2-4ea8-b9d3-12c0d06b906d {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 16:06:51 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-b8b21545-0ac6-4345-bdc6-8396520fea5f tempest-ProjectReaderTests-1450192889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:06:51 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-b8b21545-0ac6-4345-bdc6-8396520fea5f tempest-ProjectReaderTests-1450192889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:06:51 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-b8b21545-0ac6-4345-bdc6-8396520fea5f tempest-ProjectReaderTests-1450192889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:06:51 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-b8b21545-0ac6-4345-bdc6-8396520fea5f tempest-ProjectReaderTests-1450192889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:06:51 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-b8b21545-0ac6-4345-bdc6-8396520fea5f tempest-ProjectReaderTests-1450192889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:06:51 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-b8b21545-0ac6-4345-bdc6-8396520fea5f tempest-ProjectReaderTests-1450192889 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 16:06:51 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-b8b21545-0ac6-4345-bdc6-8396520fea5f tempest-ProjectReaderTests-1450192889 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 16:06:51 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-b8b21545-0ac6-4345-bdc6-8396520fea5f tempest-ProjectReaderTests-1450192889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-25b3df1e-e9c2-4ea8-b9d3-12c0d06b906d 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:06:51 devstack sudo[103573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-25b3df1e-e9c2-4ea8-b9d3-12c0d06b906d 1073741824 Jul 10 16:06:51 devstack sudo[103573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:06:52 devstack sudo[103573]: pam_unix(sudo:session): session closed for user root Jul 10 16:06:52 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-b8b21545-0ac6-4345-bdc6-8396520fea5f tempest-ProjectReaderTests-1450192889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-25b3df1e-e9c2-4ea8-b9d3-12c0d06b906d 1073741824" returned: 0 in 0.891s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:06:52 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-b8b21545-0ac6-4345-bdc6-8396520fea5f tempest-ProjectReaderTests-1450192889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-25b3df1e-e9c2-4ea8-b9d3-12c0d06b906d {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:06:52 devstack sudo[103580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-25b3df1e-e9c2-4ea8-b9d3-12c0d06b906d Jul 10 16:06:52 devstack sudo[103580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:06:53 devstack sudo[103580]: pam_unix(sudo:session): session closed for user root Jul 10 16:06:53 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-b8b21545-0ac6-4345-bdc6-8396520fea5f tempest-ProjectReaderTests-1450192889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-25b3df1e-e9c2-4ea8-b9d3-12c0d06b906d" returned: 0 in 0.683s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:06:53 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-b8b21545-0ac6-4345-bdc6-8396520fea5f tempest-ProjectReaderTests-1450192889 None] <== create_volume: return (1622ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 16:06:53 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-b8b21545-0ac6-4345-bdc6-8396520fea5f tempest-ProjectReaderTests-1450192889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.625s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:06:53 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b8b21545-0ac6-4345-bdc6-8396520fea5f tempest-ProjectReaderTests-1450192889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b442aea0-7878-4ab0-b342-e0236b9bb886) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25b3df1e-e9c2-4ea8-b9d3-12c0d06b906d', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:06:53 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b8b21545-0ac6-4345-bdc6-8396520fea5f tempest-ProjectReaderTests-1450192889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86806a16-3ab8-47d3-b0ca-6973100aef6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:06:53 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-b8b21545-0ac6-4345-bdc6-8396520fea5f tempest-ProjectReaderTests-1450192889 None] Volume volume-25b3df1e-e9c2-4ea8-b9d3-12c0d06b906d (25b3df1e-e9c2-4ea8-b9d3-12c0d06b906d): created successfully Jul 10 16:06:53 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b8b21545-0ac6-4345-bdc6-8396520fea5f tempest-ProjectReaderTests-1450192889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86806a16-3ab8-47d3-b0ca-6973100aef6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:06:53 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b8b21545-0ac6-4345-bdc6-8396520fea5f tempest-ProjectReaderTests-1450192889 None] Flow 'volume_create_manager' (01b21642-157c-4c12-b69d-d1838fdca05a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:06:53 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-b8b21545-0ac6-4345-bdc6-8396520fea5f tempest-ProjectReaderTests-1450192889 None] Created volume successfully. Jul 10 16:06:53 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-88b62e1c-406d-43da-84e2-1d33f7ebd157 tempest-ProjectReaderTests-1450192889 None] Acquiring lock "cinder-25b3df1e-e9c2-4ea8-b9d3-12c0d06b906d-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:06:53 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-88b62e1c-406d-43da-84e2-1d33f7ebd157 tempest-ProjectReaderTests-1450192889 None] Lock "cinder-25b3df1e-e9c2-4ea8-b9d3-12c0d06b906d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:06:53 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-88b62e1c-406d-43da-84e2-1d33f7ebd157 tempest-ProjectReaderTests-1450192889 None] Acquiring lock "cinder-quobyte-25b3df1e-e9c2-4ea8-b9d3-12c0d06b906d" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:06:53 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-88b62e1c-406d-43da-84e2-1d33f7ebd157 tempest-ProjectReaderTests-1450192889 None] Lock "cinder-quobyte-25b3df1e-e9c2-4ea8-b9d3-12c0d06b906d" acquired by "delete_volume" :: waited 0.015s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:06:53 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5035d74-0b1e-4e1e-a4be-9ac70cf29038]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:06:53 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-88b62e1c-406d-43da-84e2-1d33f7ebd157 tempest-ProjectReaderTests-1450192889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-25b3df1e-e9c2-4ea8-b9d3-12c0d06b906d {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:06:53 devstack sudo[103584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-25b3df1e-e9c2-4ea8-b9d3-12c0d06b906d Jul 10 16:06:53 devstack sudo[103584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:06:54 devstack sudo[103584]: pam_unix(sudo:session): session closed for user root Jul 10 16:06:54 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-88b62e1c-406d-43da-84e2-1d33f7ebd157 tempest-ProjectReaderTests-1450192889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-25b3df1e-e9c2-4ea8-b9d3-12c0d06b906d" returned: 0 in 0.784s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:06:54 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-88b62e1c-406d-43da-84e2-1d33f7ebd157 tempest-ProjectReaderTests-1450192889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-25b3df1e-e9c2-4ea8-b9d3-12c0d06b906d {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:06:54 devstack sudo[103589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-25b3df1e-e9c2-4ea8-b9d3-12c0d06b906d Jul 10 16:06:54 devstack sudo[103589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:06:55 devstack sudo[103589]: pam_unix(sudo:session): session closed for user root Jul 10 16:06:55 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-88b62e1c-406d-43da-84e2-1d33f7ebd157 tempest-ProjectReaderTests-1450192889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-25b3df1e-e9c2-4ea8-b9d3-12c0d06b906d" returned: 0 in 0.687s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:06:55 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-88b62e1c-406d-43da-84e2-1d33f7ebd157 tempest-ProjectReaderTests-1450192889 None] Lock "cinder-quobyte-25b3df1e-e9c2-4ea8-b9d3-12c0d06b906d" released by "delete_volume" :: held 1.509s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:06:55 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-88b62e1c-406d-43da-84e2-1d33f7ebd157 tempest-ProjectReaderTests-1450192889 None] Created reservations ['43f0d858-677a-461d-b8ff-b6fe252020ec', '67beb426-7bd4-49b6-ae07-b573d82dbde5', '5c4bf34e-72c2-4302-818b-520c5e7a8e64', '47d9c040-bcd2-45fb-a1a6-edd0d55d2c89'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:06:55 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-88b62e1c-406d-43da-84e2-1d33f7ebd157 tempest-ProjectReaderTests-1450192889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:06:55 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-88b62e1c-406d-43da-84e2-1d33f7ebd157 tempest-ProjectReaderTests-1450192889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:06:55 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-88b62e1c-406d-43da-84e2-1d33f7ebd157 tempest-ProjectReaderTests-1450192889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:06:55 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-88b62e1c-406d-43da-84e2-1d33f7ebd157 tempest-ProjectReaderTests-1450192889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:06:55 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-88b62e1c-406d-43da-84e2-1d33f7ebd157 tempest-ProjectReaderTests-1450192889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:06:55 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-88b62e1c-406d-43da-84e2-1d33f7ebd157 tempest-ProjectReaderTests-1450192889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:06:55 devstack sudo[103592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:06:55 devstack sudo[103592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:06:56 devstack sudo[103592]: pam_unix(sudo:session): session closed for user root Jul 10 16:06:56 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-88b62e1c-406d-43da-84e2-1d33f7ebd157 tempest-ProjectReaderTests-1450192889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.697s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:06:56 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-88b62e1c-406d-43da-84e2-1d33f7ebd157 tempest-ProjectReaderTests-1450192889 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:06:56 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-88b62e1c-406d-43da-84e2-1d33f7ebd157 tempest-ProjectReaderTests-1450192889 None] Deleted volume successfully. Jul 10 16:06:56 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-88b62e1c-406d-43da-84e2-1d33f7ebd157 tempest-ProjectReaderTests-1450192889 None] Lock "cinder-25b3df1e-e9c2-4ea8-b9d3-12c0d06b906d-delete_volume" released by "delete_volume" :: held 2.400s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:06:56 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-18f1014f-81f3-40dc-807b-14439b0a4c2d tempest-ProjectReaderTests-1450192889 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 16:06:56 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-18f1014f-81f3-40dc-807b-14439b0a4c2d tempest-ProjectReaderTests-1450192889 None] Flow 'volume_create_manager' (bacd080b-1533-4862-9d9a-c9ce8814e794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:06:56 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-18f1014f-81f3-40dc-807b-14439b0a4c2d tempest-ProjectReaderTests-1450192889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e2232a3-69b7-4a60-a8c3-473b7dfe2b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:06:56 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-18f1014f-81f3-40dc-807b-14439b0a4c2d tempest-ProjectReaderTests-1450192889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e2232a3-69b7-4a60-a8c3-473b7dfe2b45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:06:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-153378908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f627d6d-7ac2-4970-b334-bc14901a3793,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c5b04d641164d0b829712969aaeac13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:06:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:06:56Z,use_quota=True,user_id='f4b68bb8cef84cd08cca03eee3f0ab38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:06:56 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-18f1014f-81f3-40dc-807b-14439b0a4c2d tempest-ProjectReaderTests-1450192889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d29bcaa-9ccd-4080-b1e7-b60ff19d98f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:06:56 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-18f1014f-81f3-40dc-807b-14439b0a4c2d tempest-ProjectReaderTests-1450192889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d29bcaa-9ccd-4080-b1e7-b60ff19d98f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:06:56 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-18f1014f-81f3-40dc-807b-14439b0a4c2d tempest-ProjectReaderTests-1450192889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc26b6f3-0b87-49da-9889-fcfed9f90784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:06:56 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-18f1014f-81f3-40dc-807b-14439b0a4c2d tempest-ProjectReaderTests-1450192889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc26b6f3-0b87-49da-9889-fcfed9f90784) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f627d6d-7ac2-4970-b334-bc14901a3793', 'volume_name': 'volume-9f627d6d-7ac2-4970-b334-bc14901a3793', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:06:56 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-18f1014f-81f3-40dc-807b-14439b0a4c2d tempest-ProjectReaderTests-1450192889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e83d344-b8e2-4e5d-ae96-a6a0f3d09299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:06:56 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-18f1014f-81f3-40dc-807b-14439b0a4c2d tempest-ProjectReaderTests-1450192889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e83d344-b8e2-4e5d-ae96-a6a0f3d09299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:06:56 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-18f1014f-81f3-40dc-807b-14439b0a4c2d tempest-ProjectReaderTests-1450192889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faa0dc78-75b4-43b3-a478-b48fe5959b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:06:56 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-18f1014f-81f3-40dc-807b-14439b0a4c2d tempest-ProjectReaderTests-1450192889 None] Volume 9f627d6d-7ac2-4970-b334-bc14901a3793: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f627d6d-7ac2-4970-b334-bc14901a3793', 'volume_size': 1} Jul 10 16:06:56 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-18f1014f-81f3-40dc-807b-14439b0a4c2d tempest-ProjectReaderTests-1450192889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:06:56 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-18f1014f-81f3-40dc-807b-14439b0a4c2d tempest-ProjectReaderTests-1450192889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:06:56 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-18f1014f-81f3-40dc-807b-14439b0a4c2d tempest-ProjectReaderTests-1450192889 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:06:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-153378908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f627d6d-7ac2-4970-b334-bc14901a3793,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c5b04d641164d0b829712969aaeac13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:06:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:06:56Z,use_quota=True,user_id='f4b68bb8cef84cd08cca03eee3f0ab38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 16:06:56 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-18f1014f-81f3-40dc-807b-14439b0a4c2d tempest-ProjectReaderTests-1450192889 None] Creating volume 9f627d6d-7ac2-4970-b334-bc14901a3793 {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 16:06:56 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-18f1014f-81f3-40dc-807b-14439b0a4c2d tempest-ProjectReaderTests-1450192889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:06:56 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-18f1014f-81f3-40dc-807b-14439b0a4c2d tempest-ProjectReaderTests-1450192889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:06:56 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-18f1014f-81f3-40dc-807b-14439b0a4c2d tempest-ProjectReaderTests-1450192889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:06:56 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-18f1014f-81f3-40dc-807b-14439b0a4c2d tempest-ProjectReaderTests-1450192889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:06:56 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-18f1014f-81f3-40dc-807b-14439b0a4c2d tempest-ProjectReaderTests-1450192889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:06:56 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-18f1014f-81f3-40dc-807b-14439b0a4c2d tempest-ProjectReaderTests-1450192889 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 16:06:56 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-18f1014f-81f3-40dc-807b-14439b0a4c2d tempest-ProjectReaderTests-1450192889 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 16:06:56 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-18f1014f-81f3-40dc-807b-14439b0a4c2d tempest-ProjectReaderTests-1450192889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-9f627d6d-7ac2-4970-b334-bc14901a3793 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:06:56 devstack sudo[103595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-9f627d6d-7ac2-4970-b334-bc14901a3793 1073741824 Jul 10 16:06:56 devstack sudo[103595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:06:56 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-18c87841-08d1-4e0a-84bf-df0f497f5cb8 tempest-TestServerVolumeAttachmentScenario-1220265420 None] Acquiring lock "cinder-e9f2242a-c99d-4b84-817f-8abda1033a0e-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:06:56 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-18c87841-08d1-4e0a-84bf-df0f497f5cb8 tempest-TestServerVolumeAttachmentScenario-1220265420 None] Lock "cinder-e9f2242a-c99d-4b84-817f-8abda1033a0e-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:06:56 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-18c87841-08d1-4e0a-84bf-df0f497f5cb8 tempest-TestServerVolumeAttachmentScenario-1220265420 None] Acquiring lock "cinder-quobyte-e9f2242a-c99d-4b84-817f-8abda1033a0e" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:06:56 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-18c87841-08d1-4e0a-84bf-df0f497f5cb8 tempest-TestServerVolumeAttachmentScenario-1220265420 None] Lock "cinder-quobyte-e9f2242a-c99d-4b84-817f-8abda1033a0e" acquired by "delete_volume" :: waited 0.013s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:06:56 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[f638fdab-4889-431a-915e-9fcf2be0afbd]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:06:56 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-18c87841-08d1-4e0a-84bf-df0f497f5cb8 tempest-TestServerVolumeAttachmentScenario-1220265420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-e9f2242a-c99d-4b84-817f-8abda1033a0e {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:06:56 devstack sudo[103597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-e9f2242a-c99d-4b84-817f-8abda1033a0e Jul 10 16:06:56 devstack sudo[103597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:06:57 devstack sudo[103595]: pam_unix(sudo:session): session closed for user root Jul 10 16:06:57 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-18f1014f-81f3-40dc-807b-14439b0a4c2d tempest-ProjectReaderTests-1450192889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-9f627d6d-7ac2-4970-b334-bc14901a3793 1073741824" returned: 0 in 0.885s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:06:57 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-18f1014f-81f3-40dc-807b-14439b0a4c2d tempest-ProjectReaderTests-1450192889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-9f627d6d-7ac2-4970-b334-bc14901a3793 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:06:57 devstack sudo[103602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-9f627d6d-7ac2-4970-b334-bc14901a3793 Jul 10 16:06:57 devstack sudo[103602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:06:57 devstack sudo[103597]: pam_unix(sudo:session): session closed for user root Jul 10 16:06:57 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-18c87841-08d1-4e0a-84bf-df0f497f5cb8 tempest-TestServerVolumeAttachmentScenario-1220265420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-e9f2242a-c99d-4b84-817f-8abda1033a0e" returned: 0 in 0.803s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:06:57 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-18c87841-08d1-4e0a-84bf-df0f497f5cb8 tempest-TestServerVolumeAttachmentScenario-1220265420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-e9f2242a-c99d-4b84-817f-8abda1033a0e {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:06:57 devstack sudo[103607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-e9f2242a-c99d-4b84-817f-8abda1033a0e Jul 10 16:06:57 devstack sudo[103607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:06:58 devstack sudo[103602]: pam_unix(sudo:session): session closed for user root Jul 10 16:06:58 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-18f1014f-81f3-40dc-807b-14439b0a4c2d tempest-ProjectReaderTests-1450192889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-9f627d6d-7ac2-4970-b334-bc14901a3793" returned: 0 in 0.683s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:06:58 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-18f1014f-81f3-40dc-807b-14439b0a4c2d tempest-ProjectReaderTests-1450192889 None] <== create_volume: return (1616ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 16:06:58 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-18f1014f-81f3-40dc-807b-14439b0a4c2d tempest-ProjectReaderTests-1450192889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.618s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:06:58 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-18f1014f-81f3-40dc-807b-14439b0a4c2d tempest-ProjectReaderTests-1450192889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faa0dc78-75b4-43b3-a478-b48fe5959b44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f627d6d-7ac2-4970-b334-bc14901a3793', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:06:58 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-18f1014f-81f3-40dc-807b-14439b0a4c2d tempest-ProjectReaderTests-1450192889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e736596-e7e6-4d8e-817f-ed1f7801aec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:06:58 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-18f1014f-81f3-40dc-807b-14439b0a4c2d tempest-ProjectReaderTests-1450192889 None] Volume volume-9f627d6d-7ac2-4970-b334-bc14901a3793 (9f627d6d-7ac2-4970-b334-bc14901a3793): created successfully Jul 10 16:06:58 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-18f1014f-81f3-40dc-807b-14439b0a4c2d tempest-ProjectReaderTests-1450192889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e736596-e7e6-4d8e-817f-ed1f7801aec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:06:58 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-18f1014f-81f3-40dc-807b-14439b0a4c2d tempest-ProjectReaderTests-1450192889 None] Flow 'volume_create_manager' (bacd080b-1533-4862-9d9a-c9ce8814e794) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:06:58 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-18f1014f-81f3-40dc-807b-14439b0a4c2d tempest-ProjectReaderTests-1450192889 None] Created volume successfully. Jul 10 16:06:58 devstack sudo[103607]: pam_unix(sudo:session): session closed for user root Jul 10 16:06:58 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-18c87841-08d1-4e0a-84bf-df0f497f5cb8 tempest-TestServerVolumeAttachmentScenario-1220265420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-e9f2242a-c99d-4b84-817f-8abda1033a0e" returned: 0 in 0.660s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:06:58 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-18c87841-08d1-4e0a-84bf-df0f497f5cb8 tempest-TestServerVolumeAttachmentScenario-1220265420 None] Lock "cinder-quobyte-e9f2242a-c99d-4b84-817f-8abda1033a0e" released by "delete_volume" :: held 1.505s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:06:58 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-18c87841-08d1-4e0a-84bf-df0f497f5cb8 tempest-TestServerVolumeAttachmentScenario-1220265420 None] Created reservations ['3519a14f-7fc2-42cc-98a7-8a6dc002798f', 'b16e5097-f669-46ca-a214-46ca6333974d', '94f42fa0-ba71-4686-89ea-6d566b0c8d69', '5ade0e96-1c52-45af-981a-1e06e926e7a2'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:06:58 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-18c87841-08d1-4e0a-84bf-df0f497f5cb8 tempest-TestServerVolumeAttachmentScenario-1220265420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:06:58 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-18c87841-08d1-4e0a-84bf-df0f497f5cb8 tempest-TestServerVolumeAttachmentScenario-1220265420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:06:58 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-18c87841-08d1-4e0a-84bf-df0f497f5cb8 tempest-TestServerVolumeAttachmentScenario-1220265420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:06:58 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-18c87841-08d1-4e0a-84bf-df0f497f5cb8 tempest-TestServerVolumeAttachmentScenario-1220265420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:06:58 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-18c87841-08d1-4e0a-84bf-df0f497f5cb8 tempest-TestServerVolumeAttachmentScenario-1220265420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:06:58 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-18c87841-08d1-4e0a-84bf-df0f497f5cb8 tempest-TestServerVolumeAttachmentScenario-1220265420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:06:58 devstack sudo[103611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:06:58 devstack sudo[103611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:06:58 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-a8cadc0d-b466-4a16-b6d0-3ac87657efc4 tempest-ProjectReaderTests-1450192889 None] Acquiring lock "cinder-9f627d6d-7ac2-4970-b334-bc14901a3793-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:06:58 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-a8cadc0d-b466-4a16-b6d0-3ac87657efc4 tempest-ProjectReaderTests-1450192889 None] Lock "cinder-9f627d6d-7ac2-4970-b334-bc14901a3793-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:06:58 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-a8cadc0d-b466-4a16-b6d0-3ac87657efc4 tempest-ProjectReaderTests-1450192889 None] Acquiring lock "cinder-quobyte-9f627d6d-7ac2-4970-b334-bc14901a3793" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:06:58 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-a8cadc0d-b466-4a16-b6d0-3ac87657efc4 tempest-ProjectReaderTests-1450192889 None] Lock "cinder-quobyte-9f627d6d-7ac2-4970-b334-bc14901a3793" acquired by "delete_volume" :: waited 0.015s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:06:58 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[d87a5ccd-0274-4e79-bc8c-b48b25ae9e9b]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:06:58 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a8cadc0d-b466-4a16-b6d0-3ac87657efc4 tempest-ProjectReaderTests-1450192889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-9f627d6d-7ac2-4970-b334-bc14901a3793 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:06:58 devstack sudo[103613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-9f627d6d-7ac2-4970-b334-bc14901a3793 Jul 10 16:06:58 devstack sudo[103613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:06:58 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-d50dea98-b315-4b58-9e46-354e1da4ee10 tempest-TestServerVolumeAttachmentScenario-1220265420 None] Acquiring lock "cinder-e8526896-b45f-4a0a-9868-72084cef4f10-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:06:59 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-d50dea98-b315-4b58-9e46-354e1da4ee10 tempest-TestServerVolumeAttachmentScenario-1220265420 None] Lock "cinder-e8526896-b45f-4a0a-9868-72084cef4f10-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:06:59 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-d50dea98-b315-4b58-9e46-354e1da4ee10 tempest-TestServerVolumeAttachmentScenario-1220265420 None] Acquiring lock "cinder-quobyte-e8526896-b45f-4a0a-9868-72084cef4f10" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:06:59 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-d50dea98-b315-4b58-9e46-354e1da4ee10 tempest-TestServerVolumeAttachmentScenario-1220265420 None] Lock "cinder-quobyte-e8526896-b45f-4a0a-9868-72084cef4f10" acquired by "delete_volume" :: waited 0.018s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:06:59 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e8a9630-4d6b-4dd9-9a21-cb31430e889e]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:06:59 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d50dea98-b315-4b58-9e46-354e1da4ee10 tempest-TestServerVolumeAttachmentScenario-1220265420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-e8526896-b45f-4a0a-9868-72084cef4f10 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:06:59 devstack sudo[103611]: pam_unix(sudo:session): session closed for user root Jul 10 16:06:59 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-18c87841-08d1-4e0a-84bf-df0f497f5cb8 tempest-TestServerVolumeAttachmentScenario-1220265420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.718s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:06:59 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-18c87841-08d1-4e0a-84bf-df0f497f5cb8 tempest-TestServerVolumeAttachmentScenario-1220265420 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:06:59 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-18c87841-08d1-4e0a-84bf-df0f497f5cb8 tempest-TestServerVolumeAttachmentScenario-1220265420 None] Deleted volume successfully. Jul 10 16:06:59 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-18c87841-08d1-4e0a-84bf-df0f497f5cb8 tempest-TestServerVolumeAttachmentScenario-1220265420 None] Lock "cinder-e9f2242a-c99d-4b84-817f-8abda1033a0e-delete_volume" released by "delete_volume" :: held 2.454s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:06:59 devstack sudo[103616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-e8526896-b45f-4a0a-9868-72084cef4f10 Jul 10 16:06:59 devstack sudo[103616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:06:59 devstack sudo[103613]: pam_unix(sudo:session): session closed for user root Jul 10 16:06:59 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a8cadc0d-b466-4a16-b6d0-3ac87657efc4 tempest-ProjectReaderTests-1450192889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-9f627d6d-7ac2-4970-b334-bc14901a3793" returned: 0 in 0.799s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:06:59 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a8cadc0d-b466-4a16-b6d0-3ac87657efc4 tempest-ProjectReaderTests-1450192889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-9f627d6d-7ac2-4970-b334-bc14901a3793 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:06:59 devstack sudo[103621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-9f627d6d-7ac2-4970-b334-bc14901a3793 Jul 10 16:06:59 devstack sudo[103621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:06:59 devstack sudo[103616]: pam_unix(sudo:session): session closed for user root Jul 10 16:06:59 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d50dea98-b315-4b58-9e46-354e1da4ee10 tempest-TestServerVolumeAttachmentScenario-1220265420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-e8526896-b45f-4a0a-9868-72084cef4f10" returned: 0 in 0.794s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:06:59 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d50dea98-b315-4b58-9e46-354e1da4ee10 tempest-TestServerVolumeAttachmentScenario-1220265420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-e8526896-b45f-4a0a-9868-72084cef4f10 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:06:59 devstack sudo[103626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-e8526896-b45f-4a0a-9868-72084cef4f10 Jul 10 16:06:59 devstack sudo[103626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:07:00 devstack sudo[103621]: pam_unix(sudo:session): session closed for user root Jul 10 16:07:00 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a8cadc0d-b466-4a16-b6d0-3ac87657efc4 tempest-ProjectReaderTests-1450192889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-9f627d6d-7ac2-4970-b334-bc14901a3793" returned: 0 in 0.631s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:07:00 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-a8cadc0d-b466-4a16-b6d0-3ac87657efc4 tempest-ProjectReaderTests-1450192889 None] Lock "cinder-quobyte-9f627d6d-7ac2-4970-b334-bc14901a3793" released by "delete_volume" :: held 1.492s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:07:00 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-a8cadc0d-b466-4a16-b6d0-3ac87657efc4 tempest-ProjectReaderTests-1450192889 None] Created reservations ['00ce163f-d0cf-4a3b-a056-42c46ddd16e8', 'b208172f-d87a-48ea-a488-0bf3baea73dd', '22fb399e-fe28-4592-89cf-3a8f9232648f', '5ba202f6-aae7-4569-a6fb-b6ed922d2002'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:07:00 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-a8cadc0d-b466-4a16-b6d0-3ac87657efc4 tempest-ProjectReaderTests-1450192889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:07:00 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-a8cadc0d-b466-4a16-b6d0-3ac87657efc4 tempest-ProjectReaderTests-1450192889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:07:00 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-a8cadc0d-b466-4a16-b6d0-3ac87657efc4 tempest-ProjectReaderTests-1450192889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:07:00 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-a8cadc0d-b466-4a16-b6d0-3ac87657efc4 tempest-ProjectReaderTests-1450192889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:07:00 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-a8cadc0d-b466-4a16-b6d0-3ac87657efc4 tempest-ProjectReaderTests-1450192889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:07:00 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a8cadc0d-b466-4a16-b6d0-3ac87657efc4 tempest-ProjectReaderTests-1450192889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:07:00 devstack sudo[103629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:07:00 devstack sudo[103629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:07:00 devstack sudo[103626]: pam_unix(sudo:session): session closed for user root Jul 10 16:07:00 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d50dea98-b315-4b58-9e46-354e1da4ee10 tempest-TestServerVolumeAttachmentScenario-1220265420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-e8526896-b45f-4a0a-9868-72084cef4f10" returned: 0 in 0.683s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:07:00 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-d50dea98-b315-4b58-9e46-354e1da4ee10 tempest-TestServerVolumeAttachmentScenario-1220265420 None] Lock "cinder-quobyte-e8526896-b45f-4a0a-9868-72084cef4f10" released by "delete_volume" :: held 1.516s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:07:00 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-d50dea98-b315-4b58-9e46-354e1da4ee10 tempest-TestServerVolumeAttachmentScenario-1220265420 None] Created reservations ['34b4a6da-1e8d-4f1f-9c33-578e2ef43360', 'ac06e393-1b14-4e42-b016-5120286ca588', '11164c69-67a7-4ecf-aa6c-18f53e1a24de', 'b3be37ae-7414-46ea-a524-b10915f81459'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:07:00 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-d50dea98-b315-4b58-9e46-354e1da4ee10 tempest-TestServerVolumeAttachmentScenario-1220265420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:07:00 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-d50dea98-b315-4b58-9e46-354e1da4ee10 tempest-TestServerVolumeAttachmentScenario-1220265420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:07:00 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-d50dea98-b315-4b58-9e46-354e1da4ee10 tempest-TestServerVolumeAttachmentScenario-1220265420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:07:00 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-d50dea98-b315-4b58-9e46-354e1da4ee10 tempest-TestServerVolumeAttachmentScenario-1220265420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:07:00 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-d50dea98-b315-4b58-9e46-354e1da4ee10 tempest-TestServerVolumeAttachmentScenario-1220265420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:07:00 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d50dea98-b315-4b58-9e46-354e1da4ee10 tempest-TestServerVolumeAttachmentScenario-1220265420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:07:00 devstack sudo[103632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:07:00 devstack sudo[103632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:07:00 devstack sudo[103629]: pam_unix(sudo:session): session closed for user root Jul 10 16:07:00 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a8cadc0d-b466-4a16-b6d0-3ac87657efc4 tempest-ProjectReaderTests-1450192889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.629s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:07:00 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-a8cadc0d-b466-4a16-b6d0-3ac87657efc4 tempest-ProjectReaderTests-1450192889 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:07:00 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-a8cadc0d-b466-4a16-b6d0-3ac87657efc4 tempest-ProjectReaderTests-1450192889 None] Deleted volume successfully. Jul 10 16:07:00 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-a8cadc0d-b466-4a16-b6d0-3ac87657efc4 tempest-ProjectReaderTests-1450192889 None] Lock "cinder-9f627d6d-7ac2-4970-b334-bc14901a3793-delete_volume" released by "delete_volume" :: held 2.307s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:07:01 devstack sudo[103632]: pam_unix(sudo:session): session closed for user root Jul 10 16:07:01 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d50dea98-b315-4b58-9e46-354e1da4ee10 tempest-TestServerVolumeAttachmentScenario-1220265420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.710s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:07:01 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-d50dea98-b315-4b58-9e46-354e1da4ee10 tempest-TestServerVolumeAttachmentScenario-1220265420 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:07:01 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-d50dea98-b315-4b58-9e46-354e1da4ee10 tempest-TestServerVolumeAttachmentScenario-1220265420 None] Deleted volume successfully. Jul 10 16:07:01 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-d50dea98-b315-4b58-9e46-354e1da4ee10 tempest-TestServerVolumeAttachmentScenario-1220265420 None] Lock "cinder-e8526896-b45f-4a0a-9868-72084cef4f10-delete_volume" released by "delete_volume" :: held 2.447s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:07:10 devstack cinder-volume[87420]: DEBUG dbcounter [-] [87420] Writing DB stats cinder:SELECT=71,cinder:UPDATE=72,cinder:INSERT=17,cinder:DELETE=3 {{(pid=87420) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 16:07:11 devstack cinder-volume[87420]: DEBUG dbcounter [-] [87420] Writing DB stats cinder:UPDATE=80,cinder:SELECT=57,cinder:INSERT=25,cinder:DELETE=9 {{(pid=87420) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 16:07:17 devstack cinder-volume[87420]: DEBUG oslo_service.periodic_task [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87420) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 16:07:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:07:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:07:17 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:07:17 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:07:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:07:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:07:17 devstack sudo[103646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:07:17 devstack sudo[103646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:07:18 devstack sudo[103646]: pam_unix(sudo:session): session closed for user root Jul 10 16:07:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.693s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:07:18 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:07:18 devstack cinder-volume[87420]: DEBUG oslo_service.periodic_task [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Running periodic task VolumeManager._thread_info {{(pid=87420) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 16:07:18 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] thread count: 29 {{(pid=87420) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 16:07:18 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] thread info: [<_MainThread(MainThread, started 133639250378880)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87420) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 16:07:34 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9c160d6-f652-413f-9150-c327076c4159 tempest-TestShelveInstance-786394365 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 16:07:34 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f9c160d6-f652-413f-9150-c327076c4159 tempest-TestShelveInstance-786394365 None] Flow 'volume_create_manager' (8b712bb6-e87d-4718-b4cb-d18c0ef58ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:07:34 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f9c160d6-f652-413f-9150-c327076c4159 tempest-TestShelveInstance-786394365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c7bf358-03ae-4806-9288-4abb1473e0db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:07:34 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f9c160d6-f652-413f-9150-c327076c4159 tempest-TestShelveInstance-786394365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c7bf358-03ae-4806-9288-4abb1473e0db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:07:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1029628138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=820833d3-dc8f-49f1-bc52-4c15c55374c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12e91d52133e4c86ad04b5bb0080d5cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:07:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:07:34Z,use_quota=True,user_id='a3ac421e17754c5f861f26bd909e7cf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:07:34 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f9c160d6-f652-413f-9150-c327076c4159 tempest-TestShelveInstance-786394365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (536a50b4-5b21-480b-878f-21b28a96afbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:07:34 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f9c160d6-f652-413f-9150-c327076c4159 tempest-TestShelveInstance-786394365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (536a50b4-5b21-480b-878f-21b28a96afbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:07:34 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f9c160d6-f652-413f-9150-c327076c4159 tempest-TestShelveInstance-786394365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48cd1819-76b2-4ec0-aedc-0038c11dcc3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:07:34 devstack cinder-volume[87420]: DEBUG cinder.image.glance [None req-f9c160d6-f652-413f-9150-c327076c4159 tempest-TestShelveInstance-786394365 None] Creating Keystone auth plugin from conf {{(pid=87420) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 10 16:07:34 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f9c160d6-f652-413f-9150-c327076c4159 tempest-TestShelveInstance-786394365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48cd1819-76b2-4ec0-aedc-0038c11dcc3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '820833d3-dc8f-49f1-bc52-4c15c55374c4', 'volume_name': 'volume-820833d3-dc8f-49f1-bc52-4c15c55374c4', 'volume_size': 1, 'image_id': '980bf5e0-e973-48f3-bc1f-383f924c4467', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/980bf5e0-e973-48f3-bc1f-383f924c4467', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'de9cf234f3774db489ed55d5afcfc7bf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '980bf5e0-e973-48f3-bc1f-383f924c4467', 'created_at': datetime.datetime(2026, 7, 10, 13, 42, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 13, 42, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/980bf5e0-e973-48f3-bc1f-383f924c4467/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:07:34 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f9c160d6-f652-413f-9150-c327076c4159 tempest-TestShelveInstance-786394365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86c5284c-3d25-4405-a743-d9991dbbab1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:07:34 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f9c160d6-f652-413f-9150-c327076c4159 tempest-TestShelveInstance-786394365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86c5284c-3d25-4405-a743-d9991dbbab1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:07:34 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f9c160d6-f652-413f-9150-c327076c4159 tempest-TestShelveInstance-786394365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cc3bbdd-f7e9-4b84-942f-866d52cadb32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:07:34 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-f9c160d6-f652-413f-9150-c327076c4159 tempest-TestShelveInstance-786394365 None] Volume 820833d3-dc8f-49f1-bc52-4c15c55374c4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-820833d3-dc8f-49f1-bc52-4c15c55374c4', 'volume_size': 1, 'image_id': '980bf5e0-e973-48f3-bc1f-383f924c4467', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/980bf5e0-e973-48f3-bc1f-383f924c4467', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'de9cf234f3774db489ed55d5afcfc7bf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '980bf5e0-e973-48f3-bc1f-383f924c4467', 'created_at': datetime.datetime(2026, 7, 10, 13, 42, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 13, 42, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/980bf5e0-e973-48f3-bc1f-383f924c4467/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 10 16:07:34 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9c160d6-f652-413f-9150-c327076c4159 tempest-TestShelveInstance-786394365 None] Trying to clone 820833d3-dc8f-49f1-bc52-4c15c55374c4 from image 980bf5e0-e973-48f3-bc1f-383f924c4467 at location (None, [{'url': 'file:///opt/stack/data/glance/images/980bf5e0-e973-48f3-bc1f-383f924c4467', 'metadata': {}}]). {{(pid=87420) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 10 16:07:34 devstack cinder-volume[87420]: DEBUG cinder.image.image_utils [None req-f9c160d6-f652-413f-9150-c327076c4159 tempest-TestShelveInstance-786394365 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_980bf5e0-e973-48f3-bc1f-383f924c4467_3dfrl30ddevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87420) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 10 16:07:34 devstack cinder-volume[87420]: INFO cinder.image.image_utils [None req-f9c160d6-f652-413f-9150-c327076c4159 tempest-TestShelveInstance-786394365 None] Image download 20.69 MB at 20.69 MB/s Jul 10 16:07:35 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[29c4ebe1-8641-44d3-8735-eb2f119b3f9a]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:07:35 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f9c160d6-f652-413f-9150-c327076c4159 tempest-TestShelveInstance-786394365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_980bf5e0-e973-48f3-bc1f-383f924c4467_3dfrl30ddevstack@QuobyteHD {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:07:35 devstack sudo[103655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_980bf5e0-e973-48f3-bc1f-383f924c4467_3dfrl30ddevstack@QuobyteHD Jul 10 16:07:35 devstack sudo[103655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:07:35 devstack sudo[103655]: pam_unix(sudo:session): session closed for user root Jul 10 16:07:35 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f9c160d6-f652-413f-9150-c327076c4159 tempest-TestShelveInstance-786394365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_980bf5e0-e973-48f3-bc1f-383f924c4467_3dfrl30ddevstack@QuobyteHD" returned: 0 in 0.748s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:07:35 devstack cinder-volume[87420]: DEBUG cinder.image.image_utils [None req-f9c160d6-f652-413f-9150-c327076c4159 tempest-TestShelveInstance-786394365 None] Temporary image 980bf5e0-e973-48f3-bc1f-383f924c4467 is fetched for user a3ac421e17754c5f861f26bd909e7cf0. {{(pid=87420) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 10 16:07:35 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ed3d516-b588-446c-88e9-42aeb63c7168]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:07:35 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f9c160d6-f652-413f-9150-c327076c4159 tempest-TestShelveInstance-786394365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_980bf5e0-e973-48f3-bc1f-383f924c4467_3dfrl30ddevstack@QuobyteHD {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:07:35 devstack sudo[103660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_980bf5e0-e973-48f3-bc1f-383f924c4467_3dfrl30ddevstack@QuobyteHD Jul 10 16:07:35 devstack sudo[103660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:07:36 devstack sudo[103660]: pam_unix(sudo:session): session closed for user root Jul 10 16:07:36 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f9c160d6-f652-413f-9150-c327076c4159 tempest-TestShelveInstance-786394365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_980bf5e0-e973-48f3-bc1f-383f924c4467_3dfrl30ddevstack@QuobyteHD" returned: 0 in 0.737s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:07:36 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-f9c160d6-f652-413f-9150-c327076c4159 tempest-TestShelveInstance-786394365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:07:36 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-f9c160d6-f652-413f-9150-c327076c4159 tempest-TestShelveInstance-786394365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:07:36 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-f9c160d6-f652-413f-9150-c327076c4159 tempest-TestShelveInstance-786394365 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:07:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1029628138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=820833d3-dc8f-49f1-bc52-4c15c55374c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12e91d52133e4c86ad04b5bb0080d5cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:07:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:07:34Z,use_quota=True,user_id='a3ac421e17754c5f861f26bd909e7cf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 16:07:36 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-f9c160d6-f652-413f-9150-c327076c4159 tempest-TestShelveInstance-786394365 None] Creating volume 820833d3-dc8f-49f1-bc52-4c15c55374c4 {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 16:07:36 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-f9c160d6-f652-413f-9150-c327076c4159 tempest-TestShelveInstance-786394365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:07:36 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-f9c160d6-f652-413f-9150-c327076c4159 tempest-TestShelveInstance-786394365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:07:36 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-f9c160d6-f652-413f-9150-c327076c4159 tempest-TestShelveInstance-786394365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:07:36 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-f9c160d6-f652-413f-9150-c327076c4159 tempest-TestShelveInstance-786394365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:07:36 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-f9c160d6-f652-413f-9150-c327076c4159 tempest-TestShelveInstance-786394365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:07:36 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-f9c160d6-f652-413f-9150-c327076c4159 tempest-TestShelveInstance-786394365 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 16:07:36 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-f9c160d6-f652-413f-9150-c327076c4159 tempest-TestShelveInstance-786394365 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 16:07:36 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f9c160d6-f652-413f-9150-c327076c4159 tempest-TestShelveInstance-786394365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-820833d3-dc8f-49f1-bc52-4c15c55374c4 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:07:36 devstack sudo[103665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-820833d3-dc8f-49f1-bc52-4c15c55374c4 1073741824 Jul 10 16:07:36 devstack sudo[103665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:07:37 devstack sudo[103665]: pam_unix(sudo:session): session closed for user root Jul 10 16:07:37 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f9c160d6-f652-413f-9150-c327076c4159 tempest-TestShelveInstance-786394365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-820833d3-dc8f-49f1-bc52-4c15c55374c4 1073741824" returned: 0 in 0.870s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:07:37 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f9c160d6-f652-413f-9150-c327076c4159 tempest-TestShelveInstance-786394365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-820833d3-dc8f-49f1-bc52-4c15c55374c4 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:07:37 devstack sudo[103707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-820833d3-dc8f-49f1-bc52-4c15c55374c4 Jul 10 16:07:37 devstack sudo[103707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:07:38 devstack sudo[103707]: pam_unix(sudo:session): session closed for user root Jul 10 16:07:38 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f9c160d6-f652-413f-9150-c327076c4159 tempest-TestShelveInstance-786394365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-820833d3-dc8f-49f1-bc52-4c15c55374c4" returned: 0 in 0.673s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:07:38 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-f9c160d6-f652-413f-9150-c327076c4159 tempest-TestShelveInstance-786394365 None] <== create_volume: return (1582ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 16:07:38 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-f9c160d6-f652-413f-9150-c327076c4159 tempest-TestShelveInstance-786394365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.585s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:07:38 devstack cinder-volume[87420]: DEBUG cinder.volume.volume_utils [None req-f9c160d6-f652-413f-9150-c327076c4159 tempest-TestShelveInstance-786394365 None] Attempting download of 980bf5e0-e973-48f3-bc1f-383f924c4467 ((None, [{'url': 'file:///opt/stack/data/glance/images/980bf5e0-e973-48f3-bc1f-383f924c4467', 'metadata': {}}])) to volume 820833d3-dc8f-49f1-bc52-4c15c55374c4. {{(pid=87420) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 10 16:07:38 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3a41697-5bf4-4e6c-93bc-7f1c5950c59b]: (4, 'raw') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:07:38 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f9c160d6-f652-413f-9150-c327076c4159 tempest-TestShelveInstance-786394365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_980bf5e0-e973-48f3-bc1f-383f924c4467_qehszo9g {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:07:38 devstack sudo[103710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_980bf5e0-e973-48f3-bc1f-383f924c4467_qehszo9g Jul 10 16:07:38 devstack sudo[103710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:07:38 devstack sudo[103710]: pam_unix(sudo:session): session closed for user root Jul 10 16:07:38 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f9c160d6-f652-413f-9150-c327076c4159 tempest-TestShelveInstance-786394365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_980bf5e0-e973-48f3-bc1f-383f924c4467_qehszo9g" returned: 0 in 0.760s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:07:38 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f9c160d6-f652-413f-9150-c327076c4159 tempest-TestShelveInstance-786394365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_980bf5e0-e973-48f3-bc1f-383f924c4467_qehszo9g {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:07:39 devstack sudo[103714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_980bf5e0-e973-48f3-bc1f-383f924c4467_qehszo9g Jul 10 16:07:39 devstack sudo[103714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:07:39 devstack sudo[103714]: pam_unix(sudo:session): session closed for user root Jul 10 16:07:39 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f9c160d6-f652-413f-9150-c327076c4159 tempest-TestShelveInstance-786394365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_980bf5e0-e973-48f3-bc1f-383f924c4467_qehszo9g" returned: 1 in 0.735s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:07:39 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f9c160d6-f652-413f-9150-c327076c4159 tempest-TestShelveInstance-786394365 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_980bf5e0-e973-48f3-bc1f-383f924c4467_qehszo9g' failed. Not Retrying. {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 16:07:39 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[174ece9c-d180-4df1-9a80-de95df5fae7f]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:07:39 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f9c160d6-f652-413f-9150-c327076c4159 tempest-TestShelveInstance-786394365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_980bf5e0-e973-48f3-bc1f-383f924c4467_3dfrl30ddevstack@QuobyteHD {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:07:39 devstack sudo[103718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_980bf5e0-e973-48f3-bc1f-383f924c4467_3dfrl30ddevstack@QuobyteHD Jul 10 16:07:39 devstack sudo[103718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:07:40 devstack sudo[103718]: pam_unix(sudo:session): session closed for user root Jul 10 16:07:40 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f9c160d6-f652-413f-9150-c327076c4159 tempest-TestShelveInstance-786394365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_980bf5e0-e973-48f3-bc1f-383f924c4467_3dfrl30ddevstack@QuobyteHD" returned: 0 in 0.741s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:07:40 devstack cinder-volume[87420]: DEBUG cinder.image.image_utils [None req-f9c160d6-f652-413f-9150-c327076c4159 tempest-TestShelveInstance-786394365 None] 980bf5e0-e973-48f3-bc1f-383f924c4467 was qcow2, converting to raw {{(pid=87420) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 10 16:07:40 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f9c160d6-f652-413f-9150-c327076c4159 tempest-TestShelveInstance-786394365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_980bf5e0-e973-48f3-bc1f-383f924c4467_3dfrl30ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-820833d3-dc8f-49f1-bc52-4c15c55374c4 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:07:40 devstack sudo[103723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_980bf5e0-e973-48f3-bc1f-383f924c4467_3dfrl30ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-820833d3-dc8f-49f1-bc52-4c15c55374c4 Jul 10 16:07:40 devstack sudo[103723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:07:42 devstack sudo[103723]: pam_unix(sudo:session): session closed for user root Jul 10 16:07:42 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f9c160d6-f652-413f-9150-c327076c4159 tempest-TestShelveInstance-786394365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_980bf5e0-e973-48f3-bc1f-383f924c4467_3dfrl30ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-820833d3-dc8f-49f1-bc52-4c15c55374c4" returned: 0 in 1.832s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:07:42 devstack cinder-volume[87420]: DEBUG cinder.image.image_utils [None req-f9c160d6-f652-413f-9150-c327076c4159 tempest-TestShelveInstance-786394365 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_980bf5e0-e973-48f3-bc1f-383f924c4467_3dfrl30ddevstack@QuobyteHD, size 112.00 MB, duration 1.83 sec, destination /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-820833d3-dc8f-49f1-bc52-4c15c55374c4 {{(pid=87420) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 16:07:42 devstack cinder-volume[87420]: INFO cinder.image.image_utils [None req-f9c160d6-f652-413f-9150-c327076c4159 tempest-TestShelveInstance-786394365 None] Converted 112.00 MB image at 61.08 MB/s Jul 10 16:07:42 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f9c160d6-f652-413f-9150-c327076c4159 tempest-TestShelveInstance-786394365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-820833d3-dc8f-49f1-bc52-4c15c55374c4 1G {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:07:42 devstack sudo[103732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-820833d3-dc8f-49f1-bc52-4c15c55374c4 1G Jul 10 16:07:42 devstack sudo[103732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:07:43 devstack sudo[103732]: pam_unix(sudo:session): session closed for user root Jul 10 16:07:43 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f9c160d6-f652-413f-9150-c327076c4159 tempest-TestShelveInstance-786394365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-820833d3-dc8f-49f1-bc52-4c15c55374c4 1G" returned: 0 in 0.703s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:07:43 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6957c55-841a-4905-9e5f-eb0705a3976a]: (4, 'raw') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:07:43 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f9c160d6-f652-413f-9150-c327076c4159 tempest-TestShelveInstance-786394365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-820833d3-dc8f-49f1-bc52-4c15c55374c4 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:07:43 devstack sudo[103737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-820833d3-dc8f-49f1-bc52-4c15c55374c4 Jul 10 16:07:43 devstack sudo[103737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:07:43 devstack sudo[103737]: pam_unix(sudo:session): session closed for user root Jul 10 16:07:43 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f9c160d6-f652-413f-9150-c327076c4159 tempest-TestShelveInstance-786394365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-820833d3-dc8f-49f1-bc52-4c15c55374c4" returned: 0 in 0.742s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:07:43 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f9c160d6-f652-413f-9150-c327076c4159 tempest-TestShelveInstance-786394365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-820833d3-dc8f-49f1-bc52-4c15c55374c4 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:07:43 devstack sudo[103742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-820833d3-dc8f-49f1-bc52-4c15c55374c4 Jul 10 16:07:43 devstack sudo[103742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:07:44 devstack sudo[103742]: pam_unix(sudo:session): session closed for user root Jul 10 16:07:44 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f9c160d6-f652-413f-9150-c327076c4159 tempest-TestShelveInstance-786394365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-820833d3-dc8f-49f1-bc52-4c15c55374c4" returned: 1 in 0.728s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:07:44 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f9c160d6-f652-413f-9150-c327076c4159 tempest-TestShelveInstance-786394365 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-820833d3-dc8f-49f1-bc52-4c15c55374c4' failed. Not Retrying. {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 16:07:44 devstack cinder-volume[87420]: DEBUG cinder.volume.volume_utils [None req-f9c160d6-f652-413f-9150-c327076c4159 tempest-TestShelveInstance-786394365 None] Downloaded image 980bf5e0-e973-48f3-bc1f-383f924c4467 ((None, [{'url': 'file:///opt/stack/data/glance/images/980bf5e0-e973-48f3-bc1f-383f924c4467', 'metadata': {}}])) to volume 820833d3-dc8f-49f1-bc52-4c15c55374c4 successfully. {{(pid=87420) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 10 16:07:44 devstack cinder-volume[87420]: DEBUG cinder.image.image_utils [None req-f9c160d6-f652-413f-9150-c327076c4159 tempest-TestShelveInstance-786394365 None] Temporary image 980bf5e0-e973-48f3-bc1f-383f924c4467 for user a3ac421e17754c5f861f26bd909e7cf0 is deleted. {{(pid=87420) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 10 16:07:44 devstack cinder-volume[87420]: DEBUG cinder.volume.volume_utils [None req-f9c160d6-f652-413f-9150-c327076c4159 tempest-TestShelveInstance-786394365 None] Marking volume 820833d3-dc8f-49f1-bc52-4c15c55374c4 as bootable. {{(pid=87420) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 10 16:07:44 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9c160d6-f652-413f-9150-c327076c4159 tempest-TestShelveInstance-786394365 None] Copying metadata from image 980bf5e0-e973-48f3-bc1f-383f924c4467 to 820833d3-dc8f-49f1-bc52-4c15c55374c4. {{(pid=87420) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 10 16:07:44 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9c160d6-f652-413f-9150-c327076c4159 tempest-TestShelveInstance-786394365 None] Creating volume glance metadata for volume 820833d3-dc8f-49f1-bc52-4c15c55374c4 backed by image 980bf5e0-e973-48f3-bc1f-383f924c4467 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '980bf5e0-e973-48f3-bc1f-383f924c4467', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87420) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 10 16:07:44 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f9c160d6-f652-413f-9150-c327076c4159 tempest-TestShelveInstance-786394365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cc3bbdd-f7e9-4b84-942f-866d52cadb32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-820833d3-dc8f-49f1-bc52-4c15c55374c4', 'volume_size': 1, 'image_id': '980bf5e0-e973-48f3-bc1f-383f924c4467', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/980bf5e0-e973-48f3-bc1f-383f924c4467', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'de9cf234f3774db489ed55d5afcfc7bf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '980bf5e0-e973-48f3-bc1f-383f924c4467', 'created_at': datetime.datetime(2026, 7, 10, 13, 42, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 13, 42, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/980bf5e0-e973-48f3-bc1f-383f924c4467/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:07:44 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f9c160d6-f652-413f-9150-c327076c4159 tempest-TestShelveInstance-786394365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64c1e702-9770-4844-9817-b0c9f8983ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:07:44 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-f9c160d6-f652-413f-9150-c327076c4159 tempest-TestShelveInstance-786394365 None] Volume volume-820833d3-dc8f-49f1-bc52-4c15c55374c4 (820833d3-dc8f-49f1-bc52-4c15c55374c4): created successfully Jul 10 16:07:44 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f9c160d6-f652-413f-9150-c327076c4159 tempest-TestShelveInstance-786394365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64c1e702-9770-4844-9817-b0c9f8983ce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:07:44 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f9c160d6-f652-413f-9150-c327076c4159 tempest-TestShelveInstance-786394365 None] Flow 'volume_create_manager' (8b712bb6-e87d-4718-b4cb-d18c0ef58ac1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:07:44 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-f9c160d6-f652-413f-9150-c327076c4159 tempest-TestShelveInstance-786394365 None] Created volume successfully. Jul 10 16:07:51 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [req-c0aa27f2-feb7-42ef-8e3e-7ad585cf9217 req-95033862-5229-44c5-8b4e-a5dd44fd7c39 tempest-TestShelveInstance-786394365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:07:51 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [req-c0aa27f2-feb7-42ef-8e3e-7ad585cf9217 req-95033862-5229-44c5-8b4e-a5dd44fd7c39 tempest-TestShelveInstance-786394365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:07:51 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[3020853f-cd7a-45cb-a004-29a73ae50978]: (4, 'raw') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:07:51 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [req-c0aa27f2-feb7-42ef-8e3e-7ad585cf9217 req-95033862-5229-44c5-8b4e-a5dd44fd7c39 tempest-TestShelveInstance-786394365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-820833d3-dc8f-49f1-bc52-4c15c55374c4 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:07:51 devstack sudo[103765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-820833d3-dc8f-49f1-bc52-4c15c55374c4 Jul 10 16:07:51 devstack sudo[103765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:07:52 devstack sudo[103765]: pam_unix(sudo:session): session closed for user root Jul 10 16:07:52 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [req-c0aa27f2-feb7-42ef-8e3e-7ad585cf9217 req-95033862-5229-44c5-8b4e-a5dd44fd7c39 tempest-TestShelveInstance-786394365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-820833d3-dc8f-49f1-bc52-4c15c55374c4" returned: 0 in 0.844s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:07:52 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [req-c0aa27f2-feb7-42ef-8e3e-7ad585cf9217 req-95033862-5229-44c5-8b4e-a5dd44fd7c39 tempest-TestShelveInstance-786394365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-820833d3-dc8f-49f1-bc52-4c15c55374c4 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:07:52 devstack sudo[103770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-820833d3-dc8f-49f1-bc52-4c15c55374c4 Jul 10 16:07:52 devstack sudo[103770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:07:53 devstack sudo[103770]: pam_unix(sudo:session): session closed for user root Jul 10 16:07:53 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [req-c0aa27f2-feb7-42ef-8e3e-7ad585cf9217 req-95033862-5229-44c5-8b4e-a5dd44fd7c39 tempest-TestShelveInstance-786394365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-820833d3-dc8f-49f1-bc52-4c15c55374c4" returned: 1 in 0.732s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:07:53 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [req-c0aa27f2-feb7-42ef-8e3e-7ad585cf9217 req-95033862-5229-44c5-8b4e-a5dd44fd7c39 tempest-TestShelveInstance-786394365 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-820833d3-dc8f-49f1-bc52-4c15c55374c4' failed. Not Retrying. {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 16:07:53 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [req-c0aa27f2-feb7-42ef-8e3e-7ad585cf9217 req-95033862-5229-44c5-8b4e-a5dd44fd7c39 tempest-TestShelveInstance-786394365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.615s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:07:53 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [req-c0aa27f2-feb7-42ef-8e3e-7ad585cf9217 req-95033862-5229-44c5-8b4e-a5dd44fd7c39 tempest-TestShelveInstance-786394365 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80', 'name': 'volume-820833d3-dc8f-49f1-bc52-4c15c55374c4', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ac898b5e-e233-45d0-95aa-d25c21c1c322', 'enforce_multipath': True} {{(pid=87420) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 16:07:53 devstack cinder-volume[87420]: INFO cinder.volume.manager [req-c0aa27f2-feb7-42ef-8e3e-7ad585cf9217 req-95033862-5229-44c5-8b4e-a5dd44fd7c39 tempest-TestShelveInstance-786394365 None] attachment_update completed successfully. Jul 10 16:08:03 devstack cinder-volume[87420]: DEBUG dbcounter [-] [87420] Writing DB stats cinder:UPDATE=8,cinder:SELECT=12,cinder:INSERT=6 {{(pid=87420) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 16:08:03 devstack cinder-volume[87420]: DEBUG dbcounter [-] [87420] Writing DB stats cinder:SELECT=18,cinder:INSERT=8,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=87420) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 16:08:17 devstack cinder-volume[87420]: DEBUG oslo_service.periodic_task [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87420) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 16:08:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:08:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:08:17 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:08:17 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:08:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:08:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:08:17 devstack sudo[104327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:08:17 devstack sudo[104327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:08:18 devstack sudo[104327]: pam_unix(sudo:session): session closed for user root Jul 10 16:08:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.647s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:08:18 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:08:18 devstack cinder-volume[87420]: DEBUG oslo_service.periodic_task [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Running periodic task VolumeManager._thread_info {{(pid=87420) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 16:08:18 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] thread count: 29 {{(pid=87420) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 16:08:18 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] thread info: [<_MainThread(MainThread, started 133639250378880)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87420) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 16:08:29 devstack cinder-volume[87420]: INFO cinder.volume.manager [req-10504280-e409-4f2b-b52c-d2d4b0918f30 req-ff71434e-e6e9-43db-b757-1a3073dde19b tempest-TestShelveInstance-786394365 None] Terminate volume connection completed successfully. Jul 10 16:08:29 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [req-10504280-e409-4f2b-b52c-d2d4b0918f30 req-ff71434e-e6e9-43db-b757-1a3073dde19b tempest-TestShelveInstance-786394365 None] Deleting attachment ac898b5e-e233-45d0-95aa-d25c21c1c322. {{(pid=87420) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 16:08:35 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [req-572dddd8-d2b9-4948-b601-815e770d3bb8 req-fa00c3d7-d706-4eea-a0ed-98de1aba3cbd tempest-TestShelveInstance-786394365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:08:35 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [req-572dddd8-d2b9-4948-b601-815e770d3bb8 req-fa00c3d7-d706-4eea-a0ed-98de1aba3cbd tempest-TestShelveInstance-786394365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:08:35 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[12642aca-83a0-4bf2-b4f8-4945b8eef31f]: (4, 'raw') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:08:35 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [req-572dddd8-d2b9-4948-b601-815e770d3bb8 req-fa00c3d7-d706-4eea-a0ed-98de1aba3cbd tempest-TestShelveInstance-786394365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-820833d3-dc8f-49f1-bc52-4c15c55374c4 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:08:35 devstack sudo[104379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-820833d3-dc8f-49f1-bc52-4c15c55374c4 Jul 10 16:08:35 devstack sudo[104379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:08:35 devstack sudo[104379]: pam_unix(sudo:session): session closed for user root Jul 10 16:08:35 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [req-572dddd8-d2b9-4948-b601-815e770d3bb8 req-fa00c3d7-d706-4eea-a0ed-98de1aba3cbd tempest-TestShelveInstance-786394365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-820833d3-dc8f-49f1-bc52-4c15c55374c4" returned: 0 in 0.746s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:08:35 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [req-572dddd8-d2b9-4948-b601-815e770d3bb8 req-fa00c3d7-d706-4eea-a0ed-98de1aba3cbd tempest-TestShelveInstance-786394365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-820833d3-dc8f-49f1-bc52-4c15c55374c4 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:08:36 devstack sudo[104383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-820833d3-dc8f-49f1-bc52-4c15c55374c4 Jul 10 16:08:36 devstack sudo[104383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:08:36 devstack sudo[104383]: pam_unix(sudo:session): session closed for user root Jul 10 16:08:36 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [req-572dddd8-d2b9-4948-b601-815e770d3bb8 req-fa00c3d7-d706-4eea-a0ed-98de1aba3cbd tempest-TestShelveInstance-786394365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-820833d3-dc8f-49f1-bc52-4c15c55374c4" returned: 1 in 0.730s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:08:36 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [req-572dddd8-d2b9-4948-b601-815e770d3bb8 req-fa00c3d7-d706-4eea-a0ed-98de1aba3cbd tempest-TestShelveInstance-786394365 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-820833d3-dc8f-49f1-bc52-4c15c55374c4' failed. Not Retrying. {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 16:08:36 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [req-572dddd8-d2b9-4948-b601-815e770d3bb8 req-fa00c3d7-d706-4eea-a0ed-98de1aba3cbd tempest-TestShelveInstance-786394365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.518s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:08:36 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [req-572dddd8-d2b9-4948-b601-815e770d3bb8 req-fa00c3d7-d706-4eea-a0ed-98de1aba3cbd tempest-TestShelveInstance-786394365 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80', 'name': 'volume-820833d3-dc8f-49f1-bc52-4c15c55374c4', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6de6bcfb-84a7-4916-93bd-9b11e75ec5fd', 'enforce_multipath': True} {{(pid=87420) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 16:08:36 devstack cinder-volume[87420]: INFO cinder.volume.manager [req-572dddd8-d2b9-4948-b601-815e770d3bb8 req-fa00c3d7-d706-4eea-a0ed-98de1aba3cbd tempest-TestShelveInstance-786394365 None] attachment_update completed successfully. Jul 10 16:08:46 devstack cinder-volume[87420]: DEBUG dbcounter [-] [87420] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=87420) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 16:08:46 devstack cinder-volume[87420]: DEBUG dbcounter [-] [87420] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=87420) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 16:09:04 devstack cinder-volume[87420]: DEBUG dbcounter [-] [87420] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=87420) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 16:09:16 devstack cinder-volume[87420]: INFO cinder.volume.manager [req-6d19f1e8-c954-4573-af6b-3fd8c6ca38c0 req-a3683791-a96b-4f1b-a8d2-86276bfa9370 tempest-TestShelveInstance-786394365 None] Terminate volume connection completed successfully. Jul 10 16:09:16 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [req-6d19f1e8-c954-4573-af6b-3fd8c6ca38c0 req-a3683791-a96b-4f1b-a8d2-86276bfa9370 tempest-TestShelveInstance-786394365 None] Deleting attachment 6de6bcfb-84a7-4916-93bd-9b11e75ec5fd. {{(pid=87420) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 16:09:17 devstack cinder-volume[87420]: DEBUG cinder.coordination [req-6d19f1e8-c954-4573-af6b-3fd8c6ca38c0 req-ac93a53d-d8f8-4db8-9c1d-12943486a189 tempest-TestShelveInstance-786394365 None] Acquiring lock "cinder-820833d3-dc8f-49f1-bc52-4c15c55374c4-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:09:17 devstack cinder-volume[87420]: DEBUG cinder.coordination [req-6d19f1e8-c954-4573-af6b-3fd8c6ca38c0 req-ac93a53d-d8f8-4db8-9c1d-12943486a189 tempest-TestShelveInstance-786394365 None] Lock "cinder-820833d3-dc8f-49f1-bc52-4c15c55374c4-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:09:17 devstack cinder-volume[87420]: DEBUG cinder.coordination [req-6d19f1e8-c954-4573-af6b-3fd8c6ca38c0 req-ac93a53d-d8f8-4db8-9c1d-12943486a189 tempest-TestShelveInstance-786394365 None] Acquiring lock "cinder-quobyte-820833d3-dc8f-49f1-bc52-4c15c55374c4" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:09:17 devstack cinder-volume[87420]: DEBUG cinder.coordination [req-6d19f1e8-c954-4573-af6b-3fd8c6ca38c0 req-ac93a53d-d8f8-4db8-9c1d-12943486a189 tempest-TestShelveInstance-786394365 None] Lock "cinder-quobyte-820833d3-dc8f-49f1-bc52-4c15c55374c4" acquired by "delete_volume" :: waited 0.013s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:09:17 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[af56fb19-d70f-454d-97ae-722177f4d4f7]: (4, 'raw') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:09:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [req-6d19f1e8-c954-4573-af6b-3fd8c6ca38c0 req-ac93a53d-d8f8-4db8-9c1d-12943486a189 tempest-TestShelveInstance-786394365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-820833d3-dc8f-49f1-bc52-4c15c55374c4 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:09:17 devstack sudo[104940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-820833d3-dc8f-49f1-bc52-4c15c55374c4 Jul 10 16:09:17 devstack sudo[104940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:09:17 devstack cinder-volume[87420]: DEBUG oslo_service.periodic_task [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87420) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 16:09:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:09:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:09:17 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:09:17 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:09:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:09:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:09:17 devstack sudo[104942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:09:17 devstack sudo[104942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:09:18 devstack sudo[104940]: pam_unix(sudo:session): session closed for user root Jul 10 16:09:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [req-6d19f1e8-c954-4573-af6b-3fd8c6ca38c0 req-ac93a53d-d8f8-4db8-9c1d-12943486a189 tempest-TestShelveInstance-786394365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-820833d3-dc8f-49f1-bc52-4c15c55374c4" returned: 0 in 0.795s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:09:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [req-6d19f1e8-c954-4573-af6b-3fd8c6ca38c0 req-ac93a53d-d8f8-4db8-9c1d-12943486a189 tempest-TestShelveInstance-786394365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-820833d3-dc8f-49f1-bc52-4c15c55374c4 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:09:18 devstack sudo[104942]: pam_unix(sudo:session): session closed for user root Jul 10 16:09:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.669s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:09:18 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:09:18 devstack cinder-volume[87420]: DEBUG oslo_service.periodic_task [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Running periodic task VolumeManager._thread_info {{(pid=87420) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 16:09:18 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] thread count: 29 {{(pid=87420) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 16:09:18 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] thread info: [<_MainThread(MainThread, started 133639250378880)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87420) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 16:09:18 devstack sudo[104947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-820833d3-dc8f-49f1-bc52-4c15c55374c4 Jul 10 16:09:18 devstack sudo[104947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:09:18 devstack sudo[104947]: pam_unix(sudo:session): session closed for user root Jul 10 16:09:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [req-6d19f1e8-c954-4573-af6b-3fd8c6ca38c0 req-ac93a53d-d8f8-4db8-9c1d-12943486a189 tempest-TestShelveInstance-786394365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-820833d3-dc8f-49f1-bc52-4c15c55374c4" returned: 1 in 0.761s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:09:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [req-6d19f1e8-c954-4573-af6b-3fd8c6ca38c0 req-ac93a53d-d8f8-4db8-9c1d-12943486a189 tempest-TestShelveInstance-786394365 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-820833d3-dc8f-49f1-bc52-4c15c55374c4' failed. Not Retrying. {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 16:09:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [req-6d19f1e8-c954-4573-af6b-3fd8c6ca38c0 req-ac93a53d-d8f8-4db8-9c1d-12943486a189 tempest-TestShelveInstance-786394365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-820833d3-dc8f-49f1-bc52-4c15c55374c4 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:09:18 devstack sudo[104952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-820833d3-dc8f-49f1-bc52-4c15c55374c4 Jul 10 16:09:18 devstack sudo[104952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:09:19 devstack sudo[104952]: pam_unix(sudo:session): session closed for user root Jul 10 16:09:19 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [req-6d19f1e8-c954-4573-af6b-3fd8c6ca38c0 req-ac93a53d-d8f8-4db8-9c1d-12943486a189 tempest-TestShelveInstance-786394365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-820833d3-dc8f-49f1-bc52-4c15c55374c4" returned: 0 in 0.645s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:09:19 devstack cinder-volume[87420]: DEBUG cinder.coordination [req-6d19f1e8-c954-4573-af6b-3fd8c6ca38c0 req-ac93a53d-d8f8-4db8-9c1d-12943486a189 tempest-TestShelveInstance-786394365 None] Lock "cinder-quobyte-820833d3-dc8f-49f1-bc52-4c15c55374c4" released by "delete_volume" :: held 2.266s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:09:19 devstack cinder-volume[87420]: DEBUG cinder.quota [req-6d19f1e8-c954-4573-af6b-3fd8c6ca38c0 req-ac93a53d-d8f8-4db8-9c1d-12943486a189 tempest-TestShelveInstance-786394365 None] Created reservations ['6090401f-4584-4093-b037-b55cad372e4a', 'a37036e3-a420-437c-8688-cf5948abfc51', 'a7d0973c-e1b3-4267-a731-ee904d5d83f1', '1cb6bd8e-a3fa-4cfa-b554-58d9e74e45d8'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:09:19 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [req-6d19f1e8-c954-4573-af6b-3fd8c6ca38c0 req-ac93a53d-d8f8-4db8-9c1d-12943486a189 tempest-TestShelveInstance-786394365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:09:19 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [req-6d19f1e8-c954-4573-af6b-3fd8c6ca38c0 req-ac93a53d-d8f8-4db8-9c1d-12943486a189 tempest-TestShelveInstance-786394365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:09:19 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [req-6d19f1e8-c954-4573-af6b-3fd8c6ca38c0 req-ac93a53d-d8f8-4db8-9c1d-12943486a189 tempest-TestShelveInstance-786394365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:09:19 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [req-6d19f1e8-c954-4573-af6b-3fd8c6ca38c0 req-ac93a53d-d8f8-4db8-9c1d-12943486a189 tempest-TestShelveInstance-786394365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:09:19 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [req-6d19f1e8-c954-4573-af6b-3fd8c6ca38c0 req-ac93a53d-d8f8-4db8-9c1d-12943486a189 tempest-TestShelveInstance-786394365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:09:19 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [req-6d19f1e8-c954-4573-af6b-3fd8c6ca38c0 req-ac93a53d-d8f8-4db8-9c1d-12943486a189 tempest-TestShelveInstance-786394365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:09:19 devstack sudo[104957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:09:19 devstack sudo[104957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:09:20 devstack sudo[104957]: pam_unix(sudo:session): session closed for user root Jul 10 16:09:20 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [req-6d19f1e8-c954-4573-af6b-3fd8c6ca38c0 req-ac93a53d-d8f8-4db8-9c1d-12943486a189 tempest-TestShelveInstance-786394365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.690s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:09:20 devstack cinder-volume[87420]: DEBUG cinder.manager [req-6d19f1e8-c954-4573-af6b-3fd8c6ca38c0 req-ac93a53d-d8f8-4db8-9c1d-12943486a189 tempest-TestShelveInstance-786394365 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:09:20 devstack cinder-volume[87420]: INFO cinder.volume.manager [req-6d19f1e8-c954-4573-af6b-3fd8c6ca38c0 req-ac93a53d-d8f8-4db8-9c1d-12943486a189 tempest-TestShelveInstance-786394365 None] Deleted volume successfully. Jul 10 16:09:20 devstack cinder-volume[87420]: DEBUG cinder.coordination [req-6d19f1e8-c954-4573-af6b-3fd8c6ca38c0 req-ac93a53d-d8f8-4db8-9c1d-12943486a189 tempest-TestShelveInstance-786394365 None] Lock "cinder-820833d3-dc8f-49f1-bc52-4c15c55374c4-delete_volume" released by "delete_volume" :: held 3.156s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:09:29 devstack cinder-volume[87420]: DEBUG dbcounter [-] [87420] Writing DB stats cinder:SELECT=5,cinder:INSERT=3,cinder:UPDATE=7 {{(pid=87420) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 16:09:30 devstack cinder-volume[87420]: DEBUG dbcounter [-] [87420] Writing DB stats cinder:SELECT=7,cinder:UPDATE=9,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87420) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 16:09:30 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-38abc393-5738-4026-8a75-48f8323d8576 tempest-CreateVolumesFromImageTest-24973270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 16:09:30 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-38abc393-5738-4026-8a75-48f8323d8576 tempest-CreateVolumesFromImageTest-24973270 None] Flow 'volume_create_manager' (c601fd4e-1f0d-45c7-a857-f0c21d920a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:09:30 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-38abc393-5738-4026-8a75-48f8323d8576 tempest-CreateVolumesFromImageTest-24973270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be62889d-3e9e-4283-be53-29550e9d8e79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:09:30 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-38abc393-5738-4026-8a75-48f8323d8576 tempest-CreateVolumesFromImageTest-24973270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be62889d-3e9e-4283-be53-29550e9d8e79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:09:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-267116064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a7d6c58-832f-4403-b303-f72e1c9aed7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb7f20ea2d3648b5a95471bfa65d3e40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:09:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:09:30Z,use_quota=True,user_id='0e2f0cb6c2974e6383bfb015ec54cf1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:09:30 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-38abc393-5738-4026-8a75-48f8323d8576 tempest-CreateVolumesFromImageTest-24973270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c90a8777-7400-428a-9879-905271509b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:09:30 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-38abc393-5738-4026-8a75-48f8323d8576 tempest-CreateVolumesFromImageTest-24973270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c90a8777-7400-428a-9879-905271509b65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:09:30 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-38abc393-5738-4026-8a75-48f8323d8576 tempest-CreateVolumesFromImageTest-24973270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a293c389-c141-455a-a22c-2cabbb7c6fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:09:30 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-38abc393-5738-4026-8a75-48f8323d8576 tempest-CreateVolumesFromImageTest-24973270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a293c389-c141-455a-a22c-2cabbb7c6fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a7d6c58-832f-4403-b303-f72e1c9aed7e', 'volume_name': 'volume-2a7d6c58-832f-4403-b303-f72e1c9aed7e', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:09:30 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-38abc393-5738-4026-8a75-48f8323d8576 tempest-CreateVolumesFromImageTest-24973270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eeb65712-4838-4010-8431-ff7cc013c89b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:09:30 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-38abc393-5738-4026-8a75-48f8323d8576 tempest-CreateVolumesFromImageTest-24973270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eeb65712-4838-4010-8431-ff7cc013c89b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:09:30 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-38abc393-5738-4026-8a75-48f8323d8576 tempest-CreateVolumesFromImageTest-24973270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed9d19ce-55f5-4e24-8eb9-c45378ea797f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:09:30 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-38abc393-5738-4026-8a75-48f8323d8576 tempest-CreateVolumesFromImageTest-24973270 None] Volume 2a7d6c58-832f-4403-b303-f72e1c9aed7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a7d6c58-832f-4403-b303-f72e1c9aed7e', 'volume_size': 1} Jul 10 16:09:30 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-38abc393-5738-4026-8a75-48f8323d8576 tempest-CreateVolumesFromImageTest-24973270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:09:30 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-38abc393-5738-4026-8a75-48f8323d8576 tempest-CreateVolumesFromImageTest-24973270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:09:30 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-38abc393-5738-4026-8a75-48f8323d8576 tempest-CreateVolumesFromImageTest-24973270 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:09:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-267116064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a7d6c58-832f-4403-b303-f72e1c9aed7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb7f20ea2d3648b5a95471bfa65d3e40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:09:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:09:30Z,use_quota=True,user_id='0e2f0cb6c2974e6383bfb015ec54cf1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 16:09:30 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-38abc393-5738-4026-8a75-48f8323d8576 tempest-CreateVolumesFromImageTest-24973270 None] Creating volume 2a7d6c58-832f-4403-b303-f72e1c9aed7e {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 16:09:30 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-38abc393-5738-4026-8a75-48f8323d8576 tempest-CreateVolumesFromImageTest-24973270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:09:30 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-38abc393-5738-4026-8a75-48f8323d8576 tempest-CreateVolumesFromImageTest-24973270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:09:30 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-38abc393-5738-4026-8a75-48f8323d8576 tempest-CreateVolumesFromImageTest-24973270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:09:30 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-38abc393-5738-4026-8a75-48f8323d8576 tempest-CreateVolumesFromImageTest-24973270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:09:30 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-38abc393-5738-4026-8a75-48f8323d8576 tempest-CreateVolumesFromImageTest-24973270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:09:30 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-38abc393-5738-4026-8a75-48f8323d8576 tempest-CreateVolumesFromImageTest-24973270 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 16:09:30 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-38abc393-5738-4026-8a75-48f8323d8576 tempest-CreateVolumesFromImageTest-24973270 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 16:09:30 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-38abc393-5738-4026-8a75-48f8323d8576 tempest-CreateVolumesFromImageTest-24973270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-2a7d6c58-832f-4403-b303-f72e1c9aed7e 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:09:30 devstack sudo[104969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-2a7d6c58-832f-4403-b303-f72e1c9aed7e 1073741824 Jul 10 16:09:30 devstack sudo[104969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:09:30 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-701603bd-b422-42fa-b46c-8273fbf8a790 tempest-CreateVolumesFromImageTest-24973270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 16:09:30 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-701603bd-b422-42fa-b46c-8273fbf8a790 tempest-CreateVolumesFromImageTest-24973270 None] Flow 'volume_create_manager' (f4cf3a92-0f90-4dbc-ad4b-d92657c9f190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:09:30 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-701603bd-b422-42fa-b46c-8273fbf8a790 tempest-CreateVolumesFromImageTest-24973270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f46df01b-263f-41d1-ad79-53d355bac4c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:09:30 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-701603bd-b422-42fa-b46c-8273fbf8a790 tempest-CreateVolumesFromImageTest-24973270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f46df01b-263f-41d1-ad79-53d355bac4c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:09:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-815689104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7092f26d-4f8c-4915-b02e-74dfdccd8f11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb7f20ea2d3648b5a95471bfa65d3e40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:09:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:09:31Z,use_quota=True,user_id='0e2f0cb6c2974e6383bfb015ec54cf1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:09:30 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-701603bd-b422-42fa-b46c-8273fbf8a790 tempest-CreateVolumesFromImageTest-24973270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b2986fe-703f-4eb1-97bc-94c38015f870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:09:30 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-701603bd-b422-42fa-b46c-8273fbf8a790 tempest-CreateVolumesFromImageTest-24973270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b2986fe-703f-4eb1-97bc-94c38015f870) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:09:30 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-701603bd-b422-42fa-b46c-8273fbf8a790 tempest-CreateVolumesFromImageTest-24973270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e72a5f6f-bf46-48b1-a4b6-4304944a7ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:09:30 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-701603bd-b422-42fa-b46c-8273fbf8a790 tempest-CreateVolumesFromImageTest-24973270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e72a5f6f-bf46-48b1-a4b6-4304944a7ae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7092f26d-4f8c-4915-b02e-74dfdccd8f11', 'volume_name': 'volume-7092f26d-4f8c-4915-b02e-74dfdccd8f11', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:09:30 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-701603bd-b422-42fa-b46c-8273fbf8a790 tempest-CreateVolumesFromImageTest-24973270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (311c6373-ee14-43e1-beb0-dbceb3891037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:09:30 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-701603bd-b422-42fa-b46c-8273fbf8a790 tempest-CreateVolumesFromImageTest-24973270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (311c6373-ee14-43e1-beb0-dbceb3891037) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:09:30 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-701603bd-b422-42fa-b46c-8273fbf8a790 tempest-CreateVolumesFromImageTest-24973270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b4390a2-21a6-42b3-a38a-d6058438d85a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:09:30 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-701603bd-b422-42fa-b46c-8273fbf8a790 tempest-CreateVolumesFromImageTest-24973270 None] Volume 7092f26d-4f8c-4915-b02e-74dfdccd8f11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7092f26d-4f8c-4915-b02e-74dfdccd8f11', 'volume_size': 1} Jul 10 16:09:30 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-701603bd-b422-42fa-b46c-8273fbf8a790 tempest-CreateVolumesFromImageTest-24973270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:09:31 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec03bfcf-cb3b-42f0-8b17-9195556f0beb tempest-CreateVolumesFromImageTest-24973270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 16:09:31 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ec03bfcf-cb3b-42f0-8b17-9195556f0beb tempest-CreateVolumesFromImageTest-24973270 None] Flow 'volume_create_manager' (fd7cbf8d-fd89-49dc-97df-ad574893ed75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:09:31 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ec03bfcf-cb3b-42f0-8b17-9195556f0beb tempest-CreateVolumesFromImageTest-24973270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88b53ff6-0163-49ce-b725-86ab4dbc614e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:09:31 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ec03bfcf-cb3b-42f0-8b17-9195556f0beb tempest-CreateVolumesFromImageTest-24973270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88b53ff6-0163-49ce-b725-86ab4dbc614e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:09:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1291539103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=967d3c81-8585-4a95-b6f2-e4932ca74919,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb7f20ea2d3648b5a95471bfa65d3e40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:09:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:09:31Z,use_quota=True,user_id='0e2f0cb6c2974e6383bfb015ec54cf1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:09:31 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ec03bfcf-cb3b-42f0-8b17-9195556f0beb tempest-CreateVolumesFromImageTest-24973270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (409cc873-2490-4114-9d89-154c432d5ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:09:31 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ec03bfcf-cb3b-42f0-8b17-9195556f0beb tempest-CreateVolumesFromImageTest-24973270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (409cc873-2490-4114-9d89-154c432d5ecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:09:31 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ec03bfcf-cb3b-42f0-8b17-9195556f0beb tempest-CreateVolumesFromImageTest-24973270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79d112c8-dc48-4f83-a5a6-67a96045adbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:09:31 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ec03bfcf-cb3b-42f0-8b17-9195556f0beb tempest-CreateVolumesFromImageTest-24973270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79d112c8-dc48-4f83-a5a6-67a96045adbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '967d3c81-8585-4a95-b6f2-e4932ca74919', 'volume_name': 'volume-967d3c81-8585-4a95-b6f2-e4932ca74919', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:09:31 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ec03bfcf-cb3b-42f0-8b17-9195556f0beb tempest-CreateVolumesFromImageTest-24973270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08f57cc5-6382-4ed0-ace8-bd0d112dfbfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:09:31 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ec03bfcf-cb3b-42f0-8b17-9195556f0beb tempest-CreateVolumesFromImageTest-24973270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08f57cc5-6382-4ed0-ace8-bd0d112dfbfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:09:31 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ec03bfcf-cb3b-42f0-8b17-9195556f0beb tempest-CreateVolumesFromImageTest-24973270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ae79b91-d3ca-443e-919a-7f2d0c18377f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:09:31 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-ec03bfcf-cb3b-42f0-8b17-9195556f0beb tempest-CreateVolumesFromImageTest-24973270 None] Volume 967d3c81-8585-4a95-b6f2-e4932ca74919: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-967d3c81-8585-4a95-b6f2-e4932ca74919', 'volume_size': 1} Jul 10 16:09:31 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-ec03bfcf-cb3b-42f0-8b17-9195556f0beb tempest-CreateVolumesFromImageTest-24973270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:09:31 devstack sudo[104969]: pam_unix(sudo:session): session closed for user root Jul 10 16:09:31 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-38abc393-5738-4026-8a75-48f8323d8576 tempest-CreateVolumesFromImageTest-24973270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-2a7d6c58-832f-4403-b303-f72e1c9aed7e 1073741824" returned: 0 in 0.885s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:09:31 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-38abc393-5738-4026-8a75-48f8323d8576 tempest-CreateVolumesFromImageTest-24973270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-2a7d6c58-832f-4403-b303-f72e1c9aed7e {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:09:31 devstack sudo[104975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-2a7d6c58-832f-4403-b303-f72e1c9aed7e Jul 10 16:09:31 devstack sudo[104975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:09:31 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8497e13-3660-4fa2-9d49-5b56c37a3417 tempest-CreateVolumesFromImageTest-24973270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 16:09:31 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-e8497e13-3660-4fa2-9d49-5b56c37a3417 tempest-CreateVolumesFromImageTest-24973270 None] Flow 'volume_create_manager' (189946c2-2a4b-4733-a8aa-484c57e5700a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:09:31 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-e8497e13-3660-4fa2-9d49-5b56c37a3417 tempest-CreateVolumesFromImageTest-24973270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb03b25b-e4b6-40b6-b136-56c06b6fe67c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:09:31 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-e8497e13-3660-4fa2-9d49-5b56c37a3417 tempest-CreateVolumesFromImageTest-24973270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb03b25b-e4b6-40b6-b136-56c06b6fe67c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:09:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-853627264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57b7e954-5aa3-40a7-8f70-a562c5433487,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb7f20ea2d3648b5a95471bfa65d3e40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:09:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:09:31Z,use_quota=True,user_id='0e2f0cb6c2974e6383bfb015ec54cf1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:09:31 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-e8497e13-3660-4fa2-9d49-5b56c37a3417 tempest-CreateVolumesFromImageTest-24973270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb2c9aa6-e2fa-4a53-b8e5-0853bd4a5e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:09:31 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-e8497e13-3660-4fa2-9d49-5b56c37a3417 tempest-CreateVolumesFromImageTest-24973270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb2c9aa6-e2fa-4a53-b8e5-0853bd4a5e35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:09:31 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-e8497e13-3660-4fa2-9d49-5b56c37a3417 tempest-CreateVolumesFromImageTest-24973270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ad109d5-b3a8-4301-a99a-b1226acd6e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:09:31 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-e8497e13-3660-4fa2-9d49-5b56c37a3417 tempest-CreateVolumesFromImageTest-24973270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ad109d5-b3a8-4301-a99a-b1226acd6e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57b7e954-5aa3-40a7-8f70-a562c5433487', 'volume_name': 'volume-57b7e954-5aa3-40a7-8f70-a562c5433487', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:09:31 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-e8497e13-3660-4fa2-9d49-5b56c37a3417 tempest-CreateVolumesFromImageTest-24973270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d968aef8-0e99-4046-9e6d-68652be8c7ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:09:31 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-e8497e13-3660-4fa2-9d49-5b56c37a3417 tempest-CreateVolumesFromImageTest-24973270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d968aef8-0e99-4046-9e6d-68652be8c7ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:09:31 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-e8497e13-3660-4fa2-9d49-5b56c37a3417 tempest-CreateVolumesFromImageTest-24973270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93df5c7d-2913-48cb-a398-ad6af44b09da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:09:31 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-e8497e13-3660-4fa2-9d49-5b56c37a3417 tempest-CreateVolumesFromImageTest-24973270 None] Volume 57b7e954-5aa3-40a7-8f70-a562c5433487: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57b7e954-5aa3-40a7-8f70-a562c5433487', 'volume_size': 1} Jul 10 16:09:31 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-e8497e13-3660-4fa2-9d49-5b56c37a3417 tempest-CreateVolumesFromImageTest-24973270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:09:31 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca4e8743-beaa-40b8-b465-57ab7478c601 tempest-CreateVolumesFromImageTest-24973270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 16:09:31 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ca4e8743-beaa-40b8-b465-57ab7478c601 tempest-CreateVolumesFromImageTest-24973270 None] Flow 'volume_create_manager' (5572ef0c-b803-4c4a-8c58-5adb0a7c2419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:09:31 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ca4e8743-beaa-40b8-b465-57ab7478c601 tempest-CreateVolumesFromImageTest-24973270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed121306-6e84-4dfa-853d-5cc39d6eb826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:09:31 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ca4e8743-beaa-40b8-b465-57ab7478c601 tempest-CreateVolumesFromImageTest-24973270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed121306-6e84-4dfa-853d-5cc39d6eb826) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:09:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-88607305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aeb66f30-6215-4c1b-82fe-89b5f11915ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb7f20ea2d3648b5a95471bfa65d3e40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:09:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:09:32Z,use_quota=True,user_id='0e2f0cb6c2974e6383bfb015ec54cf1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:09:31 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ca4e8743-beaa-40b8-b465-57ab7478c601 tempest-CreateVolumesFromImageTest-24973270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49a32c79-c808-4bbd-ad43-e511d4a77064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:09:31 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ca4e8743-beaa-40b8-b465-57ab7478c601 tempest-CreateVolumesFromImageTest-24973270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49a32c79-c808-4bbd-ad43-e511d4a77064) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:09:31 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ca4e8743-beaa-40b8-b465-57ab7478c601 tempest-CreateVolumesFromImageTest-24973270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce7777f0-2d67-4bb6-a480-b8b332184fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:09:31 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ca4e8743-beaa-40b8-b465-57ab7478c601 tempest-CreateVolumesFromImageTest-24973270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce7777f0-2d67-4bb6-a480-b8b332184fc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aeb66f30-6215-4c1b-82fe-89b5f11915ae', 'volume_name': 'volume-aeb66f30-6215-4c1b-82fe-89b5f11915ae', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:09:31 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ca4e8743-beaa-40b8-b465-57ab7478c601 tempest-CreateVolumesFromImageTest-24973270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1e1d0a4-ccbc-41b9-b654-50740b2034bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:09:31 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ca4e8743-beaa-40b8-b465-57ab7478c601 tempest-CreateVolumesFromImageTest-24973270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1e1d0a4-ccbc-41b9-b654-50740b2034bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:09:31 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ca4e8743-beaa-40b8-b465-57ab7478c601 tempest-CreateVolumesFromImageTest-24973270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (925e9ccd-f2da-4ee9-bdb6-863392711544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:09:31 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-ca4e8743-beaa-40b8-b465-57ab7478c601 tempest-CreateVolumesFromImageTest-24973270 None] Volume aeb66f30-6215-4c1b-82fe-89b5f11915ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aeb66f30-6215-4c1b-82fe-89b5f11915ae', 'volume_size': 1} Jul 10 16:09:31 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-ca4e8743-beaa-40b8-b465-57ab7478c601 tempest-CreateVolumesFromImageTest-24973270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:09:32 devstack sudo[104975]: pam_unix(sudo:session): session closed for user root Jul 10 16:09:32 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-38abc393-5738-4026-8a75-48f8323d8576 tempest-CreateVolumesFromImageTest-24973270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-2a7d6c58-832f-4403-b303-f72e1c9aed7e" returned: 0 in 0.698s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:09:32 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-38abc393-5738-4026-8a75-48f8323d8576 tempest-CreateVolumesFromImageTest-24973270 None] <== create_volume: return (1629ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 16:09:32 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-38abc393-5738-4026-8a75-48f8323d8576 tempest-CreateVolumesFromImageTest-24973270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.631s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:09:32 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-701603bd-b422-42fa-b46c-8273fbf8a790 tempest-CreateVolumesFromImageTest-24973270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.286s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:09:32 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-701603bd-b422-42fa-b46c-8273fbf8a790 tempest-CreateVolumesFromImageTest-24973270 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:09:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-815689104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7092f26d-4f8c-4915-b02e-74dfdccd8f11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb7f20ea2d3648b5a95471bfa65d3e40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:09:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:09:31Z,use_quota=True,user_id='0e2f0cb6c2974e6383bfb015ec54cf1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 16:09:32 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-701603bd-b422-42fa-b46c-8273fbf8a790 tempest-CreateVolumesFromImageTest-24973270 None] Creating volume 7092f26d-4f8c-4915-b02e-74dfdccd8f11 {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 16:09:32 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-701603bd-b422-42fa-b46c-8273fbf8a790 tempest-CreateVolumesFromImageTest-24973270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:09:32 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-701603bd-b422-42fa-b46c-8273fbf8a790 tempest-CreateVolumesFromImageTest-24973270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:09:32 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-701603bd-b422-42fa-b46c-8273fbf8a790 tempest-CreateVolumesFromImageTest-24973270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:09:32 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-701603bd-b422-42fa-b46c-8273fbf8a790 tempest-CreateVolumesFromImageTest-24973270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:09:32 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-701603bd-b422-42fa-b46c-8273fbf8a790 tempest-CreateVolumesFromImageTest-24973270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:09:32 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-701603bd-b422-42fa-b46c-8273fbf8a790 tempest-CreateVolumesFromImageTest-24973270 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 16:09:32 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-701603bd-b422-42fa-b46c-8273fbf8a790 tempest-CreateVolumesFromImageTest-24973270 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 16:09:32 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-701603bd-b422-42fa-b46c-8273fbf8a790 tempest-CreateVolumesFromImageTest-24973270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7092f26d-4f8c-4915-b02e-74dfdccd8f11 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:09:32 devstack sudo[104978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7092f26d-4f8c-4915-b02e-74dfdccd8f11 1073741824 Jul 10 16:09:32 devstack sudo[104978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:09:32 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-38abc393-5738-4026-8a75-48f8323d8576 tempest-CreateVolumesFromImageTest-24973270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed9d19ce-55f5-4e24-8eb9-c45378ea797f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a7d6c58-832f-4403-b303-f72e1c9aed7e', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:09:32 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-38abc393-5738-4026-8a75-48f8323d8576 tempest-CreateVolumesFromImageTest-24973270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8b0dc8b-8b07-4762-83fe-12a0f5350f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:09:32 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-38abc393-5738-4026-8a75-48f8323d8576 tempest-CreateVolumesFromImageTest-24973270 None] Volume volume-2a7d6c58-832f-4403-b303-f72e1c9aed7e (2a7d6c58-832f-4403-b303-f72e1c9aed7e): created successfully Jul 10 16:09:32 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-38abc393-5738-4026-8a75-48f8323d8576 tempest-CreateVolumesFromImageTest-24973270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8b0dc8b-8b07-4762-83fe-12a0f5350f87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:09:32 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-38abc393-5738-4026-8a75-48f8323d8576 tempest-CreateVolumesFromImageTest-24973270 None] Flow 'volume_create_manager' (c601fd4e-1f0d-45c7-a857-f0c21d920a18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:09:32 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-38abc393-5738-4026-8a75-48f8323d8576 tempest-CreateVolumesFromImageTest-24973270 None] Created volume successfully. Jul 10 16:09:32 devstack sudo[104978]: pam_unix(sudo:session): session closed for user root Jul 10 16:09:32 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-701603bd-b422-42fa-b46c-8273fbf8a790 tempest-CreateVolumesFromImageTest-24973270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7092f26d-4f8c-4915-b02e-74dfdccd8f11 1073741824" returned: 0 in 0.813s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:09:33 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-701603bd-b422-42fa-b46c-8273fbf8a790 tempest-CreateVolumesFromImageTest-24973270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7092f26d-4f8c-4915-b02e-74dfdccd8f11 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:09:33 devstack sudo[104984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7092f26d-4f8c-4915-b02e-74dfdccd8f11 Jul 10 16:09:33 devstack sudo[104984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:09:33 devstack sudo[104984]: pam_unix(sudo:session): session closed for user root Jul 10 16:09:33 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-701603bd-b422-42fa-b46c-8273fbf8a790 tempest-CreateVolumesFromImageTest-24973270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7092f26d-4f8c-4915-b02e-74dfdccd8f11" returned: 0 in 0.637s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:09:33 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-701603bd-b422-42fa-b46c-8273fbf8a790 tempest-CreateVolumesFromImageTest-24973270 None] <== create_volume: return (1490ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 16:09:33 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-701603bd-b422-42fa-b46c-8273fbf8a790 tempest-CreateVolumesFromImageTest-24973270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.493s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:09:33 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-ec03bfcf-cb3b-42f0-8b17-9195556f0beb tempest-CreateVolumesFromImageTest-24973270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.414s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:09:33 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-ec03bfcf-cb3b-42f0-8b17-9195556f0beb tempest-CreateVolumesFromImageTest-24973270 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:09:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1291539103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=967d3c81-8585-4a95-b6f2-e4932ca74919,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb7f20ea2d3648b5a95471bfa65d3e40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:09:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:09:31Z,use_quota=True,user_id='0e2f0cb6c2974e6383bfb015ec54cf1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 16:09:33 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-ec03bfcf-cb3b-42f0-8b17-9195556f0beb tempest-CreateVolumesFromImageTest-24973270 None] Creating volume 967d3c81-8585-4a95-b6f2-e4932ca74919 {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 16:09:33 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-ec03bfcf-cb3b-42f0-8b17-9195556f0beb tempest-CreateVolumesFromImageTest-24973270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:09:33 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-ec03bfcf-cb3b-42f0-8b17-9195556f0beb tempest-CreateVolumesFromImageTest-24973270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:09:33 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-ec03bfcf-cb3b-42f0-8b17-9195556f0beb tempest-CreateVolumesFromImageTest-24973270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:09:33 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-ec03bfcf-cb3b-42f0-8b17-9195556f0beb tempest-CreateVolumesFromImageTest-24973270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:09:33 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-ec03bfcf-cb3b-42f0-8b17-9195556f0beb tempest-CreateVolumesFromImageTest-24973270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:09:33 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-ec03bfcf-cb3b-42f0-8b17-9195556f0beb tempest-CreateVolumesFromImageTest-24973270 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 16:09:33 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-ec03bfcf-cb3b-42f0-8b17-9195556f0beb tempest-CreateVolumesFromImageTest-24973270 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 16:09:33 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ec03bfcf-cb3b-42f0-8b17-9195556f0beb tempest-CreateVolumesFromImageTest-24973270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-967d3c81-8585-4a95-b6f2-e4932ca74919 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:09:33 devstack sudo[104988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-967d3c81-8585-4a95-b6f2-e4932ca74919 1073741824 Jul 10 16:09:33 devstack sudo[104988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:09:33 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-701603bd-b422-42fa-b46c-8273fbf8a790 tempest-CreateVolumesFromImageTest-24973270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b4390a2-21a6-42b3-a38a-d6058438d85a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7092f26d-4f8c-4915-b02e-74dfdccd8f11', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:09:33 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-701603bd-b422-42fa-b46c-8273fbf8a790 tempest-CreateVolumesFromImageTest-24973270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5125e48-6878-4735-a3ad-eab9edd8eb96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:09:33 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-701603bd-b422-42fa-b46c-8273fbf8a790 tempest-CreateVolumesFromImageTest-24973270 None] Volume volume-7092f26d-4f8c-4915-b02e-74dfdccd8f11 (7092f26d-4f8c-4915-b02e-74dfdccd8f11): created successfully Jul 10 16:09:33 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-701603bd-b422-42fa-b46c-8273fbf8a790 tempest-CreateVolumesFromImageTest-24973270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5125e48-6878-4735-a3ad-eab9edd8eb96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:09:33 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-701603bd-b422-42fa-b46c-8273fbf8a790 tempest-CreateVolumesFromImageTest-24973270 None] Flow 'volume_create_manager' (f4cf3a92-0f90-4dbc-ad4b-d92657c9f190) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:09:33 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-701603bd-b422-42fa-b46c-8273fbf8a790 tempest-CreateVolumesFromImageTest-24973270 None] Created volume successfully. Jul 10 16:09:34 devstack sudo[104988]: pam_unix(sudo:session): session closed for user root Jul 10 16:09:34 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ec03bfcf-cb3b-42f0-8b17-9195556f0beb tempest-CreateVolumesFromImageTest-24973270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-967d3c81-8585-4a95-b6f2-e4932ca74919 1073741824" returned: 0 in 0.814s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:09:34 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ec03bfcf-cb3b-42f0-8b17-9195556f0beb tempest-CreateVolumesFromImageTest-24973270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-967d3c81-8585-4a95-b6f2-e4932ca74919 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:09:34 devstack sudo[104994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-967d3c81-8585-4a95-b6f2-e4932ca74919 Jul 10 16:09:34 devstack sudo[104994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:09:35 devstack sudo[104994]: pam_unix(sudo:session): session closed for user root Jul 10 16:09:35 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ec03bfcf-cb3b-42f0-8b17-9195556f0beb tempest-CreateVolumesFromImageTest-24973270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-967d3c81-8585-4a95-b6f2-e4932ca74919" returned: 0 in 0.630s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:09:35 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-ec03bfcf-cb3b-42f0-8b17-9195556f0beb tempest-CreateVolumesFromImageTest-24973270 None] <== create_volume: return (1482ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 16:09:35 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-ec03bfcf-cb3b-42f0-8b17-9195556f0beb tempest-CreateVolumesFromImageTest-24973270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.484s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:09:35 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-e8497e13-3660-4fa2-9d49-5b56c37a3417 tempest-CreateVolumesFromImageTest-24973270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.521s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:09:35 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-e8497e13-3660-4fa2-9d49-5b56c37a3417 tempest-CreateVolumesFromImageTest-24973270 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:09:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-853627264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57b7e954-5aa3-40a7-8f70-a562c5433487,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb7f20ea2d3648b5a95471bfa65d3e40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:09:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:09:31Z,use_quota=True,user_id='0e2f0cb6c2974e6383bfb015ec54cf1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 16:09:35 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-e8497e13-3660-4fa2-9d49-5b56c37a3417 tempest-CreateVolumesFromImageTest-24973270 None] Creating volume 57b7e954-5aa3-40a7-8f70-a562c5433487 {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 16:09:35 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-e8497e13-3660-4fa2-9d49-5b56c37a3417 tempest-CreateVolumesFromImageTest-24973270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:09:35 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-e8497e13-3660-4fa2-9d49-5b56c37a3417 tempest-CreateVolumesFromImageTest-24973270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:09:35 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-e8497e13-3660-4fa2-9d49-5b56c37a3417 tempest-CreateVolumesFromImageTest-24973270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:09:35 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-e8497e13-3660-4fa2-9d49-5b56c37a3417 tempest-CreateVolumesFromImageTest-24973270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:09:35 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-e8497e13-3660-4fa2-9d49-5b56c37a3417 tempest-CreateVolumesFromImageTest-24973270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:09:35 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-e8497e13-3660-4fa2-9d49-5b56c37a3417 tempest-CreateVolumesFromImageTest-24973270 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 16:09:35 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-e8497e13-3660-4fa2-9d49-5b56c37a3417 tempest-CreateVolumesFromImageTest-24973270 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 16:09:35 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-e8497e13-3660-4fa2-9d49-5b56c37a3417 tempest-CreateVolumesFromImageTest-24973270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-57b7e954-5aa3-40a7-8f70-a562c5433487 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:09:35 devstack sudo[104997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-57b7e954-5aa3-40a7-8f70-a562c5433487 1073741824 Jul 10 16:09:35 devstack sudo[104997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:09:35 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ec03bfcf-cb3b-42f0-8b17-9195556f0beb tempest-CreateVolumesFromImageTest-24973270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ae79b91-d3ca-443e-919a-7f2d0c18377f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-967d3c81-8585-4a95-b6f2-e4932ca74919', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:09:35 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ec03bfcf-cb3b-42f0-8b17-9195556f0beb tempest-CreateVolumesFromImageTest-24973270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c822055b-61d3-4cf1-a0b5-38b723b1e844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:09:35 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-ec03bfcf-cb3b-42f0-8b17-9195556f0beb tempest-CreateVolumesFromImageTest-24973270 None] Volume volume-967d3c81-8585-4a95-b6f2-e4932ca74919 (967d3c81-8585-4a95-b6f2-e4932ca74919): created successfully Jul 10 16:09:35 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ec03bfcf-cb3b-42f0-8b17-9195556f0beb tempest-CreateVolumesFromImageTest-24973270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c822055b-61d3-4cf1-a0b5-38b723b1e844) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:09:35 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ec03bfcf-cb3b-42f0-8b17-9195556f0beb tempest-CreateVolumesFromImageTest-24973270 None] Flow 'volume_create_manager' (fd7cbf8d-fd89-49dc-97df-ad574893ed75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:09:35 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-ec03bfcf-cb3b-42f0-8b17-9195556f0beb tempest-CreateVolumesFromImageTest-24973270 None] Created volume successfully. Jul 10 16:09:35 devstack sudo[104997]: pam_unix(sudo:session): session closed for user root Jul 10 16:09:35 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-e8497e13-3660-4fa2-9d49-5b56c37a3417 tempest-CreateVolumesFromImageTest-24973270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-57b7e954-5aa3-40a7-8f70-a562c5433487 1073741824" returned: 0 in 0.793s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:09:35 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-e8497e13-3660-4fa2-9d49-5b56c37a3417 tempest-CreateVolumesFromImageTest-24973270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-57b7e954-5aa3-40a7-8f70-a562c5433487 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:09:35 devstack sudo[105003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-57b7e954-5aa3-40a7-8f70-a562c5433487 Jul 10 16:09:35 devstack sudo[105003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:09:36 devstack sudo[105003]: pam_unix(sudo:session): session closed for user root Jul 10 16:09:36 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-e8497e13-3660-4fa2-9d49-5b56c37a3417 tempest-CreateVolumesFromImageTest-24973270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-57b7e954-5aa3-40a7-8f70-a562c5433487" returned: 0 in 0.641s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:09:36 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-e8497e13-3660-4fa2-9d49-5b56c37a3417 tempest-CreateVolumesFromImageTest-24973270 None] <== create_volume: return (1471ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 16:09:36 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-e8497e13-3660-4fa2-9d49-5b56c37a3417 tempest-CreateVolumesFromImageTest-24973270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.474s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:09:36 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-ca4e8743-beaa-40b8-b465-57ab7478c601 tempest-CreateVolumesFromImageTest-24973270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.665s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:09:36 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-ca4e8743-beaa-40b8-b465-57ab7478c601 tempest-CreateVolumesFromImageTest-24973270 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:09:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-88607305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aeb66f30-6215-4c1b-82fe-89b5f11915ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb7f20ea2d3648b5a95471bfa65d3e40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:09:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:09:32Z,use_quota=True,user_id='0e2f0cb6c2974e6383bfb015ec54cf1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 16:09:36 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-ca4e8743-beaa-40b8-b465-57ab7478c601 tempest-CreateVolumesFromImageTest-24973270 None] Creating volume aeb66f30-6215-4c1b-82fe-89b5f11915ae {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 16:09:36 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-ca4e8743-beaa-40b8-b465-57ab7478c601 tempest-CreateVolumesFromImageTest-24973270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:09:36 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-ca4e8743-beaa-40b8-b465-57ab7478c601 tempest-CreateVolumesFromImageTest-24973270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:09:36 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-ca4e8743-beaa-40b8-b465-57ab7478c601 tempest-CreateVolumesFromImageTest-24973270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:09:36 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-ca4e8743-beaa-40b8-b465-57ab7478c601 tempest-CreateVolumesFromImageTest-24973270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:09:36 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-ca4e8743-beaa-40b8-b465-57ab7478c601 tempest-CreateVolumesFromImageTest-24973270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:09:36 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-ca4e8743-beaa-40b8-b465-57ab7478c601 tempest-CreateVolumesFromImageTest-24973270 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 16:09:36 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-ca4e8743-beaa-40b8-b465-57ab7478c601 tempest-CreateVolumesFromImageTest-24973270 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 16:09:36 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ca4e8743-beaa-40b8-b465-57ab7478c601 tempest-CreateVolumesFromImageTest-24973270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-aeb66f30-6215-4c1b-82fe-89b5f11915ae 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:09:36 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-e8497e13-3660-4fa2-9d49-5b56c37a3417 tempest-CreateVolumesFromImageTest-24973270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93df5c7d-2913-48cb-a398-ad6af44b09da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57b7e954-5aa3-40a7-8f70-a562c5433487', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:09:36 devstack sudo[105006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-aeb66f30-6215-4c1b-82fe-89b5f11915ae 1073741824 Jul 10 16:09:36 devstack sudo[105006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:09:36 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-e8497e13-3660-4fa2-9d49-5b56c37a3417 tempest-CreateVolumesFromImageTest-24973270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe63103b-1b3b-4a94-af84-36a9d19c5026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:09:36 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-e8497e13-3660-4fa2-9d49-5b56c37a3417 tempest-CreateVolumesFromImageTest-24973270 None] Volume volume-57b7e954-5aa3-40a7-8f70-a562c5433487 (57b7e954-5aa3-40a7-8f70-a562c5433487): created successfully Jul 10 16:09:36 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-e8497e13-3660-4fa2-9d49-5b56c37a3417 tempest-CreateVolumesFromImageTest-24973270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe63103b-1b3b-4a94-af84-36a9d19c5026) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:09:36 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-e8497e13-3660-4fa2-9d49-5b56c37a3417 tempest-CreateVolumesFromImageTest-24973270 None] Flow 'volume_create_manager' (189946c2-2a4b-4733-a8aa-484c57e5700a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:09:36 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-e8497e13-3660-4fa2-9d49-5b56c37a3417 tempest-CreateVolumesFromImageTest-24973270 None] Created volume successfully. Jul 10 16:09:37 devstack sudo[105006]: pam_unix(sudo:session): session closed for user root Jul 10 16:09:37 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ca4e8743-beaa-40b8-b465-57ab7478c601 tempest-CreateVolumesFromImageTest-24973270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-aeb66f30-6215-4c1b-82fe-89b5f11915ae 1073741824" returned: 0 in 0.812s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:09:37 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ca4e8743-beaa-40b8-b465-57ab7478c601 tempest-CreateVolumesFromImageTest-24973270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-aeb66f30-6215-4c1b-82fe-89b5f11915ae {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:09:37 devstack sudo[105012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-aeb66f30-6215-4c1b-82fe-89b5f11915ae Jul 10 16:09:37 devstack sudo[105012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:09:38 devstack sudo[105012]: pam_unix(sudo:session): session closed for user root Jul 10 16:09:38 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ca4e8743-beaa-40b8-b465-57ab7478c601 tempest-CreateVolumesFromImageTest-24973270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-aeb66f30-6215-4c1b-82fe-89b5f11915ae" returned: 0 in 0.638s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:09:38 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-ca4e8743-beaa-40b8-b465-57ab7478c601 tempest-CreateVolumesFromImageTest-24973270 None] <== create_volume: return (1490ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 16:09:38 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-ca4e8743-beaa-40b8-b465-57ab7478c601 tempest-CreateVolumesFromImageTest-24973270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.493s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:09:38 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ca4e8743-beaa-40b8-b465-57ab7478c601 tempest-CreateVolumesFromImageTest-24973270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (925e9ccd-f2da-4ee9-bdb6-863392711544) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aeb66f30-6215-4c1b-82fe-89b5f11915ae', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:09:38 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ca4e8743-beaa-40b8-b465-57ab7478c601 tempest-CreateVolumesFromImageTest-24973270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3fab96b-a633-4c23-aec6-d39e8e671331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:09:38 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-ca4e8743-beaa-40b8-b465-57ab7478c601 tempest-CreateVolumesFromImageTest-24973270 None] Volume volume-aeb66f30-6215-4c1b-82fe-89b5f11915ae (aeb66f30-6215-4c1b-82fe-89b5f11915ae): created successfully Jul 10 16:09:38 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ca4e8743-beaa-40b8-b465-57ab7478c601 tempest-CreateVolumesFromImageTest-24973270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3fab96b-a633-4c23-aec6-d39e8e671331) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:09:38 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ca4e8743-beaa-40b8-b465-57ab7478c601 tempest-CreateVolumesFromImageTest-24973270 None] Flow 'volume_create_manager' (5572ef0c-b803-4c4a-8c58-5adb0a7c2419) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:09:38 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-ca4e8743-beaa-40b8-b465-57ab7478c601 tempest-CreateVolumesFromImageTest-24973270 None] Created volume successfully. Jul 10 16:09:38 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-5e25f222-c3d1-4424-ba6a-e7c866c89b7e tempest-CreateVolumesFromImageTest-24973270 None] Acquiring lock "cinder-aeb66f30-6215-4c1b-82fe-89b5f11915ae-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:09:38 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-5e25f222-c3d1-4424-ba6a-e7c866c89b7e tempest-CreateVolumesFromImageTest-24973270 None] Lock "cinder-aeb66f30-6215-4c1b-82fe-89b5f11915ae-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:09:38 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-5e25f222-c3d1-4424-ba6a-e7c866c89b7e tempest-CreateVolumesFromImageTest-24973270 None] Acquiring lock "cinder-quobyte-aeb66f30-6215-4c1b-82fe-89b5f11915ae" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:09:38 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-5e25f222-c3d1-4424-ba6a-e7c866c89b7e tempest-CreateVolumesFromImageTest-24973270 None] Lock "cinder-quobyte-aeb66f30-6215-4c1b-82fe-89b5f11915ae" acquired by "delete_volume" :: waited 0.015s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:09:38 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a46802c-b19e-45f6-992c-80d9fe473dca]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:09:38 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-5e25f222-c3d1-4424-ba6a-e7c866c89b7e tempest-CreateVolumesFromImageTest-24973270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-aeb66f30-6215-4c1b-82fe-89b5f11915ae {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:09:38 devstack sudo[105051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-aeb66f30-6215-4c1b-82fe-89b5f11915ae Jul 10 16:09:38 devstack sudo[105051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:09:39 devstack sudo[105051]: pam_unix(sudo:session): session closed for user root Jul 10 16:09:39 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-5e25f222-c3d1-4424-ba6a-e7c866c89b7e tempest-CreateVolumesFromImageTest-24973270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-aeb66f30-6215-4c1b-82fe-89b5f11915ae" returned: 0 in 0.762s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:09:39 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-5e25f222-c3d1-4424-ba6a-e7c866c89b7e tempest-CreateVolumesFromImageTest-24973270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-aeb66f30-6215-4c1b-82fe-89b5f11915ae {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:09:39 devstack sudo[105056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-aeb66f30-6215-4c1b-82fe-89b5f11915ae Jul 10 16:09:39 devstack sudo[105056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:09:39 devstack sudo[105056]: pam_unix(sudo:session): session closed for user root Jul 10 16:09:39 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-5e25f222-c3d1-4424-ba6a-e7c866c89b7e tempest-CreateVolumesFromImageTest-24973270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-aeb66f30-6215-4c1b-82fe-89b5f11915ae" returned: 0 in 0.650s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:09:39 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-5e25f222-c3d1-4424-ba6a-e7c866c89b7e tempest-CreateVolumesFromImageTest-24973270 None] Lock "cinder-quobyte-aeb66f30-6215-4c1b-82fe-89b5f11915ae" released by "delete_volume" :: held 1.449s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:09:39 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-5e25f222-c3d1-4424-ba6a-e7c866c89b7e tempest-CreateVolumesFromImageTest-24973270 None] Created reservations ['cd69f96c-8d70-4c62-a9c7-77431dfd16fd', 'd2aa3576-833a-48c1-891e-31d8dfc6f1dd', '811536ff-a50e-41a2-ae7f-c814bb3081e1', 'a5341b35-16f7-4866-99a7-101b1d48d340'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:09:40 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-5e25f222-c3d1-4424-ba6a-e7c866c89b7e tempest-CreateVolumesFromImageTest-24973270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:09:40 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-5e25f222-c3d1-4424-ba6a-e7c866c89b7e tempest-CreateVolumesFromImageTest-24973270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:09:40 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-5e25f222-c3d1-4424-ba6a-e7c866c89b7e tempest-CreateVolumesFromImageTest-24973270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:09:40 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-5e25f222-c3d1-4424-ba6a-e7c866c89b7e tempest-CreateVolumesFromImageTest-24973270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:09:40 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-5e25f222-c3d1-4424-ba6a-e7c866c89b7e tempest-CreateVolumesFromImageTest-24973270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:09:40 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-5e25f222-c3d1-4424-ba6a-e7c866c89b7e tempest-CreateVolumesFromImageTest-24973270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:09:40 devstack sudo[105059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:09:40 devstack sudo[105059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:09:40 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-703c3304-fd67-4c49-a996-c5a35e44ad96 tempest-CreateVolumesFromImageTest-24973270 None] Acquiring lock "cinder-57b7e954-5aa3-40a7-8f70-a562c5433487-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:09:40 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-703c3304-fd67-4c49-a996-c5a35e44ad96 tempest-CreateVolumesFromImageTest-24973270 None] Lock "cinder-57b7e954-5aa3-40a7-8f70-a562c5433487-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:09:40 devstack sudo[105059]: pam_unix(sudo:session): session closed for user root Jul 10 16:09:40 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-5e25f222-c3d1-4424-ba6a-e7c866c89b7e tempest-CreateVolumesFromImageTest-24973270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.634s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:09:40 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-5e25f222-c3d1-4424-ba6a-e7c866c89b7e tempest-CreateVolumesFromImageTest-24973270 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:09:40 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-703c3304-fd67-4c49-a996-c5a35e44ad96 tempest-CreateVolumesFromImageTest-24973270 None] Acquiring lock "cinder-quobyte-57b7e954-5aa3-40a7-8f70-a562c5433487" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:09:40 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-5e25f222-c3d1-4424-ba6a-e7c866c89b7e tempest-CreateVolumesFromImageTest-24973270 None] Deleted volume successfully. Jul 10 16:09:40 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-703c3304-fd67-4c49-a996-c5a35e44ad96 tempest-CreateVolumesFromImageTest-24973270 None] Lock "cinder-quobyte-57b7e954-5aa3-40a7-8f70-a562c5433487" acquired by "delete_volume" :: waited 0.016s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:09:40 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-5e25f222-c3d1-4424-ba6a-e7c866c89b7e tempest-CreateVolumesFromImageTest-24973270 None] Lock "cinder-aeb66f30-6215-4c1b-82fe-89b5f11915ae-delete_volume" released by "delete_volume" :: held 2.296s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:09:40 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[2da2db5f-d5f8-4893-98de-8cb51665f3ea]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:09:40 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-703c3304-fd67-4c49-a996-c5a35e44ad96 tempest-CreateVolumesFromImageTest-24973270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-57b7e954-5aa3-40a7-8f70-a562c5433487 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:09:40 devstack sudo[105062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-57b7e954-5aa3-40a7-8f70-a562c5433487 Jul 10 16:09:40 devstack sudo[105062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:09:41 devstack sudo[105062]: pam_unix(sudo:session): session closed for user root Jul 10 16:09:41 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-703c3304-fd67-4c49-a996-c5a35e44ad96 tempest-CreateVolumesFromImageTest-24973270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-57b7e954-5aa3-40a7-8f70-a562c5433487" returned: 0 in 0.741s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:09:41 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-703c3304-fd67-4c49-a996-c5a35e44ad96 tempest-CreateVolumesFromImageTest-24973270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-57b7e954-5aa3-40a7-8f70-a562c5433487 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:09:41 devstack sudo[105067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-57b7e954-5aa3-40a7-8f70-a562c5433487 Jul 10 16:09:41 devstack sudo[105067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:09:42 devstack sudo[105067]: pam_unix(sudo:session): session closed for user root Jul 10 16:09:42 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-703c3304-fd67-4c49-a996-c5a35e44ad96 tempest-CreateVolumesFromImageTest-24973270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-57b7e954-5aa3-40a7-8f70-a562c5433487" returned: 0 in 0.654s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:09:42 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-703c3304-fd67-4c49-a996-c5a35e44ad96 tempest-CreateVolumesFromImageTest-24973270 None] Lock "cinder-quobyte-57b7e954-5aa3-40a7-8f70-a562c5433487" released by "delete_volume" :: held 1.439s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:09:42 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-703c3304-fd67-4c49-a996-c5a35e44ad96 tempest-CreateVolumesFromImageTest-24973270 None] Created reservations ['c02d15e3-a220-43e0-9f08-e9b7e2243f19', '3f3bca24-b8f0-434e-91b6-766bff049054', '405fc0fa-4c95-4c6c-80e9-585ddb86e736', '72e8427d-39cb-4294-871e-071f369b3180'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:09:42 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-703c3304-fd67-4c49-a996-c5a35e44ad96 tempest-CreateVolumesFromImageTest-24973270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:09:42 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-703c3304-fd67-4c49-a996-c5a35e44ad96 tempest-CreateVolumesFromImageTest-24973270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:09:42 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-703c3304-fd67-4c49-a996-c5a35e44ad96 tempest-CreateVolumesFromImageTest-24973270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:09:42 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-703c3304-fd67-4c49-a996-c5a35e44ad96 tempest-CreateVolumesFromImageTest-24973270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:09:42 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-703c3304-fd67-4c49-a996-c5a35e44ad96 tempest-CreateVolumesFromImageTest-24973270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:09:42 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-703c3304-fd67-4c49-a996-c5a35e44ad96 tempest-CreateVolumesFromImageTest-24973270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:09:42 devstack sudo[105070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:09:42 devstack sudo[105070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:09:42 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-0ea1f3ff-6daa-49a9-8410-d64c9f5740ff tempest-CreateVolumesFromImageTest-24973270 None] Acquiring lock "cinder-967d3c81-8585-4a95-b6f2-e4932ca74919-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:09:42 devstack sudo[105070]: pam_unix(sudo:session): session closed for user root Jul 10 16:09:42 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-703c3304-fd67-4c49-a996-c5a35e44ad96 tempest-CreateVolumesFromImageTest-24973270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.650s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:09:42 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-703c3304-fd67-4c49-a996-c5a35e44ad96 tempest-CreateVolumesFromImageTest-24973270 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:09:42 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-0ea1f3ff-6daa-49a9-8410-d64c9f5740ff tempest-CreateVolumesFromImageTest-24973270 None] Lock "cinder-967d3c81-8585-4a95-b6f2-e4932ca74919-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:09:42 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-703c3304-fd67-4c49-a996-c5a35e44ad96 tempest-CreateVolumesFromImageTest-24973270 None] Deleted volume successfully. Jul 10 16:09:42 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-703c3304-fd67-4c49-a996-c5a35e44ad96 tempest-CreateVolumesFromImageTest-24973270 None] Lock "cinder-57b7e954-5aa3-40a7-8f70-a562c5433487-delete_volume" released by "delete_volume" :: held 2.291s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:09:42 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-0ea1f3ff-6daa-49a9-8410-d64c9f5740ff tempest-CreateVolumesFromImageTest-24973270 None] Acquiring lock "cinder-quobyte-967d3c81-8585-4a95-b6f2-e4932ca74919" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:09:42 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-0ea1f3ff-6daa-49a9-8410-d64c9f5740ff tempest-CreateVolumesFromImageTest-24973270 None] Lock "cinder-quobyte-967d3c81-8585-4a95-b6f2-e4932ca74919" acquired by "delete_volume" :: waited 0.016s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:09:42 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dfecfed-b446-4a23-a594-efa317d0aa88]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:09:42 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-0ea1f3ff-6daa-49a9-8410-d64c9f5740ff tempest-CreateVolumesFromImageTest-24973270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-967d3c81-8585-4a95-b6f2-e4932ca74919 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:09:43 devstack sudo[105073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-967d3c81-8585-4a95-b6f2-e4932ca74919 Jul 10 16:09:43 devstack sudo[105073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:09:43 devstack sudo[105073]: pam_unix(sudo:session): session closed for user root Jul 10 16:09:43 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-0ea1f3ff-6daa-49a9-8410-d64c9f5740ff tempest-CreateVolumesFromImageTest-24973270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-967d3c81-8585-4a95-b6f2-e4932ca74919" returned: 0 in 0.754s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:09:43 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-0ea1f3ff-6daa-49a9-8410-d64c9f5740ff tempest-CreateVolumesFromImageTest-24973270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-967d3c81-8585-4a95-b6f2-e4932ca74919 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:09:43 devstack sudo[105079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-967d3c81-8585-4a95-b6f2-e4932ca74919 Jul 10 16:09:43 devstack sudo[105079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:09:44 devstack sudo[105079]: pam_unix(sudo:session): session closed for user root Jul 10 16:09:44 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-0ea1f3ff-6daa-49a9-8410-d64c9f5740ff tempest-CreateVolumesFromImageTest-24973270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-967d3c81-8585-4a95-b6f2-e4932ca74919" returned: 0 in 0.639s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:09:44 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-0ea1f3ff-6daa-49a9-8410-d64c9f5740ff tempest-CreateVolumesFromImageTest-24973270 None] Lock "cinder-quobyte-967d3c81-8585-4a95-b6f2-e4932ca74919" released by "delete_volume" :: held 1.433s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:09:44 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-0ea1f3ff-6daa-49a9-8410-d64c9f5740ff tempest-CreateVolumesFromImageTest-24973270 None] Created reservations ['931d8a4a-651d-4632-bf52-2e04e537d01f', 'bd1ccb0a-7275-489e-8976-b2d0fbeb1db7', 'a83d5679-946e-43c5-8269-0e9bee9359b3', '6906e2f0-2cfd-416d-a1a9-8dfb65f1234c'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:09:44 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-0ea1f3ff-6daa-49a9-8410-d64c9f5740ff tempest-CreateVolumesFromImageTest-24973270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:09:44 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-0ea1f3ff-6daa-49a9-8410-d64c9f5740ff tempest-CreateVolumesFromImageTest-24973270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:09:44 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-0ea1f3ff-6daa-49a9-8410-d64c9f5740ff tempest-CreateVolumesFromImageTest-24973270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:09:44 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-0ea1f3ff-6daa-49a9-8410-d64c9f5740ff tempest-CreateVolumesFromImageTest-24973270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:09:44 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-0ea1f3ff-6daa-49a9-8410-d64c9f5740ff tempest-CreateVolumesFromImageTest-24973270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:09:44 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-0ea1f3ff-6daa-49a9-8410-d64c9f5740ff tempest-CreateVolumesFromImageTest-24973270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:09:44 devstack sudo[105082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:09:44 devstack sudo[105082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:09:45 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-b34560f9-04f8-4a9d-b0e9-2ef805814dd9 tempest-CreateVolumesFromImageTest-24973270 None] Acquiring lock "cinder-7092f26d-4f8c-4915-b02e-74dfdccd8f11-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:09:45 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-b34560f9-04f8-4a9d-b0e9-2ef805814dd9 tempest-CreateVolumesFromImageTest-24973270 None] Lock "cinder-7092f26d-4f8c-4915-b02e-74dfdccd8f11-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:09:45 devstack sudo[105082]: pam_unix(sudo:session): session closed for user root Jul 10 16:09:45 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-0ea1f3ff-6daa-49a9-8410-d64c9f5740ff tempest-CreateVolumesFromImageTest-24973270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.657s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:09:45 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-0ea1f3ff-6daa-49a9-8410-d64c9f5740ff tempest-CreateVolumesFromImageTest-24973270 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:09:45 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-0ea1f3ff-6daa-49a9-8410-d64c9f5740ff tempest-CreateVolumesFromImageTest-24973270 None] Deleted volume successfully. Jul 10 16:09:45 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-b34560f9-04f8-4a9d-b0e9-2ef805814dd9 tempest-CreateVolumesFromImageTest-24973270 None] Acquiring lock "cinder-quobyte-7092f26d-4f8c-4915-b02e-74dfdccd8f11" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:09:45 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-0ea1f3ff-6daa-49a9-8410-d64c9f5740ff tempest-CreateVolumesFromImageTest-24973270 None] Lock "cinder-967d3c81-8585-4a95-b6f2-e4932ca74919-delete_volume" released by "delete_volume" :: held 2.304s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:09:45 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-b34560f9-04f8-4a9d-b0e9-2ef805814dd9 tempest-CreateVolumesFromImageTest-24973270 None] Lock "cinder-quobyte-7092f26d-4f8c-4915-b02e-74dfdccd8f11" acquired by "delete_volume" :: waited 0.016s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:09:45 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[b525b3c9-78c5-4f58-aa2f-696f59e9f074]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:09:45 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-b34560f9-04f8-4a9d-b0e9-2ef805814dd9 tempest-CreateVolumesFromImageTest-24973270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7092f26d-4f8c-4915-b02e-74dfdccd8f11 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:09:45 devstack sudo[105085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7092f26d-4f8c-4915-b02e-74dfdccd8f11 Jul 10 16:09:45 devstack sudo[105085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:09:45 devstack sudo[105085]: pam_unix(sudo:session): session closed for user root Jul 10 16:09:45 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-b34560f9-04f8-4a9d-b0e9-2ef805814dd9 tempest-CreateVolumesFromImageTest-24973270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7092f26d-4f8c-4915-b02e-74dfdccd8f11" returned: 0 in 0.761s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:09:45 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-b34560f9-04f8-4a9d-b0e9-2ef805814dd9 tempest-CreateVolumesFromImageTest-24973270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7092f26d-4f8c-4915-b02e-74dfdccd8f11 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:09:46 devstack sudo[105096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7092f26d-4f8c-4915-b02e-74dfdccd8f11 Jul 10 16:09:46 devstack sudo[105096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:09:46 devstack sudo[105096]: pam_unix(sudo:session): session closed for user root Jul 10 16:09:46 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-b34560f9-04f8-4a9d-b0e9-2ef805814dd9 tempest-CreateVolumesFromImageTest-24973270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7092f26d-4f8c-4915-b02e-74dfdccd8f11" returned: 0 in 0.634s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:09:46 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-b34560f9-04f8-4a9d-b0e9-2ef805814dd9 tempest-CreateVolumesFromImageTest-24973270 None] Lock "cinder-quobyte-7092f26d-4f8c-4915-b02e-74dfdccd8f11" released by "delete_volume" :: held 1.432s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:09:46 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-b34560f9-04f8-4a9d-b0e9-2ef805814dd9 tempest-CreateVolumesFromImageTest-24973270 None] Created reservations ['b30a0f7a-6f2a-4a4d-9588-b3f0754bc28e', 'fc65e563-e772-437e-8b74-baf92f71a627', '9423cf3a-30bf-4f16-99c9-0dd90e24ea5c', 'f8836e2f-d8f1-4a7c-b1c2-308053ec8512'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:09:46 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-b34560f9-04f8-4a9d-b0e9-2ef805814dd9 tempest-CreateVolumesFromImageTest-24973270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:09:46 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-b34560f9-04f8-4a9d-b0e9-2ef805814dd9 tempest-CreateVolumesFromImageTest-24973270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:09:46 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-b34560f9-04f8-4a9d-b0e9-2ef805814dd9 tempest-CreateVolumesFromImageTest-24973270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:09:46 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-b34560f9-04f8-4a9d-b0e9-2ef805814dd9 tempest-CreateVolumesFromImageTest-24973270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:09:46 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-b34560f9-04f8-4a9d-b0e9-2ef805814dd9 tempest-CreateVolumesFromImageTest-24973270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:09:46 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-b34560f9-04f8-4a9d-b0e9-2ef805814dd9 tempest-CreateVolumesFromImageTest-24973270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:09:46 devstack sudo[105099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:09:46 devstack sudo[105099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:09:47 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-3996fe08-7827-47fc-9ca5-9a1af3d96f65 tempest-CreateVolumesFromImageTest-24973270 None] Acquiring lock "cinder-2a7d6c58-832f-4403-b303-f72e1c9aed7e-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:09:47 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-3996fe08-7827-47fc-9ca5-9a1af3d96f65 tempest-CreateVolumesFromImageTest-24973270 None] Lock "cinder-2a7d6c58-832f-4403-b303-f72e1c9aed7e-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:09:47 devstack sudo[105099]: pam_unix(sudo:session): session closed for user root Jul 10 16:09:47 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-3996fe08-7827-47fc-9ca5-9a1af3d96f65 tempest-CreateVolumesFromImageTest-24973270 None] Acquiring lock "cinder-quobyte-2a7d6c58-832f-4403-b303-f72e1c9aed7e" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:09:47 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-b34560f9-04f8-4a9d-b0e9-2ef805814dd9 tempest-CreateVolumesFromImageTest-24973270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.643s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:09:47 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-b34560f9-04f8-4a9d-b0e9-2ef805814dd9 tempest-CreateVolumesFromImageTest-24973270 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:09:47 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-b34560f9-04f8-4a9d-b0e9-2ef805814dd9 tempest-CreateVolumesFromImageTest-24973270 None] Deleted volume successfully. Jul 10 16:09:47 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-3996fe08-7827-47fc-9ca5-9a1af3d96f65 tempest-CreateVolumesFromImageTest-24973270 None] Lock "cinder-quobyte-2a7d6c58-832f-4403-b303-f72e1c9aed7e" acquired by "delete_volume" :: waited 0.030s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:09:47 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-b34560f9-04f8-4a9d-b0e9-2ef805814dd9 tempest-CreateVolumesFromImageTest-24973270 None] Lock "cinder-7092f26d-4f8c-4915-b02e-74dfdccd8f11-delete_volume" released by "delete_volume" :: held 2.305s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:09:47 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[7003c5bd-f1ea-44ac-9652-910e94a8b084]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:09:47 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-3996fe08-7827-47fc-9ca5-9a1af3d96f65 tempest-CreateVolumesFromImageTest-24973270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-2a7d6c58-832f-4403-b303-f72e1c9aed7e {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:09:47 devstack sudo[105102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-2a7d6c58-832f-4403-b303-f72e1c9aed7e Jul 10 16:09:47 devstack sudo[105102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:09:48 devstack sudo[105102]: pam_unix(sudo:session): session closed for user root Jul 10 16:09:48 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-3996fe08-7827-47fc-9ca5-9a1af3d96f65 tempest-CreateVolumesFromImageTest-24973270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-2a7d6c58-832f-4403-b303-f72e1c9aed7e" returned: 0 in 0.739s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:09:48 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-3996fe08-7827-47fc-9ca5-9a1af3d96f65 tempest-CreateVolumesFromImageTest-24973270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-2a7d6c58-832f-4403-b303-f72e1c9aed7e {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:09:48 devstack sudo[105107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-2a7d6c58-832f-4403-b303-f72e1c9aed7e Jul 10 16:09:48 devstack sudo[105107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:09:48 devstack sudo[105107]: pam_unix(sudo:session): session closed for user root Jul 10 16:09:48 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-3996fe08-7827-47fc-9ca5-9a1af3d96f65 tempest-CreateVolumesFromImageTest-24973270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-2a7d6c58-832f-4403-b303-f72e1c9aed7e" returned: 0 in 0.669s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:09:48 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-3996fe08-7827-47fc-9ca5-9a1af3d96f65 tempest-CreateVolumesFromImageTest-24973270 None] Lock "cinder-quobyte-2a7d6c58-832f-4403-b303-f72e1c9aed7e" released by "delete_volume" :: held 1.453s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:09:48 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-3996fe08-7827-47fc-9ca5-9a1af3d96f65 tempest-CreateVolumesFromImageTest-24973270 None] Created reservations ['0616337b-27dd-4b1f-b020-53533645b614', '1c646134-977a-442f-9bd8-500eb160b40b', '7a581376-6c8f-4133-964a-667680846724', '0740f80e-2bb4-4b79-a11d-a8aec0757836'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:09:48 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-3996fe08-7827-47fc-9ca5-9a1af3d96f65 tempest-CreateVolumesFromImageTest-24973270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:09:48 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-3996fe08-7827-47fc-9ca5-9a1af3d96f65 tempest-CreateVolumesFromImageTest-24973270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:09:48 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-3996fe08-7827-47fc-9ca5-9a1af3d96f65 tempest-CreateVolumesFromImageTest-24973270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:09:48 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-3996fe08-7827-47fc-9ca5-9a1af3d96f65 tempest-CreateVolumesFromImageTest-24973270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:09:48 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-3996fe08-7827-47fc-9ca5-9a1af3d96f65 tempest-CreateVolumesFromImageTest-24973270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:09:48 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-3996fe08-7827-47fc-9ca5-9a1af3d96f65 tempest-CreateVolumesFromImageTest-24973270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:09:48 devstack sudo[105110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:09:48 devstack sudo[105110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:09:49 devstack sudo[105110]: pam_unix(sudo:session): session closed for user root Jul 10 16:09:49 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-3996fe08-7827-47fc-9ca5-9a1af3d96f65 tempest-CreateVolumesFromImageTest-24973270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.639s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:09:49 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-3996fe08-7827-47fc-9ca5-9a1af3d96f65 tempest-CreateVolumesFromImageTest-24973270 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:09:49 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-3996fe08-7827-47fc-9ca5-9a1af3d96f65 tempest-CreateVolumesFromImageTest-24973270 None] Deleted volume successfully. Jul 10 16:09:49 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-3996fe08-7827-47fc-9ca5-9a1af3d96f65 tempest-CreateVolumesFromImageTest-24973270 None] Lock "cinder-2a7d6c58-832f-4403-b303-f72e1c9aed7e-delete_volume" released by "delete_volume" :: held 2.306s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:09:52 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f24f38e-b5e7-446d-b256-1147e1915d65 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 16:09:52 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6f24f38e-b5e7-446d-b256-1147e1915d65 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Flow 'volume_create_manager' (5850ed8b-97d2-4538-acc9-39ebad8e54c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:09:52 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6f24f38e-b5e7-446d-b256-1147e1915d65 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2978d361-b27c-46e6-b305-5ea19549b4f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:09:52 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6f24f38e-b5e7-446d-b256-1147e1915d65 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2978d361-b27c-46e6-b305-5ea19549b4f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:09:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-136417279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fa8f800-3273-4ba7-924b-9448265a2bcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c1390dce84447f9ac48c45772fa572e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:09:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:09:52Z,use_quota=True,user_id='6ba11e3e074f4051ba250861ed4c34fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:09:52 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6f24f38e-b5e7-446d-b256-1147e1915d65 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f4b2ba4-e9f8-493c-adb2-5630a140ea7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:09:52 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6f24f38e-b5e7-446d-b256-1147e1915d65 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f4b2ba4-e9f8-493c-adb2-5630a140ea7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:09:52 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6f24f38e-b5e7-446d-b256-1147e1915d65 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ccdeba7-5c55-4173-b473-ad5142ce301a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:09:52 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6f24f38e-b5e7-446d-b256-1147e1915d65 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ccdeba7-5c55-4173-b473-ad5142ce301a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fa8f800-3273-4ba7-924b-9448265a2bcc', 'volume_name': 'volume-6fa8f800-3273-4ba7-924b-9448265a2bcc', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:09:52 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6f24f38e-b5e7-446d-b256-1147e1915d65 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (064f5c5d-2402-4b43-ad51-ac68f7b17b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:09:52 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6f24f38e-b5e7-446d-b256-1147e1915d65 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (064f5c5d-2402-4b43-ad51-ac68f7b17b9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:09:52 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6f24f38e-b5e7-446d-b256-1147e1915d65 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd0b9dd7-3b58-49b7-8e6a-02f2ac2519ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:09:52 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-6f24f38e-b5e7-446d-b256-1147e1915d65 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Volume 6fa8f800-3273-4ba7-924b-9448265a2bcc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fa8f800-3273-4ba7-924b-9448265a2bcc', 'volume_size': 1} Jul 10 16:09:52 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-6f24f38e-b5e7-446d-b256-1147e1915d65 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:09:52 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-6f24f38e-b5e7-446d-b256-1147e1915d65 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:09:52 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-6f24f38e-b5e7-446d-b256-1147e1915d65 tempest-CreateVolumesFromSnapshotTest-1269546565 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:09:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-136417279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fa8f800-3273-4ba7-924b-9448265a2bcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c1390dce84447f9ac48c45772fa572e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:09:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:09:52Z,use_quota=True,user_id='6ba11e3e074f4051ba250861ed4c34fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 16:09:52 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-6f24f38e-b5e7-446d-b256-1147e1915d65 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Creating volume 6fa8f800-3273-4ba7-924b-9448265a2bcc {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 16:09:52 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-6f24f38e-b5e7-446d-b256-1147e1915d65 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:09:52 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-6f24f38e-b5e7-446d-b256-1147e1915d65 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:09:52 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-6f24f38e-b5e7-446d-b256-1147e1915d65 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:09:52 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-6f24f38e-b5e7-446d-b256-1147e1915d65 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:09:52 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-6f24f38e-b5e7-446d-b256-1147e1915d65 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:09:52 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-6f24f38e-b5e7-446d-b256-1147e1915d65 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 16:09:52 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-6f24f38e-b5e7-446d-b256-1147e1915d65 tempest-CreateVolumesFromSnapshotTest-1269546565 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 16:09:52 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6f24f38e-b5e7-446d-b256-1147e1915d65 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6fa8f800-3273-4ba7-924b-9448265a2bcc 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:09:52 devstack sudo[105114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6fa8f800-3273-4ba7-924b-9448265a2bcc 1073741824 Jul 10 16:09:52 devstack sudo[105114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:09:53 devstack sudo[105114]: pam_unix(sudo:session): session closed for user root Jul 10 16:09:53 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6f24f38e-b5e7-446d-b256-1147e1915d65 tempest-CreateVolumesFromSnapshotTest-1269546565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6fa8f800-3273-4ba7-924b-9448265a2bcc 1073741824" returned: 0 in 0.788s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:09:53 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6f24f38e-b5e7-446d-b256-1147e1915d65 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6fa8f800-3273-4ba7-924b-9448265a2bcc {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:09:53 devstack sudo[105119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6fa8f800-3273-4ba7-924b-9448265a2bcc Jul 10 16:09:53 devstack sudo[105119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:09:53 devstack sudo[105119]: pam_unix(sudo:session): session closed for user root Jul 10 16:09:53 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6f24f38e-b5e7-446d-b256-1147e1915d65 tempest-CreateVolumesFromSnapshotTest-1269546565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6fa8f800-3273-4ba7-924b-9448265a2bcc" returned: 0 in 0.634s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:09:53 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-6f24f38e-b5e7-446d-b256-1147e1915d65 tempest-CreateVolumesFromSnapshotTest-1269546565 None] <== create_volume: return (1460ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 16:09:53 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-6f24f38e-b5e7-446d-b256-1147e1915d65 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.463s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:09:53 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6f24f38e-b5e7-446d-b256-1147e1915d65 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd0b9dd7-3b58-49b7-8e6a-02f2ac2519ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fa8f800-3273-4ba7-924b-9448265a2bcc', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:09:53 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6f24f38e-b5e7-446d-b256-1147e1915d65 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb84344f-c10a-437b-9c99-df3766e9451e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:09:53 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-6f24f38e-b5e7-446d-b256-1147e1915d65 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Volume volume-6fa8f800-3273-4ba7-924b-9448265a2bcc (6fa8f800-3273-4ba7-924b-9448265a2bcc): created successfully Jul 10 16:09:53 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6f24f38e-b5e7-446d-b256-1147e1915d65 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb84344f-c10a-437b-9c99-df3766e9451e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:09:53 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6f24f38e-b5e7-446d-b256-1147e1915d65 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Flow 'volume_create_manager' (5850ed8b-97d2-4538-acc9-39ebad8e54c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:09:53 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-6f24f38e-b5e7-446d-b256-1147e1915d65 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Created volume successfully. Jul 10 16:09:54 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-f3f90285-6006-4d1a-8bb6-fc48f4bc2f75 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:09:54 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-f3f90285-6006-4d1a-8bb6-fc48f4bc2f75 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:09:54 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-f3f90285-6006-4d1a-8bb6-fc48f4bc2f75 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Creating offline snapshot b4bc29c7-075d-4220-8c2f-77bcd1e1da12 of volume 6fa8f800-3273-4ba7-924b-9448265a2bcc {{(pid=87420) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 16:09:54 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab3b3df1-f31b-4792-973c-c67df86a60ef]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:09:54 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f3f90285-6006-4d1a-8bb6-fc48f4bc2f75 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6fa8f800-3273-4ba7-924b-9448265a2bcc {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:09:54 devstack sudo[105123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6fa8f800-3273-4ba7-924b-9448265a2bcc Jul 10 16:09:54 devstack sudo[105123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:09:55 devstack sudo[105123]: pam_unix(sudo:session): session closed for user root Jul 10 16:09:55 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f3f90285-6006-4d1a-8bb6-fc48f4bc2f75 tempest-CreateVolumesFromSnapshotTest-1269546565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6fa8f800-3273-4ba7-924b-9448265a2bcc" returned: 0 in 0.751s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:09:55 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f3f90285-6006-4d1a-8bb6-fc48f4bc2f75 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6fa8f800-3273-4ba7-924b-9448265a2bcc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6fa8f800-3273-4ba7-924b-9448265a2bcc.b4bc29c7-075d-4220-8c2f-77bcd1e1da12 1G {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:09:55 devstack sudo[105128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6fa8f800-3273-4ba7-924b-9448265a2bcc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6fa8f800-3273-4ba7-924b-9448265a2bcc.b4bc29c7-075d-4220-8c2f-77bcd1e1da12 1G Jul 10 16:09:55 devstack sudo[105128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:09:55 devstack sudo[105128]: pam_unix(sudo:session): session closed for user root Jul 10 16:09:55 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f3f90285-6006-4d1a-8bb6-fc48f4bc2f75 tempest-CreateVolumesFromSnapshotTest-1269546565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6fa8f800-3273-4ba7-924b-9448265a2bcc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6fa8f800-3273-4ba7-924b-9448265a2bcc.b4bc29c7-075d-4220-8c2f-77bcd1e1da12 1G" returned: 0 in 0.766s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:09:55 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f3f90285-6006-4d1a-8bb6-fc48f4bc2f75 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6fa8f800-3273-4ba7-924b-9448265a2bcc -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6fa8f800-3273-4ba7-924b-9448265a2bcc.b4bc29c7-075d-4220-8c2f-77bcd1e1da12 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:09:55 devstack sudo[105134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6fa8f800-3273-4ba7-924b-9448265a2bcc -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6fa8f800-3273-4ba7-924b-9448265a2bcc.b4bc29c7-075d-4220-8c2f-77bcd1e1da12 Jul 10 16:09:55 devstack sudo[105134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:09:56 devstack sudo[105134]: pam_unix(sudo:session): session closed for user root Jul 10 16:09:56 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f3f90285-6006-4d1a-8bb6-fc48f4bc2f75 tempest-CreateVolumesFromSnapshotTest-1269546565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6fa8f800-3273-4ba7-924b-9448265a2bcc -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6fa8f800-3273-4ba7-924b-9448265a2bcc.b4bc29c7-075d-4220-8c2f-77bcd1e1da12" returned: 0 in 0.668s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:09:56 devstack cinder-volume[87420]: WARNING cinder.volume.drivers.remotefs [None req-f3f90285-6006-4d1a-8bb6-fc48f4bc2f75 tempest-CreateVolumesFromSnapshotTest-1269546565 None] /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6fa8f800-3273-4ba7-924b-9448265a2bcc.b4bc29c7-075d-4220-8c2f-77bcd1e1da12 is being set with open permissions: ugo+rw Jul 10 16:09:56 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f3f90285-6006-4d1a-8bb6-fc48f4bc2f75 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6fa8f800-3273-4ba7-924b-9448265a2bcc.b4bc29c7-075d-4220-8c2f-77bcd1e1da12 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:09:56 devstack sudo[105140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6fa8f800-3273-4ba7-924b-9448265a2bcc.b4bc29c7-075d-4220-8c2f-77bcd1e1da12 Jul 10 16:09:56 devstack sudo[105140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:09:57 devstack sudo[105140]: pam_unix(sudo:session): session closed for user root Jul 10 16:09:57 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f3f90285-6006-4d1a-8bb6-fc48f4bc2f75 tempest-CreateVolumesFromSnapshotTest-1269546565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6fa8f800-3273-4ba7-924b-9448265a2bcc.b4bc29c7-075d-4220-8c2f-77bcd1e1da12" returned: 0 in 0.625s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:09:57 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f3f90285-6006-4d1a-8bb6-fc48f4bc2f75 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6fa8f800-3273-4ba7-924b-9448265a2bcc.info {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:09:57 devstack sudo[105143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6fa8f800-3273-4ba7-924b-9448265a2bcc.info Jul 10 16:09:57 devstack sudo[105143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:09:57 devstack sudo[105143]: pam_unix(sudo:session): session closed for user root Jul 10 16:09:57 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f3f90285-6006-4d1a-8bb6-fc48f4bc2f75 tempest-CreateVolumesFromSnapshotTest-1269546565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6fa8f800-3273-4ba7-924b-9448265a2bcc.info" returned: 0 in 0.669s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:09:57 devstack cinder-volume[87420]: WARNING cinder.volume.drivers.remotefs [None req-f3f90285-6006-4d1a-8bb6-fc48f4bc2f75 tempest-CreateVolumesFromSnapshotTest-1269546565 None] /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6fa8f800-3273-4ba7-924b-9448265a2bcc.info is being set with open permissions: ugo+rw Jul 10 16:09:57 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f3f90285-6006-4d1a-8bb6-fc48f4bc2f75 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6fa8f800-3273-4ba7-924b-9448265a2bcc.info {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:09:57 devstack sudo[105146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6fa8f800-3273-4ba7-924b-9448265a2bcc.info Jul 10 16:09:57 devstack sudo[105146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:09:58 devstack sudo[105146]: pam_unix(sudo:session): session closed for user root Jul 10 16:09:58 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f3f90285-6006-4d1a-8bb6-fc48f4bc2f75 tempest-CreateVolumesFromSnapshotTest-1269546565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6fa8f800-3273-4ba7-924b-9448265a2bcc.info" returned: 0 in 0.641s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:09:58 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-f3f90285-6006-4d1a-8bb6-fc48f4bc2f75 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.203s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:09:58 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-f3f90285-6006-4d1a-8bb6-fc48f4bc2f75 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Create snapshot completed successfully Jul 10 16:10:00 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-400320b4-70d6-4ba2-b171-952e3be0de89 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 16:10:00 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-400320b4-70d6-4ba2-b171-952e3be0de89 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Flow 'volume_create_manager' (534f9847-0550-427b-9102-8eb1bb0dc13c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:10:00 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-400320b4-70d6-4ba2-b171-952e3be0de89 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (423406e0-23b6-463a-b854-ad3d11284297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:10:00 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-400320b4-70d6-4ba2-b171-952e3be0de89 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (423406e0-23b6-463a-b854-ad3d11284297) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:10:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-181714500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6af440ad-b37b-43ca-9da9-faf223e5d9e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c1390dce84447f9ac48c45772fa572e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:10:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:10:00Z,use_quota=True,user_id='6ba11e3e074f4051ba250861ed4c34fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:10:00 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-400320b4-70d6-4ba2-b171-952e3be0de89 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fea82c8e-27e8-433a-a561-89a6c9664daa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:10:00 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-400320b4-70d6-4ba2-b171-952e3be0de89 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fea82c8e-27e8-433a-a561-89a6c9664daa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:10:00 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-400320b4-70d6-4ba2-b171-952e3be0de89 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (080f53c0-d011-4e83-8a1a-e2a34ac4fabc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:10:00 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-400320b4-70d6-4ba2-b171-952e3be0de89 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (080f53c0-d011-4e83-8a1a-e2a34ac4fabc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6af440ad-b37b-43ca-9da9-faf223e5d9e5', 'volume_name': 'volume-6af440ad-b37b-43ca-9da9-faf223e5d9e5', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:10:00 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-400320b4-70d6-4ba2-b171-952e3be0de89 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02bce973-9f3b-40e6-b306-21057ebbf6e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:10:00 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-400320b4-70d6-4ba2-b171-952e3be0de89 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02bce973-9f3b-40e6-b306-21057ebbf6e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:10:00 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-400320b4-70d6-4ba2-b171-952e3be0de89 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f519cb72-3733-4fe4-9600-400fef4546b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:10:00 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-400320b4-70d6-4ba2-b171-952e3be0de89 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Volume 6af440ad-b37b-43ca-9da9-faf223e5d9e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6af440ad-b37b-43ca-9da9-faf223e5d9e5', 'volume_size': 1} Jul 10 16:10:00 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-400320b4-70d6-4ba2-b171-952e3be0de89 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:10:00 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-400320b4-70d6-4ba2-b171-952e3be0de89 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:10:00 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-400320b4-70d6-4ba2-b171-952e3be0de89 tempest-CreateVolumesFromSnapshotTest-1269546565 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:10:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-181714500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6af440ad-b37b-43ca-9da9-faf223e5d9e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c1390dce84447f9ac48c45772fa572e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:10:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:10:00Z,use_quota=True,user_id='6ba11e3e074f4051ba250861ed4c34fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 16:10:00 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-400320b4-70d6-4ba2-b171-952e3be0de89 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Creating volume 6af440ad-b37b-43ca-9da9-faf223e5d9e5 {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 16:10:00 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-400320b4-70d6-4ba2-b171-952e3be0de89 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:10:00 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-400320b4-70d6-4ba2-b171-952e3be0de89 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:10:00 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-400320b4-70d6-4ba2-b171-952e3be0de89 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:10:00 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-400320b4-70d6-4ba2-b171-952e3be0de89 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:10:00 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-400320b4-70d6-4ba2-b171-952e3be0de89 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:10:00 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-400320b4-70d6-4ba2-b171-952e3be0de89 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 16:10:00 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-400320b4-70d6-4ba2-b171-952e3be0de89 tempest-CreateVolumesFromSnapshotTest-1269546565 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 16:10:00 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-400320b4-70d6-4ba2-b171-952e3be0de89 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6af440ad-b37b-43ca-9da9-faf223e5d9e5 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:10:00 devstack sudo[105149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6af440ad-b37b-43ca-9da9-faf223e5d9e5 1073741824 Jul 10 16:10:00 devstack sudo[105149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:10:00 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c366943-bacd-4250-bb8e-c0544743a289 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 16:10:00 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-1c366943-bacd-4250-bb8e-c0544743a289 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Flow 'volume_create_manager' (6e0dd45b-da6f-429f-8138-e645e83f79a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:10:00 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-1c366943-bacd-4250-bb8e-c0544743a289 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3707c6d7-2ab8-4e81-8af2-0febe1aacc12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:10:00 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-1c366943-bacd-4250-bb8e-c0544743a289 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3707c6d7-2ab8-4e81-8af2-0febe1aacc12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:10:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-627554712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=576db099-0d9e-4a7b-a6bd-c5bd294c71cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c1390dce84447f9ac48c45772fa572e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:10:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:10:00Z,use_quota=True,user_id='6ba11e3e074f4051ba250861ed4c34fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:10:00 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-1c366943-bacd-4250-bb8e-c0544743a289 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9889f45-fa96-4d8e-85ed-36faf0272fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:10:00 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-1c366943-bacd-4250-bb8e-c0544743a289 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9889f45-fa96-4d8e-85ed-36faf0272fd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:10:00 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-1c366943-bacd-4250-bb8e-c0544743a289 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49e2e124-991b-42fa-9520-76ff269222d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:10:00 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-1c366943-bacd-4250-bb8e-c0544743a289 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49e2e124-991b-42fa-9520-76ff269222d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '576db099-0d9e-4a7b-a6bd-c5bd294c71cb', 'volume_name': 'volume-576db099-0d9e-4a7b-a6bd-c5bd294c71cb', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:10:00 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-1c366943-bacd-4250-bb8e-c0544743a289 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eaea1085-9b3b-472e-add7-2aeb397c018e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:10:00 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-1c366943-bacd-4250-bb8e-c0544743a289 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eaea1085-9b3b-472e-add7-2aeb397c018e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:10:00 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-1c366943-bacd-4250-bb8e-c0544743a289 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (278c0089-3390-4fd2-b185-0061666e1767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:10:00 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-1c366943-bacd-4250-bb8e-c0544743a289 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Volume 576db099-0d9e-4a7b-a6bd-c5bd294c71cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-576db099-0d9e-4a7b-a6bd-c5bd294c71cb', 'volume_size': 1} Jul 10 16:10:00 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-1c366943-bacd-4250-bb8e-c0544743a289 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:10:00 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe172e53-c791-4329-afdf-d92e43da4e21 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 16:10:00 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-fe172e53-c791-4329-afdf-d92e43da4e21 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Flow 'volume_create_manager' (ef2aa673-0a1a-4843-b0a3-2130a2b6df95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:10:00 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-fe172e53-c791-4329-afdf-d92e43da4e21 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96b9be2f-9068-4955-82ac-b9fea85bd25b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:10:00 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-fe172e53-c791-4329-afdf-d92e43da4e21 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96b9be2f-9068-4955-82ac-b9fea85bd25b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:10:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-960738611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0fdb24f-4b19-4934-8ba3-3ac5400d3c19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c1390dce84447f9ac48c45772fa572e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:10:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:10:01Z,use_quota=True,user_id='6ba11e3e074f4051ba250861ed4c34fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:10:00 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-fe172e53-c791-4329-afdf-d92e43da4e21 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e523c9f3-524f-44dc-a998-db44978faac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:10:00 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-fe172e53-c791-4329-afdf-d92e43da4e21 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e523c9f3-524f-44dc-a998-db44978faac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:10:00 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-fe172e53-c791-4329-afdf-d92e43da4e21 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e92c1e57-54e1-4462-8d53-e520f4080a7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:10:00 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-fe172e53-c791-4329-afdf-d92e43da4e21 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e92c1e57-54e1-4462-8d53-e520f4080a7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0fdb24f-4b19-4934-8ba3-3ac5400d3c19', 'volume_name': 'volume-a0fdb24f-4b19-4934-8ba3-3ac5400d3c19', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:10:00 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-fe172e53-c791-4329-afdf-d92e43da4e21 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (425fe245-c79c-4f11-839b-a0db5b893710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:10:00 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-fe172e53-c791-4329-afdf-d92e43da4e21 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (425fe245-c79c-4f11-839b-a0db5b893710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:10:00 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-fe172e53-c791-4329-afdf-d92e43da4e21 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8499cd0c-a6da-48f7-a5f2-5af39c85ab14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:10:00 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-fe172e53-c791-4329-afdf-d92e43da4e21 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Volume a0fdb24f-4b19-4934-8ba3-3ac5400d3c19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0fdb24f-4b19-4934-8ba3-3ac5400d3c19', 'volume_size': 1} Jul 10 16:10:00 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-fe172e53-c791-4329-afdf-d92e43da4e21 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:10:01 devstack sudo[105149]: pam_unix(sudo:session): session closed for user root Jul 10 16:10:01 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-400320b4-70d6-4ba2-b171-952e3be0de89 tempest-CreateVolumesFromSnapshotTest-1269546565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6af440ad-b37b-43ca-9da9-faf223e5d9e5 1073741824" returned: 0 in 0.913s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:10:01 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-400320b4-70d6-4ba2-b171-952e3be0de89 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6af440ad-b37b-43ca-9da9-faf223e5d9e5 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:10:01 devstack sudo[105157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6af440ad-b37b-43ca-9da9-faf223e5d9e5 Jul 10 16:10:01 devstack sudo[105157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:10:01 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-97420ff2-1d65-4e72-a6a7-3c8f67a220bb tempest-CreateVolumesFromSnapshotTest-1269546565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 16:10:01 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-97420ff2-1d65-4e72-a6a7-3c8f67a220bb tempest-CreateVolumesFromSnapshotTest-1269546565 None] Flow 'volume_create_manager' (5f1268ed-7de1-4c5a-b462-64c2433db56b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:10:01 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-97420ff2-1d65-4e72-a6a7-3c8f67a220bb tempest-CreateVolumesFromSnapshotTest-1269546565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7e0bfb7-c7c7-43ce-bd32-6df0c33ced4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:10:01 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-97420ff2-1d65-4e72-a6a7-3c8f67a220bb tempest-CreateVolumesFromSnapshotTest-1269546565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7e0bfb7-c7c7-43ce-bd32-6df0c33ced4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:10:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1654360851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32deda80-ca9f-400f-9558-cc056adb0195,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c1390dce84447f9ac48c45772fa572e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:10:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:10:01Z,use_quota=True,user_id='6ba11e3e074f4051ba250861ed4c34fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:10:01 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-97420ff2-1d65-4e72-a6a7-3c8f67a220bb tempest-CreateVolumesFromSnapshotTest-1269546565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (510eb6a3-b169-488a-9cd9-0afe63a36b1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:10:01 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-97420ff2-1d65-4e72-a6a7-3c8f67a220bb tempest-CreateVolumesFromSnapshotTest-1269546565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (510eb6a3-b169-488a-9cd9-0afe63a36b1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:10:01 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-97420ff2-1d65-4e72-a6a7-3c8f67a220bb tempest-CreateVolumesFromSnapshotTest-1269546565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08019894-908e-4671-a6b0-080b5daaab70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:10:01 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-97420ff2-1d65-4e72-a6a7-3c8f67a220bb tempest-CreateVolumesFromSnapshotTest-1269546565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08019894-908e-4671-a6b0-080b5daaab70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32deda80-ca9f-400f-9558-cc056adb0195', 'volume_name': 'volume-32deda80-ca9f-400f-9558-cc056adb0195', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:10:01 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-97420ff2-1d65-4e72-a6a7-3c8f67a220bb tempest-CreateVolumesFromSnapshotTest-1269546565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e55b818-0616-4b52-8d9b-fae8dc43c2a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:10:01 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-97420ff2-1d65-4e72-a6a7-3c8f67a220bb tempest-CreateVolumesFromSnapshotTest-1269546565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e55b818-0616-4b52-8d9b-fae8dc43c2a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:10:01 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-97420ff2-1d65-4e72-a6a7-3c8f67a220bb tempest-CreateVolumesFromSnapshotTest-1269546565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12039869-b974-4060-9409-f5e98d90e209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:10:01 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-97420ff2-1d65-4e72-a6a7-3c8f67a220bb tempest-CreateVolumesFromSnapshotTest-1269546565 None] Volume 32deda80-ca9f-400f-9558-cc056adb0195: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32deda80-ca9f-400f-9558-cc056adb0195', 'volume_size': 1} Jul 10 16:10:01 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-97420ff2-1d65-4e72-a6a7-3c8f67a220bb tempest-CreateVolumesFromSnapshotTest-1269546565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:10:01 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-432604ab-56a6-466f-bf53-bfcf2f892226 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 16:10:01 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-432604ab-56a6-466f-bf53-bfcf2f892226 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Flow 'volume_create_manager' (cff5da1f-c8e5-467f-9ff6-e9cfda9d32e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:10:01 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-432604ab-56a6-466f-bf53-bfcf2f892226 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e3e6cba-97cb-4d57-8e77-c8c9af4357a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:10:01 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-432604ab-56a6-466f-bf53-bfcf2f892226 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e3e6cba-97cb-4d57-8e77-c8c9af4357a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:10:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-943339902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb1bd0ba-9761-46b5-a609-aa870a750894,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c1390dce84447f9ac48c45772fa572e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:10:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:10:01Z,use_quota=True,user_id='6ba11e3e074f4051ba250861ed4c34fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:10:01 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-432604ab-56a6-466f-bf53-bfcf2f892226 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3a5fefd-a146-4c51-9018-17d8c4fdec7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:10:01 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-432604ab-56a6-466f-bf53-bfcf2f892226 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3a5fefd-a146-4c51-9018-17d8c4fdec7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:10:01 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-432604ab-56a6-466f-bf53-bfcf2f892226 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46a0931a-2e50-4163-820d-673630734ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:10:01 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-432604ab-56a6-466f-bf53-bfcf2f892226 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46a0931a-2e50-4163-820d-673630734ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb1bd0ba-9761-46b5-a609-aa870a750894', 'volume_name': 'volume-eb1bd0ba-9761-46b5-a609-aa870a750894', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:10:01 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-432604ab-56a6-466f-bf53-bfcf2f892226 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b5782ab-5ee6-49e7-a29f-3ee7a37627bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:10:01 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-432604ab-56a6-466f-bf53-bfcf2f892226 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b5782ab-5ee6-49e7-a29f-3ee7a37627bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:10:01 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-432604ab-56a6-466f-bf53-bfcf2f892226 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab62c53e-eb9c-49cb-bca6-266a95d64c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:10:01 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-432604ab-56a6-466f-bf53-bfcf2f892226 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Volume eb1bd0ba-9761-46b5-a609-aa870a750894: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb1bd0ba-9761-46b5-a609-aa870a750894', 'volume_size': 1} Jul 10 16:10:01 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-432604ab-56a6-466f-bf53-bfcf2f892226 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:10:01 devstack sudo[105157]: pam_unix(sudo:session): session closed for user root Jul 10 16:10:01 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-400320b4-70d6-4ba2-b171-952e3be0de89 tempest-CreateVolumesFromSnapshotTest-1269546565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6af440ad-b37b-43ca-9da9-faf223e5d9e5" returned: 0 in 0.693s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:10:01 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-400320b4-70d6-4ba2-b171-952e3be0de89 tempest-CreateVolumesFromSnapshotTest-1269546565 None] <== create_volume: return (1656ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 16:10:01 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-400320b4-70d6-4ba2-b171-952e3be0de89 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.659s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:10:01 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-1c366943-bacd-4250-bb8e-c0544743a289 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.296s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:10:01 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-1c366943-bacd-4250-bb8e-c0544743a289 tempest-CreateVolumesFromSnapshotTest-1269546565 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:10:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-627554712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=576db099-0d9e-4a7b-a6bd-c5bd294c71cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c1390dce84447f9ac48c45772fa572e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:10:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:10:00Z,use_quota=True,user_id='6ba11e3e074f4051ba250861ed4c34fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 16:10:01 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-1c366943-bacd-4250-bb8e-c0544743a289 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Creating volume 576db099-0d9e-4a7b-a6bd-c5bd294c71cb {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 16:10:01 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-1c366943-bacd-4250-bb8e-c0544743a289 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:10:01 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-1c366943-bacd-4250-bb8e-c0544743a289 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:10:01 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-1c366943-bacd-4250-bb8e-c0544743a289 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:10:01 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-1c366943-bacd-4250-bb8e-c0544743a289 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:10:01 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-1c366943-bacd-4250-bb8e-c0544743a289 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:10:01 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-1c366943-bacd-4250-bb8e-c0544743a289 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 16:10:01 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-1c366943-bacd-4250-bb8e-c0544743a289 tempest-CreateVolumesFromSnapshotTest-1269546565 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 16:10:01 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-1c366943-bacd-4250-bb8e-c0544743a289 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-576db099-0d9e-4a7b-a6bd-c5bd294c71cb 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:10:01 devstack sudo[105160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-576db099-0d9e-4a7b-a6bd-c5bd294c71cb 1073741824 Jul 10 16:10:01 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-400320b4-70d6-4ba2-b171-952e3be0de89 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f519cb72-3733-4fe4-9600-400fef4546b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6af440ad-b37b-43ca-9da9-faf223e5d9e5', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:10:01 devstack sudo[105160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:10:01 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-400320b4-70d6-4ba2-b171-952e3be0de89 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e77e0963-7e16-4f11-92ef-0c98887adeb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:10:01 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-400320b4-70d6-4ba2-b171-952e3be0de89 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Volume volume-6af440ad-b37b-43ca-9da9-faf223e5d9e5 (6af440ad-b37b-43ca-9da9-faf223e5d9e5): created successfully Jul 10 16:10:01 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-400320b4-70d6-4ba2-b171-952e3be0de89 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e77e0963-7e16-4f11-92ef-0c98887adeb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:10:01 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-400320b4-70d6-4ba2-b171-952e3be0de89 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Flow 'volume_create_manager' (534f9847-0550-427b-9102-8eb1bb0dc13c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:10:01 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-400320b4-70d6-4ba2-b171-952e3be0de89 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Created volume successfully. Jul 10 16:10:02 devstack sudo[105160]: pam_unix(sudo:session): session closed for user root Jul 10 16:10:02 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-1c366943-bacd-4250-bb8e-c0544743a289 tempest-CreateVolumesFromSnapshotTest-1269546565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-576db099-0d9e-4a7b-a6bd-c5bd294c71cb 1073741824" returned: 0 in 0.835s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:10:02 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-1c366943-bacd-4250-bb8e-c0544743a289 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-576db099-0d9e-4a7b-a6bd-c5bd294c71cb {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:10:02 devstack sudo[105166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-576db099-0d9e-4a7b-a6bd-c5bd294c71cb Jul 10 16:10:02 devstack sudo[105166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:10:03 devstack sudo[105166]: pam_unix(sudo:session): session closed for user root Jul 10 16:10:03 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-1c366943-bacd-4250-bb8e-c0544743a289 tempest-CreateVolumesFromSnapshotTest-1269546565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-576db099-0d9e-4a7b-a6bd-c5bd294c71cb" returned: 0 in 0.629s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:10:03 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-1c366943-bacd-4250-bb8e-c0544743a289 tempest-CreateVolumesFromSnapshotTest-1269546565 None] <== create_volume: return (1502ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 16:10:03 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-1c366943-bacd-4250-bb8e-c0544743a289 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.504s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:10:03 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-fe172e53-c791-4329-afdf-d92e43da4e21 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.427s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:10:03 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-fe172e53-c791-4329-afdf-d92e43da4e21 tempest-CreateVolumesFromSnapshotTest-1269546565 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:10:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-960738611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0fdb24f-4b19-4934-8ba3-3ac5400d3c19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c1390dce84447f9ac48c45772fa572e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:10:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:10:01Z,use_quota=True,user_id='6ba11e3e074f4051ba250861ed4c34fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 16:10:03 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-fe172e53-c791-4329-afdf-d92e43da4e21 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Creating volume a0fdb24f-4b19-4934-8ba3-3ac5400d3c19 {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 16:10:03 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-fe172e53-c791-4329-afdf-d92e43da4e21 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:10:03 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-fe172e53-c791-4329-afdf-d92e43da4e21 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:10:03 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-fe172e53-c791-4329-afdf-d92e43da4e21 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:10:03 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-fe172e53-c791-4329-afdf-d92e43da4e21 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:10:03 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-fe172e53-c791-4329-afdf-d92e43da4e21 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:10:03 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-fe172e53-c791-4329-afdf-d92e43da4e21 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 16:10:03 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-fe172e53-c791-4329-afdf-d92e43da4e21 tempest-CreateVolumesFromSnapshotTest-1269546565 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 16:10:03 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-fe172e53-c791-4329-afdf-d92e43da4e21 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a0fdb24f-4b19-4934-8ba3-3ac5400d3c19 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:10:03 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-1c366943-bacd-4250-bb8e-c0544743a289 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (278c0089-3390-4fd2-b185-0061666e1767) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-576db099-0d9e-4a7b-a6bd-c5bd294c71cb', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:10:03 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-1c366943-bacd-4250-bb8e-c0544743a289 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b696b86-d285-42a8-8ffb-63d30f3cd93f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:10:03 devstack sudo[105169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a0fdb24f-4b19-4934-8ba3-3ac5400d3c19 1073741824 Jul 10 16:10:03 devstack sudo[105169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:10:03 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-1c366943-bacd-4250-bb8e-c0544743a289 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Volume volume-576db099-0d9e-4a7b-a6bd-c5bd294c71cb (576db099-0d9e-4a7b-a6bd-c5bd294c71cb): created successfully Jul 10 16:10:03 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-1c366943-bacd-4250-bb8e-c0544743a289 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b696b86-d285-42a8-8ffb-63d30f3cd93f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:10:03 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-1c366943-bacd-4250-bb8e-c0544743a289 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Flow 'volume_create_manager' (6e0dd45b-da6f-429f-8138-e645e83f79a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:10:03 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-1c366943-bacd-4250-bb8e-c0544743a289 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Created volume successfully. Jul 10 16:10:04 devstack sudo[105169]: pam_unix(sudo:session): session closed for user root Jul 10 16:10:04 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-fe172e53-c791-4329-afdf-d92e43da4e21 tempest-CreateVolumesFromSnapshotTest-1269546565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a0fdb24f-4b19-4934-8ba3-3ac5400d3c19 1073741824" returned: 0 in 0.813s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:10:04 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-fe172e53-c791-4329-afdf-d92e43da4e21 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a0fdb24f-4b19-4934-8ba3-3ac5400d3c19 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:10:04 devstack sudo[105176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a0fdb24f-4b19-4934-8ba3-3ac5400d3c19 Jul 10 16:10:04 devstack sudo[105176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:10:04 devstack sudo[105176]: pam_unix(sudo:session): session closed for user root Jul 10 16:10:04 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-fe172e53-c791-4329-afdf-d92e43da4e21 tempest-CreateVolumesFromSnapshotTest-1269546565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a0fdb24f-4b19-4934-8ba3-3ac5400d3c19" returned: 0 in 0.632s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:10:04 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-fe172e53-c791-4329-afdf-d92e43da4e21 tempest-CreateVolumesFromSnapshotTest-1269546565 None] <== create_volume: return (1482ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 16:10:04 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-fe172e53-c791-4329-afdf-d92e43da4e21 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.485s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:10:04 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-97420ff2-1d65-4e72-a6a7-3c8f67a220bb tempest-CreateVolumesFromSnapshotTest-1269546565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.547s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:10:04 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-97420ff2-1d65-4e72-a6a7-3c8f67a220bb tempest-CreateVolumesFromSnapshotTest-1269546565 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:10:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1654360851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32deda80-ca9f-400f-9558-cc056adb0195,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c1390dce84447f9ac48c45772fa572e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:10:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:10:01Z,use_quota=True,user_id='6ba11e3e074f4051ba250861ed4c34fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 16:10:04 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-97420ff2-1d65-4e72-a6a7-3c8f67a220bb tempest-CreateVolumesFromSnapshotTest-1269546565 None] Creating volume 32deda80-ca9f-400f-9558-cc056adb0195 {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 16:10:04 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-97420ff2-1d65-4e72-a6a7-3c8f67a220bb tempest-CreateVolumesFromSnapshotTest-1269546565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:10:04 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-97420ff2-1d65-4e72-a6a7-3c8f67a220bb tempest-CreateVolumesFromSnapshotTest-1269546565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:10:04 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-97420ff2-1d65-4e72-a6a7-3c8f67a220bb tempest-CreateVolumesFromSnapshotTest-1269546565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:10:04 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-97420ff2-1d65-4e72-a6a7-3c8f67a220bb tempest-CreateVolumesFromSnapshotTest-1269546565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:10:04 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-97420ff2-1d65-4e72-a6a7-3c8f67a220bb tempest-CreateVolumesFromSnapshotTest-1269546565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:10:04 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-97420ff2-1d65-4e72-a6a7-3c8f67a220bb tempest-CreateVolumesFromSnapshotTest-1269546565 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 16:10:04 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-97420ff2-1d65-4e72-a6a7-3c8f67a220bb tempest-CreateVolumesFromSnapshotTest-1269546565 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 16:10:04 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-97420ff2-1d65-4e72-a6a7-3c8f67a220bb tempest-CreateVolumesFromSnapshotTest-1269546565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-32deda80-ca9f-400f-9558-cc056adb0195 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:10:04 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-fe172e53-c791-4329-afdf-d92e43da4e21 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8499cd0c-a6da-48f7-a5f2-5af39c85ab14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0fdb24f-4b19-4934-8ba3-3ac5400d3c19', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:10:04 devstack sudo[105179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-32deda80-ca9f-400f-9558-cc056adb0195 1073741824 Jul 10 16:10:04 devstack sudo[105179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:10:04 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-fe172e53-c791-4329-afdf-d92e43da4e21 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f39d8313-ed67-4c32-a170-85b1741bcc00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:10:04 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-fe172e53-c791-4329-afdf-d92e43da4e21 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Volume volume-a0fdb24f-4b19-4934-8ba3-3ac5400d3c19 (a0fdb24f-4b19-4934-8ba3-3ac5400d3c19): created successfully Jul 10 16:10:04 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-fe172e53-c791-4329-afdf-d92e43da4e21 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f39d8313-ed67-4c32-a170-85b1741bcc00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:10:04 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-fe172e53-c791-4329-afdf-d92e43da4e21 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Flow 'volume_create_manager' (ef2aa673-0a1a-4843-b0a3-2130a2b6df95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:10:04 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-fe172e53-c791-4329-afdf-d92e43da4e21 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Created volume successfully. Jul 10 16:10:05 devstack sudo[105179]: pam_unix(sudo:session): session closed for user root Jul 10 16:10:05 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-97420ff2-1d65-4e72-a6a7-3c8f67a220bb tempest-CreateVolumesFromSnapshotTest-1269546565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-32deda80-ca9f-400f-9558-cc056adb0195 1073741824" returned: 0 in 0.794s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:10:05 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-97420ff2-1d65-4e72-a6a7-3c8f67a220bb tempest-CreateVolumesFromSnapshotTest-1269546565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-32deda80-ca9f-400f-9558-cc056adb0195 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:10:05 devstack sudo[105184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-32deda80-ca9f-400f-9558-cc056adb0195 Jul 10 16:10:05 devstack sudo[105184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:10:06 devstack sudo[105184]: pam_unix(sudo:session): session closed for user root Jul 10 16:10:06 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-97420ff2-1d65-4e72-a6a7-3c8f67a220bb tempest-CreateVolumesFromSnapshotTest-1269546565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-32deda80-ca9f-400f-9558-cc056adb0195" returned: 0 in 0.646s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:10:06 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-97420ff2-1d65-4e72-a6a7-3c8f67a220bb tempest-CreateVolumesFromSnapshotTest-1269546565 None] <== create_volume: return (1476ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 16:10:06 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-97420ff2-1d65-4e72-a6a7-3c8f67a220bb tempest-CreateVolumesFromSnapshotTest-1269546565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.480s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:10:06 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-432604ab-56a6-466f-bf53-bfcf2f892226 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.677s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:10:06 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-432604ab-56a6-466f-bf53-bfcf2f892226 tempest-CreateVolumesFromSnapshotTest-1269546565 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:10:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-943339902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb1bd0ba-9761-46b5-a609-aa870a750894,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c1390dce84447f9ac48c45772fa572e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:10:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:10:01Z,use_quota=True,user_id='6ba11e3e074f4051ba250861ed4c34fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 16:10:06 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-432604ab-56a6-466f-bf53-bfcf2f892226 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Creating volume eb1bd0ba-9761-46b5-a609-aa870a750894 {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 16:10:06 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-432604ab-56a6-466f-bf53-bfcf2f892226 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:10:06 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-432604ab-56a6-466f-bf53-bfcf2f892226 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:10:06 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-432604ab-56a6-466f-bf53-bfcf2f892226 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:10:06 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-432604ab-56a6-466f-bf53-bfcf2f892226 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:10:06 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-432604ab-56a6-466f-bf53-bfcf2f892226 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:10:06 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-432604ab-56a6-466f-bf53-bfcf2f892226 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 16:10:06 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-432604ab-56a6-466f-bf53-bfcf2f892226 tempest-CreateVolumesFromSnapshotTest-1269546565 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 16:10:06 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-432604ab-56a6-466f-bf53-bfcf2f892226 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-eb1bd0ba-9761-46b5-a609-aa870a750894 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:10:06 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-97420ff2-1d65-4e72-a6a7-3c8f67a220bb tempest-CreateVolumesFromSnapshotTest-1269546565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12039869-b974-4060-9409-f5e98d90e209) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32deda80-ca9f-400f-9558-cc056adb0195', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:10:06 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-97420ff2-1d65-4e72-a6a7-3c8f67a220bb tempest-CreateVolumesFromSnapshotTest-1269546565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c97b954-0726-472b-b420-9c44577d6067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:10:06 devstack sudo[105187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-eb1bd0ba-9761-46b5-a609-aa870a750894 1073741824 Jul 10 16:10:06 devstack sudo[105187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:10:06 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-97420ff2-1d65-4e72-a6a7-3c8f67a220bb tempest-CreateVolumesFromSnapshotTest-1269546565 None] Volume volume-32deda80-ca9f-400f-9558-cc056adb0195 (32deda80-ca9f-400f-9558-cc056adb0195): created successfully Jul 10 16:10:06 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-97420ff2-1d65-4e72-a6a7-3c8f67a220bb tempest-CreateVolumesFromSnapshotTest-1269546565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c97b954-0726-472b-b420-9c44577d6067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:10:06 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-97420ff2-1d65-4e72-a6a7-3c8f67a220bb tempest-CreateVolumesFromSnapshotTest-1269546565 None] Flow 'volume_create_manager' (5f1268ed-7de1-4c5a-b462-64c2433db56b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:10:06 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-97420ff2-1d65-4e72-a6a7-3c8f67a220bb tempest-CreateVolumesFromSnapshotTest-1269546565 None] Created volume successfully. Jul 10 16:10:07 devstack sudo[105187]: pam_unix(sudo:session): session closed for user root Jul 10 16:10:07 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-432604ab-56a6-466f-bf53-bfcf2f892226 tempest-CreateVolumesFromSnapshotTest-1269546565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-eb1bd0ba-9761-46b5-a609-aa870a750894 1073741824" returned: 0 in 0.817s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:10:07 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-432604ab-56a6-466f-bf53-bfcf2f892226 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-eb1bd0ba-9761-46b5-a609-aa870a750894 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:10:07 devstack sudo[105192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-eb1bd0ba-9761-46b5-a609-aa870a750894 Jul 10 16:10:07 devstack sudo[105192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:10:07 devstack sudo[105192]: pam_unix(sudo:session): session closed for user root Jul 10 16:10:07 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-432604ab-56a6-466f-bf53-bfcf2f892226 tempest-CreateVolumesFromSnapshotTest-1269546565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-eb1bd0ba-9761-46b5-a609-aa870a750894" returned: 0 in 0.625s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:10:07 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-432604ab-56a6-466f-bf53-bfcf2f892226 tempest-CreateVolumesFromSnapshotTest-1269546565 None] <== create_volume: return (1479ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 16:10:07 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-432604ab-56a6-466f-bf53-bfcf2f892226 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.483s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:10:07 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-432604ab-56a6-466f-bf53-bfcf2f892226 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab62c53e-eb9c-49cb-bca6-266a95d64c48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb1bd0ba-9761-46b5-a609-aa870a750894', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:10:07 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-432604ab-56a6-466f-bf53-bfcf2f892226 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4777c6f9-40fd-424c-898d-3e93f0ea1e4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:10:07 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-432604ab-56a6-466f-bf53-bfcf2f892226 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Volume volume-eb1bd0ba-9761-46b5-a609-aa870a750894 (eb1bd0ba-9761-46b5-a609-aa870a750894): created successfully Jul 10 16:10:07 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-432604ab-56a6-466f-bf53-bfcf2f892226 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4777c6f9-40fd-424c-898d-3e93f0ea1e4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:10:07 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-432604ab-56a6-466f-bf53-bfcf2f892226 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Flow 'volume_create_manager' (cff5da1f-c8e5-467f-9ff6-e9cfda9d32e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:10:07 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-432604ab-56a6-466f-bf53-bfcf2f892226 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Created volume successfully. Jul 10 16:10:08 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-2319f58d-72e1-4a55-9d45-0dbd9656a68d tempest-CreateVolumesFromSnapshotTest-1269546565 None] Acquiring lock "cinder-eb1bd0ba-9761-46b5-a609-aa870a750894-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:10:08 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-2319f58d-72e1-4a55-9d45-0dbd9656a68d tempest-CreateVolumesFromSnapshotTest-1269546565 None] Lock "cinder-eb1bd0ba-9761-46b5-a609-aa870a750894-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:10:08 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-2319f58d-72e1-4a55-9d45-0dbd9656a68d tempest-CreateVolumesFromSnapshotTest-1269546565 None] Acquiring lock "cinder-quobyte-eb1bd0ba-9761-46b5-a609-aa870a750894" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:10:08 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-2319f58d-72e1-4a55-9d45-0dbd9656a68d tempest-CreateVolumesFromSnapshotTest-1269546565 None] Lock "cinder-quobyte-eb1bd0ba-9761-46b5-a609-aa870a750894" acquired by "delete_volume" :: waited 0.017s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:10:08 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4cdf3ba-69b7-4329-8745-179c97b322de]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:10:08 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-2319f58d-72e1-4a55-9d45-0dbd9656a68d tempest-CreateVolumesFromSnapshotTest-1269546565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-eb1bd0ba-9761-46b5-a609-aa870a750894 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:10:08 devstack sudo[105195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-eb1bd0ba-9761-46b5-a609-aa870a750894 Jul 10 16:10:08 devstack sudo[105195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:10:08 devstack sudo[105195]: pam_unix(sudo:session): session closed for user root Jul 10 16:10:08 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-2319f58d-72e1-4a55-9d45-0dbd9656a68d tempest-CreateVolumesFromSnapshotTest-1269546565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-eb1bd0ba-9761-46b5-a609-aa870a750894" returned: 0 in 0.748s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:10:08 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-2319f58d-72e1-4a55-9d45-0dbd9656a68d tempest-CreateVolumesFromSnapshotTest-1269546565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-eb1bd0ba-9761-46b5-a609-aa870a750894 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:10:08 devstack sudo[105200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-eb1bd0ba-9761-46b5-a609-aa870a750894 Jul 10 16:10:08 devstack sudo[105200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:10:09 devstack sudo[105200]: pam_unix(sudo:session): session closed for user root Jul 10 16:10:09 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-2319f58d-72e1-4a55-9d45-0dbd9656a68d tempest-CreateVolumesFromSnapshotTest-1269546565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-eb1bd0ba-9761-46b5-a609-aa870a750894" returned: 0 in 0.631s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:10:09 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-2319f58d-72e1-4a55-9d45-0dbd9656a68d tempest-CreateVolumesFromSnapshotTest-1269546565 None] Lock "cinder-quobyte-eb1bd0ba-9761-46b5-a609-aa870a750894" released by "delete_volume" :: held 1.416s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:10:09 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-2319f58d-72e1-4a55-9d45-0dbd9656a68d tempest-CreateVolumesFromSnapshotTest-1269546565 None] Created reservations ['b939be8c-56c2-4f2f-9567-126d6cc30db5', '7a305b43-18a8-4b28-9019-c95f576248a7', '92c743d8-6fb0-4adf-8430-bf66c8dd6455', '26e5d2af-b4fd-4d65-aff5-5987ff5b55a0'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:10:09 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-2319f58d-72e1-4a55-9d45-0dbd9656a68d tempest-CreateVolumesFromSnapshotTest-1269546565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:10:09 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-2319f58d-72e1-4a55-9d45-0dbd9656a68d tempest-CreateVolumesFromSnapshotTest-1269546565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:10:09 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-2319f58d-72e1-4a55-9d45-0dbd9656a68d tempest-CreateVolumesFromSnapshotTest-1269546565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:10:09 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-2319f58d-72e1-4a55-9d45-0dbd9656a68d tempest-CreateVolumesFromSnapshotTest-1269546565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:10:09 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-2319f58d-72e1-4a55-9d45-0dbd9656a68d tempest-CreateVolumesFromSnapshotTest-1269546565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:10:09 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-2319f58d-72e1-4a55-9d45-0dbd9656a68d tempest-CreateVolumesFromSnapshotTest-1269546565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:10:09 devstack sudo[105203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:10:09 devstack sudo[105203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:10:10 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-a9d27871-ba1d-4199-9b96-d1d42bd1cc8d tempest-CreateVolumesFromSnapshotTest-1269546565 None] Acquiring lock "cinder-32deda80-ca9f-400f-9558-cc056adb0195-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:10:10 devstack sudo[105203]: pam_unix(sudo:session): session closed for user root Jul 10 16:10:10 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-2319f58d-72e1-4a55-9d45-0dbd9656a68d tempest-CreateVolumesFromSnapshotTest-1269546565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.645s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:10:10 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-2319f58d-72e1-4a55-9d45-0dbd9656a68d tempest-CreateVolumesFromSnapshotTest-1269546565 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:10:10 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-a9d27871-ba1d-4199-9b96-d1d42bd1cc8d tempest-CreateVolumesFromSnapshotTest-1269546565 None] Lock "cinder-32deda80-ca9f-400f-9558-cc056adb0195-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:10:10 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-2319f58d-72e1-4a55-9d45-0dbd9656a68d tempest-CreateVolumesFromSnapshotTest-1269546565 None] Deleted volume successfully. Jul 10 16:10:10 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-2319f58d-72e1-4a55-9d45-0dbd9656a68d tempest-CreateVolumesFromSnapshotTest-1269546565 None] Lock "cinder-eb1bd0ba-9761-46b5-a609-aa870a750894-delete_volume" released by "delete_volume" :: held 2.251s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:10:10 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-a9d27871-ba1d-4199-9b96-d1d42bd1cc8d tempest-CreateVolumesFromSnapshotTest-1269546565 None] Acquiring lock "cinder-quobyte-32deda80-ca9f-400f-9558-cc056adb0195" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:10:10 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-a9d27871-ba1d-4199-9b96-d1d42bd1cc8d tempest-CreateVolumesFromSnapshotTest-1269546565 None] Lock "cinder-quobyte-32deda80-ca9f-400f-9558-cc056adb0195" acquired by "delete_volume" :: waited 0.015s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:10:10 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc4346d3-438f-4749-a753-826ba6577220]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:10:10 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a9d27871-ba1d-4199-9b96-d1d42bd1cc8d tempest-CreateVolumesFromSnapshotTest-1269546565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-32deda80-ca9f-400f-9558-cc056adb0195 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:10:10 devstack sudo[105206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-32deda80-ca9f-400f-9558-cc056adb0195 Jul 10 16:10:10 devstack sudo[105206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:10:11 devstack sudo[105206]: pam_unix(sudo:session): session closed for user root Jul 10 16:10:11 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a9d27871-ba1d-4199-9b96-d1d42bd1cc8d tempest-CreateVolumesFromSnapshotTest-1269546565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-32deda80-ca9f-400f-9558-cc056adb0195" returned: 0 in 0.749s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:10:11 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a9d27871-ba1d-4199-9b96-d1d42bd1cc8d tempest-CreateVolumesFromSnapshotTest-1269546565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-32deda80-ca9f-400f-9558-cc056adb0195 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:10:11 devstack sudo[105211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-32deda80-ca9f-400f-9558-cc056adb0195 Jul 10 16:10:11 devstack sudo[105211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:10:11 devstack sudo[105211]: pam_unix(sudo:session): session closed for user root Jul 10 16:10:11 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a9d27871-ba1d-4199-9b96-d1d42bd1cc8d tempest-CreateVolumesFromSnapshotTest-1269546565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-32deda80-ca9f-400f-9558-cc056adb0195" returned: 0 in 0.631s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:10:11 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-a9d27871-ba1d-4199-9b96-d1d42bd1cc8d tempest-CreateVolumesFromSnapshotTest-1269546565 None] Lock "cinder-quobyte-32deda80-ca9f-400f-9558-cc056adb0195" released by "delete_volume" :: held 1.419s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:10:11 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-a9d27871-ba1d-4199-9b96-d1d42bd1cc8d tempest-CreateVolumesFromSnapshotTest-1269546565 None] Created reservations ['4dfeae6f-c2a1-443f-804a-71f98e28de70', '9a7cde4b-c1c6-4c02-b6e6-d355c9541739', 'c5424c35-e427-4b50-bc36-3355b5fa433e', '461a8501-5402-4709-b383-fcffdfb77102'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:10:11 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-a9d27871-ba1d-4199-9b96-d1d42bd1cc8d tempest-CreateVolumesFromSnapshotTest-1269546565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:10:11 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-a9d27871-ba1d-4199-9b96-d1d42bd1cc8d tempest-CreateVolumesFromSnapshotTest-1269546565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:10:11 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-a9d27871-ba1d-4199-9b96-d1d42bd1cc8d tempest-CreateVolumesFromSnapshotTest-1269546565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:10:11 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-a9d27871-ba1d-4199-9b96-d1d42bd1cc8d tempest-CreateVolumesFromSnapshotTest-1269546565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:10:11 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-a9d27871-ba1d-4199-9b96-d1d42bd1cc8d tempest-CreateVolumesFromSnapshotTest-1269546565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:10:11 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a9d27871-ba1d-4199-9b96-d1d42bd1cc8d tempest-CreateVolumesFromSnapshotTest-1269546565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:10:11 devstack sudo[105214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:10:11 devstack sudo[105214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:10:12 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-c47dd830-4d66-47fe-812f-00b276d1791e tempest-CreateVolumesFromSnapshotTest-1269546565 None] Acquiring lock "cinder-a0fdb24f-4b19-4934-8ba3-3ac5400d3c19-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:10:12 devstack sudo[105214]: pam_unix(sudo:session): session closed for user root Jul 10 16:10:12 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a9d27871-ba1d-4199-9b96-d1d42bd1cc8d tempest-CreateVolumesFromSnapshotTest-1269546565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.647s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:10:12 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-a9d27871-ba1d-4199-9b96-d1d42bd1cc8d tempest-CreateVolumesFromSnapshotTest-1269546565 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:10:12 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-c47dd830-4d66-47fe-812f-00b276d1791e tempest-CreateVolumesFromSnapshotTest-1269546565 None] Lock "cinder-a0fdb24f-4b19-4934-8ba3-3ac5400d3c19-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:10:12 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-a9d27871-ba1d-4199-9b96-d1d42bd1cc8d tempest-CreateVolumesFromSnapshotTest-1269546565 None] Deleted volume successfully. Jul 10 16:10:12 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-a9d27871-ba1d-4199-9b96-d1d42bd1cc8d tempest-CreateVolumesFromSnapshotTest-1269546565 None] Lock "cinder-32deda80-ca9f-400f-9558-cc056adb0195-delete_volume" released by "delete_volume" :: held 2.257s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:10:12 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-c47dd830-4d66-47fe-812f-00b276d1791e tempest-CreateVolumesFromSnapshotTest-1269546565 None] Acquiring lock "cinder-quobyte-a0fdb24f-4b19-4934-8ba3-3ac5400d3c19" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:10:12 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-c47dd830-4d66-47fe-812f-00b276d1791e tempest-CreateVolumesFromSnapshotTest-1269546565 None] Lock "cinder-quobyte-a0fdb24f-4b19-4934-8ba3-3ac5400d3c19" acquired by "delete_volume" :: waited 0.013s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:10:12 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dabe1fe-c434-49cb-afce-0bf3c2d0f76f]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:10:12 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c47dd830-4d66-47fe-812f-00b276d1791e tempest-CreateVolumesFromSnapshotTest-1269546565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a0fdb24f-4b19-4934-8ba3-3ac5400d3c19 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:10:12 devstack sudo[105219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a0fdb24f-4b19-4934-8ba3-3ac5400d3c19 Jul 10 16:10:12 devstack sudo[105219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:10:13 devstack sudo[105219]: pam_unix(sudo:session): session closed for user root Jul 10 16:10:13 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c47dd830-4d66-47fe-812f-00b276d1791e tempest-CreateVolumesFromSnapshotTest-1269546565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a0fdb24f-4b19-4934-8ba3-3ac5400d3c19" returned: 0 in 0.731s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:10:13 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c47dd830-4d66-47fe-812f-00b276d1791e tempest-CreateVolumesFromSnapshotTest-1269546565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a0fdb24f-4b19-4934-8ba3-3ac5400d3c19 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:10:13 devstack sudo[105224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a0fdb24f-4b19-4934-8ba3-3ac5400d3c19 Jul 10 16:10:13 devstack sudo[105224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:10:13 devstack sudo[105224]: pam_unix(sudo:session): session closed for user root Jul 10 16:10:13 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c47dd830-4d66-47fe-812f-00b276d1791e tempest-CreateVolumesFromSnapshotTest-1269546565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a0fdb24f-4b19-4934-8ba3-3ac5400d3c19" returned: 0 in 0.639s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:10:14 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-c47dd830-4d66-47fe-812f-00b276d1791e tempest-CreateVolumesFromSnapshotTest-1269546565 None] Lock "cinder-quobyte-a0fdb24f-4b19-4934-8ba3-3ac5400d3c19" released by "delete_volume" :: held 1.411s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:10:14 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-c47dd830-4d66-47fe-812f-00b276d1791e tempest-CreateVolumesFromSnapshotTest-1269546565 None] Created reservations ['6b187758-d597-4f5b-a636-285b9a8bada5', '677927a9-404d-4124-a0ba-a8a7caa8e9e5', '9301ca7a-495c-4a82-be20-227b9e975143', 'e2e61297-49a9-414e-ac90-4585344b9782'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:10:14 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-c47dd830-4d66-47fe-812f-00b276d1791e tempest-CreateVolumesFromSnapshotTest-1269546565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:10:14 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-c47dd830-4d66-47fe-812f-00b276d1791e tempest-CreateVolumesFromSnapshotTest-1269546565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:10:14 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-c47dd830-4d66-47fe-812f-00b276d1791e tempest-CreateVolumesFromSnapshotTest-1269546565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:10:14 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-c47dd830-4d66-47fe-812f-00b276d1791e tempest-CreateVolumesFromSnapshotTest-1269546565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:10:14 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-c47dd830-4d66-47fe-812f-00b276d1791e tempest-CreateVolumesFromSnapshotTest-1269546565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:10:14 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c47dd830-4d66-47fe-812f-00b276d1791e tempest-CreateVolumesFromSnapshotTest-1269546565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:10:14 devstack sudo[105228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:10:14 devstack sudo[105228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:10:14 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-9e4335e4-75c3-40d1-8929-ba8812991d27 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Acquiring lock "cinder-576db099-0d9e-4a7b-a6bd-c5bd294c71cb-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:10:14 devstack sudo[105228]: pam_unix(sudo:session): session closed for user root Jul 10 16:10:14 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c47dd830-4d66-47fe-812f-00b276d1791e tempest-CreateVolumesFromSnapshotTest-1269546565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.639s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:10:14 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-c47dd830-4d66-47fe-812f-00b276d1791e tempest-CreateVolumesFromSnapshotTest-1269546565 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:10:14 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-c47dd830-4d66-47fe-812f-00b276d1791e tempest-CreateVolumesFromSnapshotTest-1269546565 None] Deleted volume successfully. Jul 10 16:10:14 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-9e4335e4-75c3-40d1-8929-ba8812991d27 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Lock "cinder-576db099-0d9e-4a7b-a6bd-c5bd294c71cb-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:10:14 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-c47dd830-4d66-47fe-812f-00b276d1791e tempest-CreateVolumesFromSnapshotTest-1269546565 None] Lock "cinder-a0fdb24f-4b19-4934-8ba3-3ac5400d3c19-delete_volume" released by "delete_volume" :: held 2.254s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:10:14 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-9e4335e4-75c3-40d1-8929-ba8812991d27 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Acquiring lock "cinder-quobyte-576db099-0d9e-4a7b-a6bd-c5bd294c71cb" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:10:14 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-9e4335e4-75c3-40d1-8929-ba8812991d27 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Lock "cinder-quobyte-576db099-0d9e-4a7b-a6bd-c5bd294c71cb" acquired by "delete_volume" :: waited 0.014s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:10:14 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9f85fbc-165a-44f1-b8ea-abf0fea5a9d0]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:10:14 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-9e4335e4-75c3-40d1-8929-ba8812991d27 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-576db099-0d9e-4a7b-a6bd-c5bd294c71cb {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:10:14 devstack sudo[105232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-576db099-0d9e-4a7b-a6bd-c5bd294c71cb Jul 10 16:10:14 devstack sudo[105232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:10:15 devstack sudo[105232]: pam_unix(sudo:session): session closed for user root Jul 10 16:10:15 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-9e4335e4-75c3-40d1-8929-ba8812991d27 tempest-CreateVolumesFromSnapshotTest-1269546565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-576db099-0d9e-4a7b-a6bd-c5bd294c71cb" returned: 0 in 0.744s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:10:15 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-9e4335e4-75c3-40d1-8929-ba8812991d27 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-576db099-0d9e-4a7b-a6bd-c5bd294c71cb {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:10:15 devstack sudo[105238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-576db099-0d9e-4a7b-a6bd-c5bd294c71cb Jul 10 16:10:15 devstack sudo[105238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:10:16 devstack sudo[105238]: pam_unix(sudo:session): session closed for user root Jul 10 16:10:16 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-9e4335e4-75c3-40d1-8929-ba8812991d27 tempest-CreateVolumesFromSnapshotTest-1269546565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-576db099-0d9e-4a7b-a6bd-c5bd294c71cb" returned: 0 in 0.628s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:10:16 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-9e4335e4-75c3-40d1-8929-ba8812991d27 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Lock "cinder-quobyte-576db099-0d9e-4a7b-a6bd-c5bd294c71cb" released by "delete_volume" :: held 1.409s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:10:16 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-9e4335e4-75c3-40d1-8929-ba8812991d27 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Created reservations ['07958288-f9d4-42a1-bfe8-60d465a595bd', '0cc7814a-89f0-4579-a25e-db2f9442c7cb', '2f810e41-1796-4cfb-8e99-c951b017de50', 'ca7ff92e-3544-4222-816b-76c3b3b94211'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:10:16 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-9e4335e4-75c3-40d1-8929-ba8812991d27 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:10:16 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-9e4335e4-75c3-40d1-8929-ba8812991d27 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:10:16 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-9e4335e4-75c3-40d1-8929-ba8812991d27 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:10:16 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-9e4335e4-75c3-40d1-8929-ba8812991d27 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:10:16 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-9e4335e4-75c3-40d1-8929-ba8812991d27 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:10:16 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-9e4335e4-75c3-40d1-8929-ba8812991d27 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:10:16 devstack sudo[105241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:10:16 devstack sudo[105241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:10:16 devstack sudo[105241]: pam_unix(sudo:session): session closed for user root Jul 10 16:10:16 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-1acdaa0f-83c1-4ff7-b6f3-7ba270bca783 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Acquiring lock "cinder-6af440ad-b37b-43ca-9da9-faf223e5d9e5-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:10:16 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-9e4335e4-75c3-40d1-8929-ba8812991d27 tempest-CreateVolumesFromSnapshotTest-1269546565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.646s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:10:16 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-9e4335e4-75c3-40d1-8929-ba8812991d27 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:10:16 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-9e4335e4-75c3-40d1-8929-ba8812991d27 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Deleted volume successfully. Jul 10 16:10:16 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-1acdaa0f-83c1-4ff7-b6f3-7ba270bca783 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Lock "cinder-6af440ad-b37b-43ca-9da9-faf223e5d9e5-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:10:17 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-9e4335e4-75c3-40d1-8929-ba8812991d27 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Lock "cinder-576db099-0d9e-4a7b-a6bd-c5bd294c71cb-delete_volume" released by "delete_volume" :: held 2.250s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:10:17 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-1acdaa0f-83c1-4ff7-b6f3-7ba270bca783 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Acquiring lock "cinder-quobyte-6af440ad-b37b-43ca-9da9-faf223e5d9e5" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:10:17 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-1acdaa0f-83c1-4ff7-b6f3-7ba270bca783 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Lock "cinder-quobyte-6af440ad-b37b-43ca-9da9-faf223e5d9e5" acquired by "delete_volume" :: waited 0.014s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:10:17 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceee2d65-e3fb-4e5f-b838-0d59fbb0760b]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:10:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-1acdaa0f-83c1-4ff7-b6f3-7ba270bca783 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6af440ad-b37b-43ca-9da9-faf223e5d9e5 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:10:17 devstack sudo[105244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6af440ad-b37b-43ca-9da9-faf223e5d9e5 Jul 10 16:10:17 devstack sudo[105244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:10:17 devstack cinder-volume[87420]: DEBUG oslo_service.periodic_task [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87420) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 16:10:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:10:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:10:17 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:10:17 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:10:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:10:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:10:17 devstack sudo[105246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:10:17 devstack sudo[105246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:10:17 devstack sudo[105244]: pam_unix(sudo:session): session closed for user root Jul 10 16:10:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-1acdaa0f-83c1-4ff7-b6f3-7ba270bca783 tempest-CreateVolumesFromSnapshotTest-1269546565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6af440ad-b37b-43ca-9da9-faf223e5d9e5" returned: 0 in 0.752s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:10:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-1acdaa0f-83c1-4ff7-b6f3-7ba270bca783 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6af440ad-b37b-43ca-9da9-faf223e5d9e5 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:10:17 devstack sudo[105251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6af440ad-b37b-43ca-9da9-faf223e5d9e5 Jul 10 16:10:17 devstack sudo[105251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:10:18 devstack sudo[105246]: pam_unix(sudo:session): session closed for user root Jul 10 16:10:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.658s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:10:18 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:10:18 devstack cinder-volume[87420]: DEBUG oslo_service.periodic_task [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Running periodic task VolumeManager._thread_info {{(pid=87420) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 16:10:18 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] thread count: 29 {{(pid=87420) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 16:10:18 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] thread info: [<_MainThread(MainThread, started 133639250378880)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87420) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 16:10:18 devstack sudo[105251]: pam_unix(sudo:session): session closed for user root Jul 10 16:10:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-1acdaa0f-83c1-4ff7-b6f3-7ba270bca783 tempest-CreateVolumesFromSnapshotTest-1269546565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6af440ad-b37b-43ca-9da9-faf223e5d9e5" returned: 0 in 0.644s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:10:18 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-1acdaa0f-83c1-4ff7-b6f3-7ba270bca783 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Lock "cinder-quobyte-6af440ad-b37b-43ca-9da9-faf223e5d9e5" released by "delete_volume" :: held 1.432s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:10:18 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-1acdaa0f-83c1-4ff7-b6f3-7ba270bca783 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Created reservations ['881aaaa0-0495-4e4a-8718-fc1b14ef8046', '63892226-05ed-418a-9a2a-8d54dc3bc1a6', '6da799ab-5822-4616-8b2c-07580a6e750e', '74af06b8-bc46-43d3-b333-c404f17a8a62'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:10:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-1acdaa0f-83c1-4ff7-b6f3-7ba270bca783 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:10:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-1acdaa0f-83c1-4ff7-b6f3-7ba270bca783 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:10:18 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-1acdaa0f-83c1-4ff7-b6f3-7ba270bca783 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:10:18 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-1acdaa0f-83c1-4ff7-b6f3-7ba270bca783 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:10:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-1acdaa0f-83c1-4ff7-b6f3-7ba270bca783 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:10:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-1acdaa0f-83c1-4ff7-b6f3-7ba270bca783 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:10:18 devstack sudo[105255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:10:18 devstack sudo[105255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:10:19 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-b5ce57e7-2dc0-4b28-9dd0-3595f39b5a40 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Acquiring lock "cinder-b4bc29c7-075d-4220-8c2f-77bcd1e1da12-delete_snapshot" by "delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:10:19 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-b5ce57e7-2dc0-4b28-9dd0-3595f39b5a40 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Lock "cinder-b4bc29c7-075d-4220-8c2f-77bcd1e1da12-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:10:19 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-b5ce57e7-2dc0-4b28-9dd0-3595f39b5a40 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Acquiring lock "cinder-quobyte-6fa8f800-3273-4ba7-924b-9448265a2bcc" by "delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:10:19 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-b5ce57e7-2dc0-4b28-9dd0-3595f39b5a40 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Lock "cinder-quobyte-6fa8f800-3273-4ba7-924b-9448265a2bcc" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:10:19 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-b5ce57e7-2dc0-4b28-9dd0-3595f39b5a40 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Acquiring lock "cinder-quobyte-b4bc29c7-075d-4220-8c2f-77bcd1e1da12" by "_delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:10:19 devstack sudo[105255]: pam_unix(sudo:session): session closed for user root Jul 10 16:10:19 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-1acdaa0f-83c1-4ff7-b6f3-7ba270bca783 tempest-CreateVolumesFromSnapshotTest-1269546565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.657s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:10:19 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-1acdaa0f-83c1-4ff7-b6f3-7ba270bca783 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:10:19 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-1acdaa0f-83c1-4ff7-b6f3-7ba270bca783 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Deleted volume successfully. Jul 10 16:10:19 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-b5ce57e7-2dc0-4b28-9dd0-3595f39b5a40 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Lock "cinder-quobyte-b4bc29c7-075d-4220-8c2f-77bcd1e1da12" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:10:19 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-b5ce57e7-2dc0-4b28-9dd0-3595f39b5a40 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Deleting offline snapshot b4bc29c7-075d-4220-8c2f-77bcd1e1da12 of volume 6fa8f800-3273-4ba7-924b-9448265a2bcc {{(pid=87420) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 16:10:19 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-b5ce57e7-2dc0-4b28-9dd0-3595f39b5a40 tempest-CreateVolumesFromSnapshotTest-1269546565 None] snapshot_file for this snap is: volume-6fa8f800-3273-4ba7-924b-9448265a2bcc.b4bc29c7-075d-4220-8c2f-77bcd1e1da12 {{(pid=87420) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 16:10:19 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-1acdaa0f-83c1-4ff7-b6f3-7ba270bca783 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Lock "cinder-6af440ad-b37b-43ca-9da9-faf223e5d9e5-delete_volume" released by "delete_volume" :: held 2.298s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:10:19 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[075d5d35-e914-4a3c-be44-0c5cbd55bfad]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:10:19 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-b5ce57e7-2dc0-4b28-9dd0-3595f39b5a40 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6fa8f800-3273-4ba7-924b-9448265a2bcc.b4bc29c7-075d-4220-8c2f-77bcd1e1da12 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:10:19 devstack sudo[105258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6fa8f800-3273-4ba7-924b-9448265a2bcc.b4bc29c7-075d-4220-8c2f-77bcd1e1da12 Jul 10 16:10:19 devstack sudo[105258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:10:20 devstack sudo[105258]: pam_unix(sudo:session): session closed for user root Jul 10 16:10:20 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-b5ce57e7-2dc0-4b28-9dd0-3595f39b5a40 tempest-CreateVolumesFromSnapshotTest-1269546565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6fa8f800-3273-4ba7-924b-9448265a2bcc.b4bc29c7-075d-4220-8c2f-77bcd1e1da12" returned: 0 in 0.751s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:10:20 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-b5ce57e7-2dc0-4b28-9dd0-3595f39b5a40 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6fa8f800-3273-4ba7-924b-9448265a2bcc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87420) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 16:10:20 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[8971aa59-6538-4c5b-b468-2353fe8345ab]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:10:20 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-b5ce57e7-2dc0-4b28-9dd0-3595f39b5a40 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6fa8f800-3273-4ba7-924b-9448265a2bcc {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:10:20 devstack sudo[105263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6fa8f800-3273-4ba7-924b-9448265a2bcc Jul 10 16:10:20 devstack sudo[105263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:10:20 devstack sudo[105263]: pam_unix(sudo:session): session closed for user root Jul 10 16:10:20 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-b5ce57e7-2dc0-4b28-9dd0-3595f39b5a40 tempest-CreateVolumesFromSnapshotTest-1269546565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6fa8f800-3273-4ba7-924b-9448265a2bcc" returned: 0 in 0.750s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:10:20 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-b5ce57e7-2dc0-4b28-9dd0-3595f39b5a40 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6fa8f800-3273-4ba7-924b-9448265a2bcc.b4bc29c7-075d-4220-8c2f-77bcd1e1da12 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:10:20 devstack sudo[105269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6fa8f800-3273-4ba7-924b-9448265a2bcc.b4bc29c7-075d-4220-8c2f-77bcd1e1da12 Jul 10 16:10:20 devstack sudo[105269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:10:21 devstack sudo[105269]: pam_unix(sudo:session): session closed for user root Jul 10 16:10:21 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-b5ce57e7-2dc0-4b28-9dd0-3595f39b5a40 tempest-CreateVolumesFromSnapshotTest-1269546565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6fa8f800-3273-4ba7-924b-9448265a2bcc.b4bc29c7-075d-4220-8c2f-77bcd1e1da12" returned: 0 in 0.736s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:10:21 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-b5ce57e7-2dc0-4b28-9dd0-3595f39b5a40 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6fa8f800-3273-4ba7-924b-9448265a2bcc.b4bc29c7-075d-4220-8c2f-77bcd1e1da12 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:10:21 devstack sudo[105274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6fa8f800-3273-4ba7-924b-9448265a2bcc.b4bc29c7-075d-4220-8c2f-77bcd1e1da12 Jul 10 16:10:21 devstack sudo[105274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:10:22 devstack sudo[105274]: pam_unix(sudo:session): session closed for user root Jul 10 16:10:22 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-b5ce57e7-2dc0-4b28-9dd0-3595f39b5a40 tempest-CreateVolumesFromSnapshotTest-1269546565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6fa8f800-3273-4ba7-924b-9448265a2bcc.b4bc29c7-075d-4220-8c2f-77bcd1e1da12" returned: 0 in 0.636s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:10:22 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-b5ce57e7-2dc0-4b28-9dd0-3595f39b5a40 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Lock "cinder-quobyte-b4bc29c7-075d-4220-8c2f-77bcd1e1da12" released by "_delete_snapshot" :: held 2.975s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:10:22 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-b5ce57e7-2dc0-4b28-9dd0-3595f39b5a40 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Lock "cinder-quobyte-6fa8f800-3273-4ba7-924b-9448265a2bcc" released by "delete_snapshot" :: held 3.003s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:10:22 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-b5ce57e7-2dc0-4b28-9dd0-3595f39b5a40 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Created reservations ['858234ae-29c3-4a13-9d44-b3d6f1b32aa8', '5e68dbbb-9fb1-4a8c-ae36-5f6fa4278fbd', 'eecfccf5-0fb8-4087-8c84-8624a685bfb2', 'b26f75a7-e059-4d1a-acb8-26e24c062c65'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:10:22 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-b5ce57e7-2dc0-4b28-9dd0-3595f39b5a40 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Delete snapshot completed successfully. Jul 10 16:10:22 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-b5ce57e7-2dc0-4b28-9dd0-3595f39b5a40 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Lock "cinder-b4bc29c7-075d-4220-8c2f-77bcd1e1da12-delete_snapshot" released by "delete_snapshot" :: held 3.130s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:10:23 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-d5215b2d-7666-434d-842c-b740682f75d5 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Acquiring lock "cinder-6fa8f800-3273-4ba7-924b-9448265a2bcc-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:10:23 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-d5215b2d-7666-434d-842c-b740682f75d5 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Lock "cinder-6fa8f800-3273-4ba7-924b-9448265a2bcc-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:10:23 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-d5215b2d-7666-434d-842c-b740682f75d5 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Acquiring lock "cinder-quobyte-6fa8f800-3273-4ba7-924b-9448265a2bcc" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:10:23 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-d5215b2d-7666-434d-842c-b740682f75d5 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Lock "cinder-quobyte-6fa8f800-3273-4ba7-924b-9448265a2bcc" acquired by "delete_volume" :: waited 0.015s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:10:23 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9590cb6-d8b2-4ec1-ba01-62a12dc6750d]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:10:23 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d5215b2d-7666-434d-842c-b740682f75d5 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6fa8f800-3273-4ba7-924b-9448265a2bcc {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:10:23 devstack sudo[105278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6fa8f800-3273-4ba7-924b-9448265a2bcc Jul 10 16:10:23 devstack sudo[105278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:10:24 devstack sudo[105278]: pam_unix(sudo:session): session closed for user root Jul 10 16:10:24 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d5215b2d-7666-434d-842c-b740682f75d5 tempest-CreateVolumesFromSnapshotTest-1269546565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6fa8f800-3273-4ba7-924b-9448265a2bcc" returned: 0 in 0.752s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:10:24 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d5215b2d-7666-434d-842c-b740682f75d5 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6fa8f800-3273-4ba7-924b-9448265a2bcc {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:10:24 devstack sudo[105284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6fa8f800-3273-4ba7-924b-9448265a2bcc Jul 10 16:10:24 devstack sudo[105284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:10:24 devstack sudo[105284]: pam_unix(sudo:session): session closed for user root Jul 10 16:10:24 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d5215b2d-7666-434d-842c-b740682f75d5 tempest-CreateVolumesFromSnapshotTest-1269546565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6fa8f800-3273-4ba7-924b-9448265a2bcc" returned: 0 in 0.640s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:10:24 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-d5215b2d-7666-434d-842c-b740682f75d5 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Lock "cinder-quobyte-6fa8f800-3273-4ba7-924b-9448265a2bcc" released by "delete_volume" :: held 1.449s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:10:25 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-d5215b2d-7666-434d-842c-b740682f75d5 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Created reservations ['336259cd-e55a-46bb-ba1d-2b8273b0e03d', 'ff22f0c2-54f5-4c96-bb54-7535f843c2d1', 'f9a6f24d-4346-4369-8755-e252e6050410', 'c4a95b8a-3205-4320-960b-bf2171329feb'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:10:25 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-d5215b2d-7666-434d-842c-b740682f75d5 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:10:25 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-d5215b2d-7666-434d-842c-b740682f75d5 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:10:25 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-d5215b2d-7666-434d-842c-b740682f75d5 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:10:25 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-d5215b2d-7666-434d-842c-b740682f75d5 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:10:25 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-d5215b2d-7666-434d-842c-b740682f75d5 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:10:25 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d5215b2d-7666-434d-842c-b740682f75d5 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:10:25 devstack sudo[105289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:10:25 devstack sudo[105289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:10:25 devstack sudo[105289]: pam_unix(sudo:session): session closed for user root Jul 10 16:10:25 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d5215b2d-7666-434d-842c-b740682f75d5 tempest-CreateVolumesFromSnapshotTest-1269546565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.641s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:10:25 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-d5215b2d-7666-434d-842c-b740682f75d5 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:10:25 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-d5215b2d-7666-434d-842c-b740682f75d5 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Deleted volume successfully. Jul 10 16:10:25 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-d5215b2d-7666-434d-842c-b740682f75d5 tempest-CreateVolumesFromSnapshotTest-1269546565 None] Lock "cinder-6fa8f800-3273-4ba7-924b-9448265a2bcc-delete_volume" released by "delete_volume" :: held 2.347s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:10:28 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-858267cb-c3b7-4857-893b-01d35d11b90f tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 16:10:28 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-858267cb-c3b7-4857-893b-01d35d11b90f tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Flow 'volume_create_manager' (1dfe6834-5476-45b8-a0d6-2be02b7bd1f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:10:28 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-858267cb-c3b7-4857-893b-01d35d11b90f tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef7ea9a7-694d-427e-99a8-70246693d08c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:10:28 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-858267cb-c3b7-4857-893b-01d35d11b90f tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef7ea9a7-694d-427e-99a8-70246693d08c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:10:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-48518193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52dc5771-2ea4-4111-bab2-699e969bd371,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d3104b7a71b4ec9bee14df5ea1336b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:10:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:10:28Z,use_quota=True,user_id='f5db39b283f646e5992ffff3ef9907b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:10:28 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-858267cb-c3b7-4857-893b-01d35d11b90f tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ea7f97a-66b9-4e80-8a82-1ab7e8353254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:10:28 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-858267cb-c3b7-4857-893b-01d35d11b90f tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ea7f97a-66b9-4e80-8a82-1ab7e8353254) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:10:28 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-858267cb-c3b7-4857-893b-01d35d11b90f tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5be5370-7edc-42cd-a1de-bd231e690354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:10:28 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-858267cb-c3b7-4857-893b-01d35d11b90f tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5be5370-7edc-42cd-a1de-bd231e690354) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52dc5771-2ea4-4111-bab2-699e969bd371', 'volume_name': 'volume-52dc5771-2ea4-4111-bab2-699e969bd371', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:10:28 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-858267cb-c3b7-4857-893b-01d35d11b90f tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a52b95af-317b-4b5e-93fb-17581a1b2182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:10:28 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-858267cb-c3b7-4857-893b-01d35d11b90f tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a52b95af-317b-4b5e-93fb-17581a1b2182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:10:28 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-858267cb-c3b7-4857-893b-01d35d11b90f tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df22e891-77f4-4a12-930d-6f01a5c3ba99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:10:28 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-858267cb-c3b7-4857-893b-01d35d11b90f tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Volume 52dc5771-2ea4-4111-bab2-699e969bd371: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52dc5771-2ea4-4111-bab2-699e969bd371', 'volume_size': 1} Jul 10 16:10:28 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-858267cb-c3b7-4857-893b-01d35d11b90f tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:10:28 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-858267cb-c3b7-4857-893b-01d35d11b90f tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:10:28 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-858267cb-c3b7-4857-893b-01d35d11b90f tempest-CreateVolumesFromSourceVolumeTest-135047111 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:10:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-48518193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52dc5771-2ea4-4111-bab2-699e969bd371,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d3104b7a71b4ec9bee14df5ea1336b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:10:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:10:28Z,use_quota=True,user_id='f5db39b283f646e5992ffff3ef9907b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 16:10:28 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-858267cb-c3b7-4857-893b-01d35d11b90f tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Creating volume 52dc5771-2ea4-4111-bab2-699e969bd371 {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 16:10:28 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-858267cb-c3b7-4857-893b-01d35d11b90f tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:10:28 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-858267cb-c3b7-4857-893b-01d35d11b90f tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:10:28 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-858267cb-c3b7-4857-893b-01d35d11b90f tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:10:28 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-858267cb-c3b7-4857-893b-01d35d11b90f tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:10:28 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-858267cb-c3b7-4857-893b-01d35d11b90f tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:10:28 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-858267cb-c3b7-4857-893b-01d35d11b90f tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 16:10:28 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-858267cb-c3b7-4857-893b-01d35d11b90f tempest-CreateVolumesFromSourceVolumeTest-135047111 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 16:10:28 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-858267cb-c3b7-4857-893b-01d35d11b90f tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-52dc5771-2ea4-4111-bab2-699e969bd371 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:10:28 devstack sudo[105292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-52dc5771-2ea4-4111-bab2-699e969bd371 1073741824 Jul 10 16:10:28 devstack sudo[105292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:10:28 devstack sudo[105292]: pam_unix(sudo:session): session closed for user root Jul 10 16:10:29 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-858267cb-c3b7-4857-893b-01d35d11b90f tempest-CreateVolumesFromSourceVolumeTest-135047111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-52dc5771-2ea4-4111-bab2-699e969bd371 1073741824" returned: 0 in 0.789s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:10:29 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-858267cb-c3b7-4857-893b-01d35d11b90f tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-52dc5771-2ea4-4111-bab2-699e969bd371 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:10:29 devstack sudo[105298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-52dc5771-2ea4-4111-bab2-699e969bd371 Jul 10 16:10:29 devstack sudo[105298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:10:29 devstack sudo[105298]: pam_unix(sudo:session): session closed for user root Jul 10 16:10:29 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-858267cb-c3b7-4857-893b-01d35d11b90f tempest-CreateVolumesFromSourceVolumeTest-135047111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-52dc5771-2ea4-4111-bab2-699e969bd371" returned: 0 in 0.629s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:10:29 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-858267cb-c3b7-4857-893b-01d35d11b90f tempest-CreateVolumesFromSourceVolumeTest-135047111 None] <== create_volume: return (1460ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 16:10:29 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-858267cb-c3b7-4857-893b-01d35d11b90f tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.463s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:10:29 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-858267cb-c3b7-4857-893b-01d35d11b90f tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df22e891-77f4-4a12-930d-6f01a5c3ba99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52dc5771-2ea4-4111-bab2-699e969bd371', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:10:29 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-858267cb-c3b7-4857-893b-01d35d11b90f tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b565c1e-e4f6-4a08-8849-ee26d8ccde32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:10:29 devstack cinder-volume[87420]: DEBUG dbcounter [-] [87420] Writing DB stats cinder:SELECT=77,cinder:UPDATE=134,cinder:DELETE=12,cinder:INSERT=28 {{(pid=87420) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 16:10:29 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-858267cb-c3b7-4857-893b-01d35d11b90f tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Volume volume-52dc5771-2ea4-4111-bab2-699e969bd371 (52dc5771-2ea4-4111-bab2-699e969bd371): created successfully Jul 10 16:10:29 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-858267cb-c3b7-4857-893b-01d35d11b90f tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b565c1e-e4f6-4a08-8849-ee26d8ccde32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:10:29 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-858267cb-c3b7-4857-893b-01d35d11b90f tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Flow 'volume_create_manager' (1dfe6834-5476-45b8-a0d6-2be02b7bd1f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:10:29 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-858267cb-c3b7-4857-893b-01d35d11b90f tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Created volume successfully. Jul 10 16:10:30 devstack cinder-volume[87420]: DEBUG dbcounter [-] [87420] Writing DB stats cinder:SELECT=99,cinder:UPDATE=129,cinder:INSERT=33,cinder:DELETE=12 {{(pid=87420) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 16:10:30 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-f31bdc6a-f96a-4dd9-9c47-50564747b806 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 16:10:30 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f31bdc6a-f96a-4dd9-9c47-50564747b806 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Flow 'volume_create_manager' (d9af6a70-5efd-4b2d-9078-2a43cd7f0a00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:10:30 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f31bdc6a-f96a-4dd9-9c47-50564747b806 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7595a4e3-40e0-499f-9bac-ec5cf36a6cbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:10:30 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f31bdc6a-f96a-4dd9-9c47-50564747b806 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7595a4e3-40e0-499f-9bac-ec5cf36a6cbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:10:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1989983750',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=509d8f4c-7775-40b4-a76d-2bf306597d8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d3104b7a71b4ec9bee14df5ea1336b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:10:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:10:31Z,use_quota=True,user_id='f5db39b283f646e5992ffff3ef9907b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:10:30 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f31bdc6a-f96a-4dd9-9c47-50564747b806 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0288e4d1-986f-459e-aa03-9d012a467c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:10:30 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f31bdc6a-f96a-4dd9-9c47-50564747b806 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0288e4d1-986f-459e-aa03-9d012a467c48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:10:30 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f31bdc6a-f96a-4dd9-9c47-50564747b806 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18bbf168-d134-41ab-92b0-e0010d363a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:10:30 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f31bdc6a-f96a-4dd9-9c47-50564747b806 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18bbf168-d134-41ab-92b0-e0010d363a70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '509d8f4c-7775-40b4-a76d-2bf306597d8c', 'volume_name': 'volume-509d8f4c-7775-40b4-a76d-2bf306597d8c', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:10:30 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f31bdc6a-f96a-4dd9-9c47-50564747b806 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72b6a909-eb78-47f5-a98e-20f717f745d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:10:30 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f31bdc6a-f96a-4dd9-9c47-50564747b806 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72b6a909-eb78-47f5-a98e-20f717f745d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:10:30 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f31bdc6a-f96a-4dd9-9c47-50564747b806 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2863864-4973-45bc-919b-829822e80b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:10:30 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-f31bdc6a-f96a-4dd9-9c47-50564747b806 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Volume 509d8f4c-7775-40b4-a76d-2bf306597d8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-509d8f4c-7775-40b4-a76d-2bf306597d8c', 'volume_size': 1} Jul 10 16:10:30 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-f31bdc6a-f96a-4dd9-9c47-50564747b806 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:10:30 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-f31bdc6a-f96a-4dd9-9c47-50564747b806 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:10:30 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-f31bdc6a-f96a-4dd9-9c47-50564747b806 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:10:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1989983750',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=509d8f4c-7775-40b4-a76d-2bf306597d8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d3104b7a71b4ec9bee14df5ea1336b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:10:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:10:31Z,use_quota=True,user_id='f5db39b283f646e5992ffff3ef9907b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 16:10:30 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-f31bdc6a-f96a-4dd9-9c47-50564747b806 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Creating volume 509d8f4c-7775-40b4-a76d-2bf306597d8c {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 16:10:30 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-f31bdc6a-f96a-4dd9-9c47-50564747b806 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:10:30 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-f31bdc6a-f96a-4dd9-9c47-50564747b806 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:10:30 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-f31bdc6a-f96a-4dd9-9c47-50564747b806 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:10:30 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-f31bdc6a-f96a-4dd9-9c47-50564747b806 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:10:30 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-f31bdc6a-f96a-4dd9-9c47-50564747b806 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:10:30 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-f31bdc6a-f96a-4dd9-9c47-50564747b806 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 16:10:30 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-f31bdc6a-f96a-4dd9-9c47-50564747b806 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 16:10:30 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f31bdc6a-f96a-4dd9-9c47-50564747b806 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-509d8f4c-7775-40b4-a76d-2bf306597d8c 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:10:30 devstack sudo[105301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-509d8f4c-7775-40b4-a76d-2bf306597d8c 1073741824 Jul 10 16:10:30 devstack sudo[105301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:10:30 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-d998d49a-f600-465a-92b5-2bbb55b34920 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 16:10:30 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d998d49a-f600-465a-92b5-2bbb55b34920 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Flow 'volume_create_manager' (ccb5edbc-b819-462f-8198-a3f5fefe8c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:10:30 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d998d49a-f600-465a-92b5-2bbb55b34920 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (425f9032-2871-4464-ad55-a8fc873f1587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:10:31 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d998d49a-f600-465a-92b5-2bbb55b34920 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (425f9032-2871-4464-ad55-a8fc873f1587) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:10:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-215381734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b5c99ff-1609-4e3b-b5ad-6805b4e6aaba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d3104b7a71b4ec9bee14df5ea1336b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:10:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:10:31Z,use_quota=True,user_id='f5db39b283f646e5992ffff3ef9907b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:10:31 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d998d49a-f600-465a-92b5-2bbb55b34920 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7df5515-74bb-450e-bf5c-0ba4a576c6e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:10:31 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d998d49a-f600-465a-92b5-2bbb55b34920 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7df5515-74bb-450e-bf5c-0ba4a576c6e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:10:31 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d998d49a-f600-465a-92b5-2bbb55b34920 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52bfde5c-f67d-4c0d-a0b7-0d1b1a782af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:10:31 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d998d49a-f600-465a-92b5-2bbb55b34920 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52bfde5c-f67d-4c0d-a0b7-0d1b1a782af4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b5c99ff-1609-4e3b-b5ad-6805b4e6aaba', 'volume_name': 'volume-3b5c99ff-1609-4e3b-b5ad-6805b4e6aaba', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:10:31 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d998d49a-f600-465a-92b5-2bbb55b34920 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a99288a9-40e4-4da7-becf-0e5d1de3a9ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:10:31 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d998d49a-f600-465a-92b5-2bbb55b34920 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a99288a9-40e4-4da7-becf-0e5d1de3a9ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:10:31 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d998d49a-f600-465a-92b5-2bbb55b34920 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f999437-35a2-424a-a2c7-deb075ce90bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:10:31 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-d998d49a-f600-465a-92b5-2bbb55b34920 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Volume 3b5c99ff-1609-4e3b-b5ad-6805b4e6aaba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b5c99ff-1609-4e3b-b5ad-6805b4e6aaba', 'volume_size': 1} Jul 10 16:10:31 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-d998d49a-f600-465a-92b5-2bbb55b34920 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:10:31 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3063b1d-fe33-4046-a0c3-c5f1a68c0518 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 16:10:31 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-e3063b1d-fe33-4046-a0c3-c5f1a68c0518 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Flow 'volume_create_manager' (38bdbe47-6337-4c71-98c7-15e3ae45d0b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:10:31 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-e3063b1d-fe33-4046-a0c3-c5f1a68c0518 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba1baaba-4143-4a94-bbaa-5abcf2737e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:10:31 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-e3063b1d-fe33-4046-a0c3-c5f1a68c0518 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba1baaba-4143-4a94-bbaa-5abcf2737e08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:10:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-662587094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=191573f5-6dde-4383-9172-e4aeb0c99ae0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d3104b7a71b4ec9bee14df5ea1336b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:10:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:10:31Z,use_quota=True,user_id='f5db39b283f646e5992ffff3ef9907b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:10:31 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-e3063b1d-fe33-4046-a0c3-c5f1a68c0518 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89e78201-014f-4c59-ae22-8e79e37b4abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:10:31 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-e3063b1d-fe33-4046-a0c3-c5f1a68c0518 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89e78201-014f-4c59-ae22-8e79e37b4abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:10:31 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-e3063b1d-fe33-4046-a0c3-c5f1a68c0518 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dd637cf-7fc2-4624-a6d8-e3f657256081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:10:31 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-e3063b1d-fe33-4046-a0c3-c5f1a68c0518 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dd637cf-7fc2-4624-a6d8-e3f657256081) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '191573f5-6dde-4383-9172-e4aeb0c99ae0', 'volume_name': 'volume-191573f5-6dde-4383-9172-e4aeb0c99ae0', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:10:31 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-e3063b1d-fe33-4046-a0c3-c5f1a68c0518 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ab7c22d-343d-4ee9-bf0e-652f63953b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:10:31 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-e3063b1d-fe33-4046-a0c3-c5f1a68c0518 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ab7c22d-343d-4ee9-bf0e-652f63953b89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:10:31 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-e3063b1d-fe33-4046-a0c3-c5f1a68c0518 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3da81d1-3e42-4c14-b201-6c5105c51726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:10:31 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-e3063b1d-fe33-4046-a0c3-c5f1a68c0518 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Volume 191573f5-6dde-4383-9172-e4aeb0c99ae0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-191573f5-6dde-4383-9172-e4aeb0c99ae0', 'volume_size': 1} Jul 10 16:10:31 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-e3063b1d-fe33-4046-a0c3-c5f1a68c0518 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:10:31 devstack sudo[105301]: pam_unix(sudo:session): session closed for user root Jul 10 16:10:31 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f31bdc6a-f96a-4dd9-9c47-50564747b806 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-509d8f4c-7775-40b4-a76d-2bf306597d8c 1073741824" returned: 0 in 0.923s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:10:31 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb412abb-0828-4e1c-a12d-3aa5955fde12 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 16:10:31 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-bb412abb-0828-4e1c-a12d-3aa5955fde12 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Flow 'volume_create_manager' (b3f2d736-0e64-415e-9cd9-2ba1159db8f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:10:31 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-bb412abb-0828-4e1c-a12d-3aa5955fde12 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56a1a621-a583-417b-85ea-a399125fea15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:10:31 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f31bdc6a-f96a-4dd9-9c47-50564747b806 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-509d8f4c-7775-40b4-a76d-2bf306597d8c {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:10:31 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-bb412abb-0828-4e1c-a12d-3aa5955fde12 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56a1a621-a583-417b-85ea-a399125fea15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:10:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-772494132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1feae0ec-66c9-481c-83a7-5789f368700d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d3104b7a71b4ec9bee14df5ea1336b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:10:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:10:32Z,use_quota=True,user_id='f5db39b283f646e5992ffff3ef9907b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:10:31 devstack sudo[105306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-509d8f4c-7775-40b4-a76d-2bf306597d8c Jul 10 16:10:31 devstack sudo[105306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:10:31 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-bb412abb-0828-4e1c-a12d-3aa5955fde12 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eace72d9-bd9d-43a1-aeec-15a35aea5fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:10:31 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-bb412abb-0828-4e1c-a12d-3aa5955fde12 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eace72d9-bd9d-43a1-aeec-15a35aea5fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:10:31 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-bb412abb-0828-4e1c-a12d-3aa5955fde12 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0cab34d-cf4f-41ae-9904-25df8d1235b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:10:31 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-bb412abb-0828-4e1c-a12d-3aa5955fde12 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0cab34d-cf4f-41ae-9904-25df8d1235b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1feae0ec-66c9-481c-83a7-5789f368700d', 'volume_name': 'volume-1feae0ec-66c9-481c-83a7-5789f368700d', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:10:31 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-bb412abb-0828-4e1c-a12d-3aa5955fde12 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04a151ca-0068-4ee7-9768-507eac0e2cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:10:31 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-bb412abb-0828-4e1c-a12d-3aa5955fde12 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04a151ca-0068-4ee7-9768-507eac0e2cb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:10:31 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-bb412abb-0828-4e1c-a12d-3aa5955fde12 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (638230aa-e7b9-4805-b22b-37b84357d7c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:10:31 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-bb412abb-0828-4e1c-a12d-3aa5955fde12 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Volume 1feae0ec-66c9-481c-83a7-5789f368700d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1feae0ec-66c9-481c-83a7-5789f368700d', 'volume_size': 1} Jul 10 16:10:31 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-bb412abb-0828-4e1c-a12d-3aa5955fde12 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:10:32 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-88a36073-8874-4a10-b969-c56798f1345a tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 16:10:32 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-88a36073-8874-4a10-b969-c56798f1345a tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Flow 'volume_create_manager' (c6701ef1-aa99-46b5-b3ba-002b7cb3d122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:10:32 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-88a36073-8874-4a10-b969-c56798f1345a tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b42eb4d9-44ca-4e1a-87c1-68b58dd7981a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:10:32 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-88a36073-8874-4a10-b969-c56798f1345a tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b42eb4d9-44ca-4e1a-87c1-68b58dd7981a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:10:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1008603700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03e10fa3-1318-4339-aaac-26b5c499c543,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d3104b7a71b4ec9bee14df5ea1336b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:10:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:10:32Z,use_quota=True,user_id='f5db39b283f646e5992ffff3ef9907b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:10:32 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-88a36073-8874-4a10-b969-c56798f1345a tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2663d64a-ceda-4399-ae6e-3998aa250b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:10:32 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-88a36073-8874-4a10-b969-c56798f1345a tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2663d64a-ceda-4399-ae6e-3998aa250b5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:10:32 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-88a36073-8874-4a10-b969-c56798f1345a tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b0bb667-b584-4df6-a4c9-41c297c8bb57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:10:32 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-88a36073-8874-4a10-b969-c56798f1345a tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b0bb667-b584-4df6-a4c9-41c297c8bb57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03e10fa3-1318-4339-aaac-26b5c499c543', 'volume_name': 'volume-03e10fa3-1318-4339-aaac-26b5c499c543', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:10:32 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-88a36073-8874-4a10-b969-c56798f1345a tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc92c680-174c-43b7-87fb-3a811efeb895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:10:32 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-88a36073-8874-4a10-b969-c56798f1345a tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc92c680-174c-43b7-87fb-3a811efeb895) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:10:32 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-88a36073-8874-4a10-b969-c56798f1345a tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b54257e-14ac-4b36-82eb-0bb950d010e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:10:32 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-88a36073-8874-4a10-b969-c56798f1345a tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Volume 03e10fa3-1318-4339-aaac-26b5c499c543: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03e10fa3-1318-4339-aaac-26b5c499c543', 'volume_size': 1} Jul 10 16:10:32 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-88a36073-8874-4a10-b969-c56798f1345a tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:10:32 devstack sudo[105306]: pam_unix(sudo:session): session closed for user root Jul 10 16:10:32 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f31bdc6a-f96a-4dd9-9c47-50564747b806 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-509d8f4c-7775-40b4-a76d-2bf306597d8c" returned: 0 in 0.662s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:10:32 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-f31bdc6a-f96a-4dd9-9c47-50564747b806 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] <== create_volume: return (1675ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 16:10:32 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-f31bdc6a-f96a-4dd9-9c47-50564747b806 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.678s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:10:32 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-d998d49a-f600-465a-92b5-2bbb55b34920 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.333s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:10:32 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-d998d49a-f600-465a-92b5-2bbb55b34920 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:10:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-215381734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b5c99ff-1609-4e3b-b5ad-6805b4e6aaba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d3104b7a71b4ec9bee14df5ea1336b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:10:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:10:31Z,use_quota=True,user_id='f5db39b283f646e5992ffff3ef9907b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 16:10:32 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-d998d49a-f600-465a-92b5-2bbb55b34920 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Creating volume 3b5c99ff-1609-4e3b-b5ad-6805b4e6aaba {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 16:10:32 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-d998d49a-f600-465a-92b5-2bbb55b34920 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:10:32 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-d998d49a-f600-465a-92b5-2bbb55b34920 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:10:32 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-d998d49a-f600-465a-92b5-2bbb55b34920 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:10:32 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-d998d49a-f600-465a-92b5-2bbb55b34920 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:10:32 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-d998d49a-f600-465a-92b5-2bbb55b34920 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:10:32 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-d998d49a-f600-465a-92b5-2bbb55b34920 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 16:10:32 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-d998d49a-f600-465a-92b5-2bbb55b34920 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 16:10:32 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d998d49a-f600-465a-92b5-2bbb55b34920 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3b5c99ff-1609-4e3b-b5ad-6805b4e6aaba 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:10:32 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f31bdc6a-f96a-4dd9-9c47-50564747b806 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2863864-4973-45bc-919b-829822e80b73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-509d8f4c-7775-40b4-a76d-2bf306597d8c', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:10:32 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f31bdc6a-f96a-4dd9-9c47-50564747b806 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ca97d43-8c57-42e4-9cf7-9f94e941fe4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:10:32 devstack sudo[105309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3b5c99ff-1609-4e3b-b5ad-6805b4e6aaba 1073741824 Jul 10 16:10:32 devstack sudo[105309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:10:32 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-f31bdc6a-f96a-4dd9-9c47-50564747b806 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Volume volume-509d8f4c-7775-40b4-a76d-2bf306597d8c (509d8f4c-7775-40b4-a76d-2bf306597d8c): created successfully Jul 10 16:10:32 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f31bdc6a-f96a-4dd9-9c47-50564747b806 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ca97d43-8c57-42e4-9cf7-9f94e941fe4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:10:32 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f31bdc6a-f96a-4dd9-9c47-50564747b806 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Flow 'volume_create_manager' (d9af6a70-5efd-4b2d-9078-2a43cd7f0a00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:10:32 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-f31bdc6a-f96a-4dd9-9c47-50564747b806 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Created volume successfully. Jul 10 16:10:33 devstack sudo[105309]: pam_unix(sudo:session): session closed for user root Jul 10 16:10:33 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d998d49a-f600-465a-92b5-2bbb55b34920 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3b5c99ff-1609-4e3b-b5ad-6805b4e6aaba 1073741824" returned: 0 in 0.810s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:10:33 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d998d49a-f600-465a-92b5-2bbb55b34920 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3b5c99ff-1609-4e3b-b5ad-6805b4e6aaba {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:10:33 devstack sudo[105315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3b5c99ff-1609-4e3b-b5ad-6805b4e6aaba Jul 10 16:10:33 devstack sudo[105315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:10:33 devstack sudo[105315]: pam_unix(sudo:session): session closed for user root Jul 10 16:10:33 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d998d49a-f600-465a-92b5-2bbb55b34920 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3b5c99ff-1609-4e3b-b5ad-6805b4e6aaba" returned: 0 in 0.635s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:10:33 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-d998d49a-f600-465a-92b5-2bbb55b34920 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] <== create_volume: return (1479ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 16:10:33 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-d998d49a-f600-465a-92b5-2bbb55b34920 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.482s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:10:33 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-e3063b1d-fe33-4046-a0c3-c5f1a68c0518 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.479s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:10:33 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-e3063b1d-fe33-4046-a0c3-c5f1a68c0518 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:10:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-662587094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=191573f5-6dde-4383-9172-e4aeb0c99ae0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d3104b7a71b4ec9bee14df5ea1336b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:10:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:10:31Z,use_quota=True,user_id='f5db39b283f646e5992ffff3ef9907b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 16:10:33 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-e3063b1d-fe33-4046-a0c3-c5f1a68c0518 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Creating volume 191573f5-6dde-4383-9172-e4aeb0c99ae0 {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 16:10:33 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-e3063b1d-fe33-4046-a0c3-c5f1a68c0518 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:10:33 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-e3063b1d-fe33-4046-a0c3-c5f1a68c0518 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:10:33 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-e3063b1d-fe33-4046-a0c3-c5f1a68c0518 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:10:33 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-e3063b1d-fe33-4046-a0c3-c5f1a68c0518 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:10:33 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-e3063b1d-fe33-4046-a0c3-c5f1a68c0518 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:10:33 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-e3063b1d-fe33-4046-a0c3-c5f1a68c0518 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 16:10:33 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-e3063b1d-fe33-4046-a0c3-c5f1a68c0518 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 16:10:33 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-e3063b1d-fe33-4046-a0c3-c5f1a68c0518 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-191573f5-6dde-4383-9172-e4aeb0c99ae0 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:10:33 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d998d49a-f600-465a-92b5-2bbb55b34920 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f999437-35a2-424a-a2c7-deb075ce90bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b5c99ff-1609-4e3b-b5ad-6805b4e6aaba', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:10:33 devstack sudo[105319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-191573f5-6dde-4383-9172-e4aeb0c99ae0 1073741824 Jul 10 16:10:33 devstack sudo[105319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:10:33 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d998d49a-f600-465a-92b5-2bbb55b34920 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6824a4e1-640f-4403-a9e4-a12447e62c32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:10:33 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-d998d49a-f600-465a-92b5-2bbb55b34920 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Volume volume-3b5c99ff-1609-4e3b-b5ad-6805b4e6aaba (3b5c99ff-1609-4e3b-b5ad-6805b4e6aaba): created successfully Jul 10 16:10:33 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d998d49a-f600-465a-92b5-2bbb55b34920 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6824a4e1-640f-4403-a9e4-a12447e62c32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:10:33 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d998d49a-f600-465a-92b5-2bbb55b34920 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Flow 'volume_create_manager' (ccb5edbc-b819-462f-8198-a3f5fefe8c9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:10:33 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-d998d49a-f600-465a-92b5-2bbb55b34920 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Created volume successfully. Jul 10 16:10:34 devstack sudo[105319]: pam_unix(sudo:session): session closed for user root Jul 10 16:10:34 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-e3063b1d-fe33-4046-a0c3-c5f1a68c0518 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-191573f5-6dde-4383-9172-e4aeb0c99ae0 1073741824" returned: 0 in 0.808s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:10:34 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-e3063b1d-fe33-4046-a0c3-c5f1a68c0518 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-191573f5-6dde-4383-9172-e4aeb0c99ae0 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:10:34 devstack sudo[105324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-191573f5-6dde-4383-9172-e4aeb0c99ae0 Jul 10 16:10:34 devstack sudo[105324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:10:35 devstack sudo[105324]: pam_unix(sudo:session): session closed for user root Jul 10 16:10:35 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-e3063b1d-fe33-4046-a0c3-c5f1a68c0518 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-191573f5-6dde-4383-9172-e4aeb0c99ae0" returned: 0 in 0.627s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:10:35 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-e3063b1d-fe33-4046-a0c3-c5f1a68c0518 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] <== create_volume: return (1470ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 16:10:35 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-e3063b1d-fe33-4046-a0c3-c5f1a68c0518 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.473s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:10:35 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-bb412abb-0828-4e1c-a12d-3aa5955fde12 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.556s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:10:35 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-bb412abb-0828-4e1c-a12d-3aa5955fde12 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:10:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-772494132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1feae0ec-66c9-481c-83a7-5789f368700d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d3104b7a71b4ec9bee14df5ea1336b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:10:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:10:32Z,use_quota=True,user_id='f5db39b283f646e5992ffff3ef9907b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 16:10:35 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-bb412abb-0828-4e1c-a12d-3aa5955fde12 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Creating volume 1feae0ec-66c9-481c-83a7-5789f368700d {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 16:10:35 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-bb412abb-0828-4e1c-a12d-3aa5955fde12 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:10:35 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-bb412abb-0828-4e1c-a12d-3aa5955fde12 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:10:35 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-bb412abb-0828-4e1c-a12d-3aa5955fde12 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:10:35 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-bb412abb-0828-4e1c-a12d-3aa5955fde12 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:10:35 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-bb412abb-0828-4e1c-a12d-3aa5955fde12 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:10:35 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-bb412abb-0828-4e1c-a12d-3aa5955fde12 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 16:10:35 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-bb412abb-0828-4e1c-a12d-3aa5955fde12 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 16:10:35 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-bb412abb-0828-4e1c-a12d-3aa5955fde12 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1feae0ec-66c9-481c-83a7-5789f368700d 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:10:35 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-e3063b1d-fe33-4046-a0c3-c5f1a68c0518 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3da81d1-3e42-4c14-b201-6c5105c51726) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-191573f5-6dde-4383-9172-e4aeb0c99ae0', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:10:35 devstack sudo[105327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1feae0ec-66c9-481c-83a7-5789f368700d 1073741824 Jul 10 16:10:35 devstack sudo[105327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:10:35 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-e3063b1d-fe33-4046-a0c3-c5f1a68c0518 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ea418ff-f6e4-4a51-9f88-3ff17c27eb62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:10:35 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-e3063b1d-fe33-4046-a0c3-c5f1a68c0518 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Volume volume-191573f5-6dde-4383-9172-e4aeb0c99ae0 (191573f5-6dde-4383-9172-e4aeb0c99ae0): created successfully Jul 10 16:10:35 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-e3063b1d-fe33-4046-a0c3-c5f1a68c0518 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ea418ff-f6e4-4a51-9f88-3ff17c27eb62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:10:35 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-e3063b1d-fe33-4046-a0c3-c5f1a68c0518 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Flow 'volume_create_manager' (38bdbe47-6337-4c71-98c7-15e3ae45d0b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:10:35 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-e3063b1d-fe33-4046-a0c3-c5f1a68c0518 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Created volume successfully. Jul 10 16:10:36 devstack sudo[105327]: pam_unix(sudo:session): session closed for user root Jul 10 16:10:36 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-bb412abb-0828-4e1c-a12d-3aa5955fde12 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1feae0ec-66c9-481c-83a7-5789f368700d 1073741824" returned: 0 in 0.798s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:10:36 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-bb412abb-0828-4e1c-a12d-3aa5955fde12 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1feae0ec-66c9-481c-83a7-5789f368700d {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:10:36 devstack sudo[105332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1feae0ec-66c9-481c-83a7-5789f368700d Jul 10 16:10:36 devstack sudo[105332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:10:36 devstack sudo[105332]: pam_unix(sudo:session): session closed for user root Jul 10 16:10:36 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-bb412abb-0828-4e1c-a12d-3aa5955fde12 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1feae0ec-66c9-481c-83a7-5789f368700d" returned: 0 in 0.643s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:10:36 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-bb412abb-0828-4e1c-a12d-3aa5955fde12 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] <== create_volume: return (1476ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 16:10:36 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-bb412abb-0828-4e1c-a12d-3aa5955fde12 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.479s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:10:36 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-88a36073-8874-4a10-b969-c56798f1345a tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.720s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:10:36 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-88a36073-8874-4a10-b969-c56798f1345a tempest-CreateVolumesFromSourceVolumeTest-135047111 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:10:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1008603700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03e10fa3-1318-4339-aaac-26b5c499c543,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d3104b7a71b4ec9bee14df5ea1336b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:10:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:10:32Z,use_quota=True,user_id='f5db39b283f646e5992ffff3ef9907b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 16:10:36 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-88a36073-8874-4a10-b969-c56798f1345a tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Creating volume 03e10fa3-1318-4339-aaac-26b5c499c543 {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 16:10:36 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-88a36073-8874-4a10-b969-c56798f1345a tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:10:36 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-88a36073-8874-4a10-b969-c56798f1345a tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:10:36 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-88a36073-8874-4a10-b969-c56798f1345a tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:10:36 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-88a36073-8874-4a10-b969-c56798f1345a tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:10:36 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-88a36073-8874-4a10-b969-c56798f1345a tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:10:36 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-88a36073-8874-4a10-b969-c56798f1345a tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 16:10:36 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-88a36073-8874-4a10-b969-c56798f1345a tempest-CreateVolumesFromSourceVolumeTest-135047111 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 16:10:36 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-88a36073-8874-4a10-b969-c56798f1345a tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-03e10fa3-1318-4339-aaac-26b5c499c543 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:10:36 devstack sudo[105335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-03e10fa3-1318-4339-aaac-26b5c499c543 1073741824 Jul 10 16:10:36 devstack sudo[105335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:10:36 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-bb412abb-0828-4e1c-a12d-3aa5955fde12 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (638230aa-e7b9-4805-b22b-37b84357d7c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1feae0ec-66c9-481c-83a7-5789f368700d', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:10:36 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-bb412abb-0828-4e1c-a12d-3aa5955fde12 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28db716b-e0c0-4aa4-a6a9-893cc75ac4d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:10:36 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-bb412abb-0828-4e1c-a12d-3aa5955fde12 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Volume volume-1feae0ec-66c9-481c-83a7-5789f368700d (1feae0ec-66c9-481c-83a7-5789f368700d): created successfully Jul 10 16:10:36 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-bb412abb-0828-4e1c-a12d-3aa5955fde12 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28db716b-e0c0-4aa4-a6a9-893cc75ac4d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:10:36 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-bb412abb-0828-4e1c-a12d-3aa5955fde12 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Flow 'volume_create_manager' (b3f2d736-0e64-415e-9cd9-2ba1159db8f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:10:36 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-bb412abb-0828-4e1c-a12d-3aa5955fde12 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Created volume successfully. Jul 10 16:10:37 devstack sudo[105335]: pam_unix(sudo:session): session closed for user root Jul 10 16:10:37 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-88a36073-8874-4a10-b969-c56798f1345a tempest-CreateVolumesFromSourceVolumeTest-135047111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-03e10fa3-1318-4339-aaac-26b5c499c543 1073741824" returned: 0 in 0.804s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:10:37 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-88a36073-8874-4a10-b969-c56798f1345a tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-03e10fa3-1318-4339-aaac-26b5c499c543 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:10:37 devstack sudo[105340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-03e10fa3-1318-4339-aaac-26b5c499c543 Jul 10 16:10:37 devstack sudo[105340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:10:38 devstack sudo[105340]: pam_unix(sudo:session): session closed for user root Jul 10 16:10:38 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-88a36073-8874-4a10-b969-c56798f1345a tempest-CreateVolumesFromSourceVolumeTest-135047111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-03e10fa3-1318-4339-aaac-26b5c499c543" returned: 0 in 0.634s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:10:38 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-88a36073-8874-4a10-b969-c56798f1345a tempest-CreateVolumesFromSourceVolumeTest-135047111 None] <== create_volume: return (1474ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 16:10:38 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-88a36073-8874-4a10-b969-c56798f1345a tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.477s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:10:38 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-88a36073-8874-4a10-b969-c56798f1345a tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b54257e-14ac-4b36-82eb-0bb950d010e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03e10fa3-1318-4339-aaac-26b5c499c543', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:10:38 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-88a36073-8874-4a10-b969-c56798f1345a tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (957bea9c-bc7e-49a2-9408-45666e2916f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:10:38 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-88a36073-8874-4a10-b969-c56798f1345a tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Volume volume-03e10fa3-1318-4339-aaac-26b5c499c543 (03e10fa3-1318-4339-aaac-26b5c499c543): created successfully Jul 10 16:10:38 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-88a36073-8874-4a10-b969-c56798f1345a tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (957bea9c-bc7e-49a2-9408-45666e2916f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:10:38 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-88a36073-8874-4a10-b969-c56798f1345a tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Flow 'volume_create_manager' (c6701ef1-aa99-46b5-b3ba-002b7cb3d122) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:10:38 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-88a36073-8874-4a10-b969-c56798f1345a tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Created volume successfully. Jul 10 16:10:38 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-4b76eb44-ac66-4a94-89f2-4d34ad286819 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Acquiring lock "cinder-03e10fa3-1318-4339-aaac-26b5c499c543-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:10:38 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-4b76eb44-ac66-4a94-89f2-4d34ad286819 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Lock "cinder-03e10fa3-1318-4339-aaac-26b5c499c543-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:10:38 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-4b76eb44-ac66-4a94-89f2-4d34ad286819 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Acquiring lock "cinder-quobyte-03e10fa3-1318-4339-aaac-26b5c499c543" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:10:38 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-4b76eb44-ac66-4a94-89f2-4d34ad286819 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Lock "cinder-quobyte-03e10fa3-1318-4339-aaac-26b5c499c543" acquired by "delete_volume" :: waited 0.016s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:10:38 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[28476d7b-a114-456f-8bea-5a080583fa13]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:10:38 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4b76eb44-ac66-4a94-89f2-4d34ad286819 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-03e10fa3-1318-4339-aaac-26b5c499c543 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:10:38 devstack sudo[105379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-03e10fa3-1318-4339-aaac-26b5c499c543 Jul 10 16:10:38 devstack sudo[105379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:10:39 devstack sudo[105379]: pam_unix(sudo:session): session closed for user root Jul 10 16:10:39 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4b76eb44-ac66-4a94-89f2-4d34ad286819 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-03e10fa3-1318-4339-aaac-26b5c499c543" returned: 0 in 0.733s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:10:39 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4b76eb44-ac66-4a94-89f2-4d34ad286819 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-03e10fa3-1318-4339-aaac-26b5c499c543 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:10:39 devstack sudo[105384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-03e10fa3-1318-4339-aaac-26b5c499c543 Jul 10 16:10:39 devstack sudo[105384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:10:40 devstack sudo[105384]: pam_unix(sudo:session): session closed for user root Jul 10 16:10:40 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4b76eb44-ac66-4a94-89f2-4d34ad286819 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-03e10fa3-1318-4339-aaac-26b5c499c543" returned: 0 in 0.646s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:10:40 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-4b76eb44-ac66-4a94-89f2-4d34ad286819 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Lock "cinder-quobyte-03e10fa3-1318-4339-aaac-26b5c499c543" released by "delete_volume" :: held 1.419s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:10:40 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-4b76eb44-ac66-4a94-89f2-4d34ad286819 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Created reservations ['afbeb328-2a3b-4298-9f24-d0c35b751f92', '7d9a55c6-787d-4c8c-9a4e-c32bc1c1c83e', '3d83fb8b-4926-48bb-b714-ac87c7d98657', '43438221-9287-4492-ac8b-9f037544a484'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:10:40 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-4b76eb44-ac66-4a94-89f2-4d34ad286819 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:10:40 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-4b76eb44-ac66-4a94-89f2-4d34ad286819 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:10:40 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-4b76eb44-ac66-4a94-89f2-4d34ad286819 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:10:40 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-4b76eb44-ac66-4a94-89f2-4d34ad286819 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:10:40 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-4b76eb44-ac66-4a94-89f2-4d34ad286819 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:10:40 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4b76eb44-ac66-4a94-89f2-4d34ad286819 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:10:40 devstack sudo[105387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:10:40 devstack sudo[105387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:10:40 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-af2510d7-60ff-4df5-b64b-4c78c722d25f tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Acquiring lock "cinder-1feae0ec-66c9-481c-83a7-5789f368700d-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:10:40 devstack sudo[105387]: pam_unix(sudo:session): session closed for user root Jul 10 16:10:40 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-af2510d7-60ff-4df5-b64b-4c78c722d25f tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Lock "cinder-1feae0ec-66c9-481c-83a7-5789f368700d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:10:40 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4b76eb44-ac66-4a94-89f2-4d34ad286819 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.656s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:10:40 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-4b76eb44-ac66-4a94-89f2-4d34ad286819 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:10:40 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-4b76eb44-ac66-4a94-89f2-4d34ad286819 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Deleted volume successfully. Jul 10 16:10:40 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-4b76eb44-ac66-4a94-89f2-4d34ad286819 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Lock "cinder-03e10fa3-1318-4339-aaac-26b5c499c543-delete_volume" released by "delete_volume" :: held 2.260s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:10:40 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-af2510d7-60ff-4df5-b64b-4c78c722d25f tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Acquiring lock "cinder-quobyte-1feae0ec-66c9-481c-83a7-5789f368700d" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:10:40 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-af2510d7-60ff-4df5-b64b-4c78c722d25f tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Lock "cinder-quobyte-1feae0ec-66c9-481c-83a7-5789f368700d" acquired by "delete_volume" :: waited 0.015s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:10:40 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f6f9e7d-3f1f-4eaf-b282-78e2cac8ac39]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:10:40 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-af2510d7-60ff-4df5-b64b-4c78c722d25f tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1feae0ec-66c9-481c-83a7-5789f368700d {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:10:40 devstack sudo[105390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1feae0ec-66c9-481c-83a7-5789f368700d Jul 10 16:10:40 devstack sudo[105390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:10:41 devstack sudo[105390]: pam_unix(sudo:session): session closed for user root Jul 10 16:10:41 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-af2510d7-60ff-4df5-b64b-4c78c722d25f tempest-CreateVolumesFromSourceVolumeTest-135047111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1feae0ec-66c9-481c-83a7-5789f368700d" returned: 0 in 0.732s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:10:41 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-af2510d7-60ff-4df5-b64b-4c78c722d25f tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1feae0ec-66c9-481c-83a7-5789f368700d {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:10:41 devstack sudo[105395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1feae0ec-66c9-481c-83a7-5789f368700d Jul 10 16:10:41 devstack sudo[105395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:10:42 devstack sudo[105395]: pam_unix(sudo:session): session closed for user root Jul 10 16:10:42 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-af2510d7-60ff-4df5-b64b-4c78c722d25f tempest-CreateVolumesFromSourceVolumeTest-135047111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1feae0ec-66c9-481c-83a7-5789f368700d" returned: 0 in 0.652s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:10:42 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-af2510d7-60ff-4df5-b64b-4c78c722d25f tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Lock "cinder-quobyte-1feae0ec-66c9-481c-83a7-5789f368700d" released by "delete_volume" :: held 1.421s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:10:42 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-af2510d7-60ff-4df5-b64b-4c78c722d25f tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Created reservations ['a96cf9be-0f54-4c31-b905-37d7bff971f7', '2662013f-3926-4b19-b3df-8e433a24af1f', 'c040fe41-6f18-4c00-b458-0ed5a4cf7b9c', '56f6a3e9-414d-42a5-8a90-e5cb278b421b'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:10:42 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-af2510d7-60ff-4df5-b64b-4c78c722d25f tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:10:42 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-af2510d7-60ff-4df5-b64b-4c78c722d25f tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:10:42 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-af2510d7-60ff-4df5-b64b-4c78c722d25f tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:10:42 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-af2510d7-60ff-4df5-b64b-4c78c722d25f tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:10:42 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-af2510d7-60ff-4df5-b64b-4c78c722d25f tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:10:42 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-af2510d7-60ff-4df5-b64b-4c78c722d25f tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:10:42 devstack sudo[105398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:10:42 devstack sudo[105398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:10:42 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-1f5d6f23-951c-4504-970a-236f155e8fe3 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Acquiring lock "cinder-191573f5-6dde-4383-9172-e4aeb0c99ae0-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:10:43 devstack sudo[105398]: pam_unix(sudo:session): session closed for user root Jul 10 16:10:43 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-af2510d7-60ff-4df5-b64b-4c78c722d25f tempest-CreateVolumesFromSourceVolumeTest-135047111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.634s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:10:43 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-af2510d7-60ff-4df5-b64b-4c78c722d25f tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:10:43 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-af2510d7-60ff-4df5-b64b-4c78c722d25f tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Deleted volume successfully. Jul 10 16:10:43 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-1f5d6f23-951c-4504-970a-236f155e8fe3 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Lock "cinder-191573f5-6dde-4383-9172-e4aeb0c99ae0-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:10:43 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-af2510d7-60ff-4df5-b64b-4c78c722d25f tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Lock "cinder-1feae0ec-66c9-481c-83a7-5789f368700d-delete_volume" released by "delete_volume" :: held 2.266s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:10:43 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-1f5d6f23-951c-4504-970a-236f155e8fe3 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Acquiring lock "cinder-quobyte-191573f5-6dde-4383-9172-e4aeb0c99ae0" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:10:43 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-1f5d6f23-951c-4504-970a-236f155e8fe3 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Lock "cinder-quobyte-191573f5-6dde-4383-9172-e4aeb0c99ae0" acquired by "delete_volume" :: waited 0.015s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:10:43 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[08a3571a-1e83-4093-87ab-e21c2ef0505a]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:10:43 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-1f5d6f23-951c-4504-970a-236f155e8fe3 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-191573f5-6dde-4383-9172-e4aeb0c99ae0 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:10:43 devstack sudo[105402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-191573f5-6dde-4383-9172-e4aeb0c99ae0 Jul 10 16:10:43 devstack sudo[105402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:10:43 devstack sudo[105402]: pam_unix(sudo:session): session closed for user root Jul 10 16:10:43 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-1f5d6f23-951c-4504-970a-236f155e8fe3 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-191573f5-6dde-4383-9172-e4aeb0c99ae0" returned: 0 in 0.742s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:10:43 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-1f5d6f23-951c-4504-970a-236f155e8fe3 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-191573f5-6dde-4383-9172-e4aeb0c99ae0 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:10:43 devstack sudo[105408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-191573f5-6dde-4383-9172-e4aeb0c99ae0 Jul 10 16:10:43 devstack sudo[105408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:10:44 devstack sudo[105408]: pam_unix(sudo:session): session closed for user root Jul 10 16:10:44 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-1f5d6f23-951c-4504-970a-236f155e8fe3 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-191573f5-6dde-4383-9172-e4aeb0c99ae0" returned: 0 in 0.626s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:10:44 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-1f5d6f23-951c-4504-970a-236f155e8fe3 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Lock "cinder-quobyte-191573f5-6dde-4383-9172-e4aeb0c99ae0" released by "delete_volume" :: held 1.404s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:10:44 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-1f5d6f23-951c-4504-970a-236f155e8fe3 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Created reservations ['f6a52e4c-3bd2-40ec-8761-4d83e3516283', '398ee1e1-7073-46ad-857a-1f6a06198a30', '8b6feaa1-c6cb-4571-8e1d-05ccd9ff86ed', 'ca810d9c-3d88-447d-af88-3014b9fd15b2'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:10:44 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-1f5d6f23-951c-4504-970a-236f155e8fe3 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:10:44 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-1f5d6f23-951c-4504-970a-236f155e8fe3 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:10:44 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-1f5d6f23-951c-4504-970a-236f155e8fe3 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:10:44 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-1f5d6f23-951c-4504-970a-236f155e8fe3 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:10:44 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-1f5d6f23-951c-4504-970a-236f155e8fe3 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:10:44 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-1f5d6f23-951c-4504-970a-236f155e8fe3 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:10:44 devstack sudo[105411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:10:44 devstack sudo[105411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:10:45 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-95b0fbb4-ac50-4c84-b5a7-977a064c4039 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Acquiring lock "cinder-3b5c99ff-1609-4e3b-b5ad-6805b4e6aaba-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:10:45 devstack sudo[105411]: pam_unix(sudo:session): session closed for user root Jul 10 16:10:45 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-1f5d6f23-951c-4504-970a-236f155e8fe3 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.655s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:10:45 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-1f5d6f23-951c-4504-970a-236f155e8fe3 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:10:45 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-95b0fbb4-ac50-4c84-b5a7-977a064c4039 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Lock "cinder-3b5c99ff-1609-4e3b-b5ad-6805b4e6aaba-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:10:45 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-1f5d6f23-951c-4504-970a-236f155e8fe3 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Deleted volume successfully. Jul 10 16:10:45 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-1f5d6f23-951c-4504-970a-236f155e8fe3 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Lock "cinder-191573f5-6dde-4383-9172-e4aeb0c99ae0-delete_volume" released by "delete_volume" :: held 2.265s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:10:45 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-95b0fbb4-ac50-4c84-b5a7-977a064c4039 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Acquiring lock "cinder-quobyte-3b5c99ff-1609-4e3b-b5ad-6805b4e6aaba" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:10:45 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-95b0fbb4-ac50-4c84-b5a7-977a064c4039 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Lock "cinder-quobyte-3b5c99ff-1609-4e3b-b5ad-6805b4e6aaba" acquired by "delete_volume" :: waited 0.015s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:10:45 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[2599fbc4-5ca7-4092-9e2d-77e247171a1f]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:10:45 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-95b0fbb4-ac50-4c84-b5a7-977a064c4039 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3b5c99ff-1609-4e3b-b5ad-6805b4e6aaba {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:10:45 devstack sudo[105414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3b5c99ff-1609-4e3b-b5ad-6805b4e6aaba Jul 10 16:10:45 devstack sudo[105414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:10:46 devstack sudo[105414]: pam_unix(sudo:session): session closed for user root Jul 10 16:10:46 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-95b0fbb4-ac50-4c84-b5a7-977a064c4039 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3b5c99ff-1609-4e3b-b5ad-6805b4e6aaba" returned: 0 in 0.746s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:10:46 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-95b0fbb4-ac50-4c84-b5a7-977a064c4039 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3b5c99ff-1609-4e3b-b5ad-6805b4e6aaba {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:10:46 devstack sudo[105425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3b5c99ff-1609-4e3b-b5ad-6805b4e6aaba Jul 10 16:10:46 devstack sudo[105425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:10:46 devstack sudo[105425]: pam_unix(sudo:session): session closed for user root Jul 10 16:10:46 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-95b0fbb4-ac50-4c84-b5a7-977a064c4039 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3b5c99ff-1609-4e3b-b5ad-6805b4e6aaba" returned: 0 in 0.634s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:10:46 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-95b0fbb4-ac50-4c84-b5a7-977a064c4039 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Lock "cinder-quobyte-3b5c99ff-1609-4e3b-b5ad-6805b4e6aaba" released by "delete_volume" :: held 1.416s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:10:46 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-95b0fbb4-ac50-4c84-b5a7-977a064c4039 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Created reservations ['5b1c15c2-7169-4cc0-9ceb-958e291ca954', '722e4910-a4fd-4d01-93da-d13f966c4da0', '6f2d3d2b-3e04-493e-8fa1-a4d2cf1be63e', '6e8e14dc-5115-43c2-9253-121547b5fb3c'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:10:46 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-95b0fbb4-ac50-4c84-b5a7-977a064c4039 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:10:46 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-95b0fbb4-ac50-4c84-b5a7-977a064c4039 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:10:46 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-95b0fbb4-ac50-4c84-b5a7-977a064c4039 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:10:46 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-95b0fbb4-ac50-4c84-b5a7-977a064c4039 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:10:46 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-95b0fbb4-ac50-4c84-b5a7-977a064c4039 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:10:46 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-95b0fbb4-ac50-4c84-b5a7-977a064c4039 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:10:46 devstack sudo[105428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:10:46 devstack sudo[105428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:10:47 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-283ce4f9-0aa1-4963-acf0-6b87d8b48556 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Acquiring lock "cinder-509d8f4c-7775-40b4-a76d-2bf306597d8c-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:10:47 devstack sudo[105428]: pam_unix(sudo:session): session closed for user root Jul 10 16:10:47 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-95b0fbb4-ac50-4c84-b5a7-977a064c4039 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.629s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:10:47 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-95b0fbb4-ac50-4c84-b5a7-977a064c4039 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:10:47 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-283ce4f9-0aa1-4963-acf0-6b87d8b48556 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Lock "cinder-509d8f4c-7775-40b4-a76d-2bf306597d8c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:10:47 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-95b0fbb4-ac50-4c84-b5a7-977a064c4039 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Deleted volume successfully. Jul 10 16:10:47 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-95b0fbb4-ac50-4c84-b5a7-977a064c4039 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Lock "cinder-3b5c99ff-1609-4e3b-b5ad-6805b4e6aaba-delete_volume" released by "delete_volume" :: held 2.249s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:10:47 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-283ce4f9-0aa1-4963-acf0-6b87d8b48556 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Acquiring lock "cinder-quobyte-509d8f4c-7775-40b4-a76d-2bf306597d8c" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:10:47 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-283ce4f9-0aa1-4963-acf0-6b87d8b48556 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Lock "cinder-quobyte-509d8f4c-7775-40b4-a76d-2bf306597d8c" acquired by "delete_volume" :: waited 0.014s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:10:47 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[543c5d47-3b62-4a47-bcc3-967462f700d9]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:10:47 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-283ce4f9-0aa1-4963-acf0-6b87d8b48556 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-509d8f4c-7775-40b4-a76d-2bf306597d8c {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:10:47 devstack sudo[105431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-509d8f4c-7775-40b4-a76d-2bf306597d8c Jul 10 16:10:47 devstack sudo[105431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:10:48 devstack sudo[105431]: pam_unix(sudo:session): session closed for user root Jul 10 16:10:48 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-283ce4f9-0aa1-4963-acf0-6b87d8b48556 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-509d8f4c-7775-40b4-a76d-2bf306597d8c" returned: 0 in 0.748s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:10:48 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-283ce4f9-0aa1-4963-acf0-6b87d8b48556 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-509d8f4c-7775-40b4-a76d-2bf306597d8c {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:10:48 devstack sudo[105436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-509d8f4c-7775-40b4-a76d-2bf306597d8c Jul 10 16:10:48 devstack sudo[105436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:10:48 devstack sudo[105436]: pam_unix(sudo:session): session closed for user root Jul 10 16:10:48 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-283ce4f9-0aa1-4963-acf0-6b87d8b48556 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-509d8f4c-7775-40b4-a76d-2bf306597d8c" returned: 0 in 0.656s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:10:48 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-283ce4f9-0aa1-4963-acf0-6b87d8b48556 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Lock "cinder-quobyte-509d8f4c-7775-40b4-a76d-2bf306597d8c" released by "delete_volume" :: held 1.440s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:10:49 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-283ce4f9-0aa1-4963-acf0-6b87d8b48556 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Created reservations ['323a1533-b039-44da-ba60-3a40c428de07', '04675c19-d6fc-423f-92ba-0427e5dbffa9', 'b0fdd9a3-6ab3-40ff-a942-42778e92eccd', 'b3b25a0f-83fc-4a13-bdea-41b75c85c4ec'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:10:49 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-283ce4f9-0aa1-4963-acf0-6b87d8b48556 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:10:49 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-283ce4f9-0aa1-4963-acf0-6b87d8b48556 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:10:49 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-283ce4f9-0aa1-4963-acf0-6b87d8b48556 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:10:49 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-283ce4f9-0aa1-4963-acf0-6b87d8b48556 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:10:49 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-283ce4f9-0aa1-4963-acf0-6b87d8b48556 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:10:49 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-283ce4f9-0aa1-4963-acf0-6b87d8b48556 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:10:49 devstack sudo[105439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:10:49 devstack sudo[105439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:10:49 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-356b2be6-93fe-412e-9a9f-a541e31b164d tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Acquiring lock "cinder-52dc5771-2ea4-4111-bab2-699e969bd371-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:10:49 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-356b2be6-93fe-412e-9a9f-a541e31b164d tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Lock "cinder-52dc5771-2ea4-4111-bab2-699e969bd371-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:10:49 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-356b2be6-93fe-412e-9a9f-a541e31b164d tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Acquiring lock "cinder-quobyte-52dc5771-2ea4-4111-bab2-699e969bd371" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:10:49 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-356b2be6-93fe-412e-9a9f-a541e31b164d tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Lock "cinder-quobyte-52dc5771-2ea4-4111-bab2-699e969bd371" acquired by "delete_volume" :: waited 0.014s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:10:49 devstack sudo[105439]: pam_unix(sudo:session): session closed for user root Jul 10 16:10:49 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-283ce4f9-0aa1-4963-acf0-6b87d8b48556 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.694s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:10:49 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-283ce4f9-0aa1-4963-acf0-6b87d8b48556 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:10:49 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-283ce4f9-0aa1-4963-acf0-6b87d8b48556 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Deleted volume successfully. Jul 10 16:10:49 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[48842fdb-5bc3-497a-96d2-e48f09cc9c74]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:10:49 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-356b2be6-93fe-412e-9a9f-a541e31b164d tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-52dc5771-2ea4-4111-bab2-699e969bd371 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:10:49 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-283ce4f9-0aa1-4963-acf0-6b87d8b48556 tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Lock "cinder-509d8f4c-7775-40b4-a76d-2bf306597d8c-delete_volume" released by "delete_volume" :: held 2.337s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:10:49 devstack sudo[105442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-52dc5771-2ea4-4111-bab2-699e969bd371 Jul 10 16:10:49 devstack sudo[105442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:10:50 devstack sudo[105442]: pam_unix(sudo:session): session closed for user root Jul 10 16:10:50 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-356b2be6-93fe-412e-9a9f-a541e31b164d tempest-CreateVolumesFromSourceVolumeTest-135047111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-52dc5771-2ea4-4111-bab2-699e969bd371" returned: 0 in 0.767s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:10:50 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-356b2be6-93fe-412e-9a9f-a541e31b164d tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-52dc5771-2ea4-4111-bab2-699e969bd371 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:10:50 devstack sudo[105447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-52dc5771-2ea4-4111-bab2-699e969bd371 Jul 10 16:10:50 devstack sudo[105447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:10:51 devstack sudo[105447]: pam_unix(sudo:session): session closed for user root Jul 10 16:10:51 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-356b2be6-93fe-412e-9a9f-a541e31b164d tempest-CreateVolumesFromSourceVolumeTest-135047111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-52dc5771-2ea4-4111-bab2-699e969bd371" returned: 0 in 0.637s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:10:51 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-356b2be6-93fe-412e-9a9f-a541e31b164d tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Lock "cinder-quobyte-52dc5771-2ea4-4111-bab2-699e969bd371" released by "delete_volume" :: held 1.449s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:10:51 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-356b2be6-93fe-412e-9a9f-a541e31b164d tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Created reservations ['6ac2fd1f-0696-4e55-b297-8507bec6b71e', 'dea9fc63-93e5-4167-8bc7-ae71baa17d14', '3aef72a4-7de7-495d-a79c-f1d1bc1f43c0', '9bf30d38-2a2b-4098-a660-04c8ddd44a47'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:10:51 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-356b2be6-93fe-412e-9a9f-a541e31b164d tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:10:51 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-356b2be6-93fe-412e-9a9f-a541e31b164d tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:10:51 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-356b2be6-93fe-412e-9a9f-a541e31b164d tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:10:51 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-356b2be6-93fe-412e-9a9f-a541e31b164d tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:10:51 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-356b2be6-93fe-412e-9a9f-a541e31b164d tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:10:51 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-356b2be6-93fe-412e-9a9f-a541e31b164d tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:10:51 devstack sudo[105450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:10:51 devstack sudo[105450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:10:51 devstack sudo[105450]: pam_unix(sudo:session): session closed for user root Jul 10 16:10:51 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-356b2be6-93fe-412e-9a9f-a541e31b164d tempest-CreateVolumesFromSourceVolumeTest-135047111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.645s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:10:51 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-356b2be6-93fe-412e-9a9f-a541e31b164d tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:10:51 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-356b2be6-93fe-412e-9a9f-a541e31b164d tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Deleted volume successfully. Jul 10 16:10:51 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-356b2be6-93fe-412e-9a9f-a541e31b164d tempest-CreateVolumesFromSourceVolumeTest-135047111 None] Lock "cinder-52dc5771-2ea4-4111-bab2-699e969bd371-delete_volume" released by "delete_volume" :: held 2.287s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:11:04 devstack cinder-volume[87420]: DEBUG dbcounter [-] [87420] Writing DB stats cinder:SELECT=44,cinder:UPDATE=63,cinder:DELETE=8,cinder:INSERT=12 {{(pid=87420) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 16:11:04 devstack cinder-volume[87420]: DEBUG dbcounter [-] [87420] Writing DB stats cinder:SELECT=37,cinder:UPDATE=63,cinder:INSERT=17,cinder:DELETE=3 {{(pid=87420) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 16:11:11 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c244507-351e-4943-b2e3-6b264ef92f3c tempest-CreateVolumesFromImageTest-1081655338 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 16:11:11 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6c244507-351e-4943-b2e3-6b264ef92f3c tempest-CreateVolumesFromImageTest-1081655338 None] Flow 'volume_create_manager' (0d19325f-ac07-4ba6-9085-875744f72afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:11:11 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6c244507-351e-4943-b2e3-6b264ef92f3c tempest-CreateVolumesFromImageTest-1081655338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb4f5f62-b1c5-4e6f-abe7-0d08e435e944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:11 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6c244507-351e-4943-b2e3-6b264ef92f3c tempest-CreateVolumesFromImageTest-1081655338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb4f5f62-b1c5-4e6f-abe7-0d08e435e944) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:11:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-47617335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=489159d0-470e-4219-97dd-5ce37db36a49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39b2a3edcb6d4fb1bf67ea17cd711f67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:11:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:11:11Z,use_quota=True,user_id='402dd651bd734f44a9457236a27535f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:11 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6c244507-351e-4943-b2e3-6b264ef92f3c tempest-CreateVolumesFromImageTest-1081655338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (242ae87b-014f-4e25-a3b1-f0350baad18a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:11 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6c244507-351e-4943-b2e3-6b264ef92f3c tempest-CreateVolumesFromImageTest-1081655338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (242ae87b-014f-4e25-a3b1-f0350baad18a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:11 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6c244507-351e-4943-b2e3-6b264ef92f3c tempest-CreateVolumesFromImageTest-1081655338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b2b0e98-a7e3-42f4-9c15-943dbbab084e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:11 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6c244507-351e-4943-b2e3-6b264ef92f3c tempest-CreateVolumesFromImageTest-1081655338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b2b0e98-a7e3-42f4-9c15-943dbbab084e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '489159d0-470e-4219-97dd-5ce37db36a49', 'volume_name': 'volume-489159d0-470e-4219-97dd-5ce37db36a49', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:11 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6c244507-351e-4943-b2e3-6b264ef92f3c tempest-CreateVolumesFromImageTest-1081655338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1430c0a-bbc7-44e4-9e72-5cc6aadcaeb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:11 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6c244507-351e-4943-b2e3-6b264ef92f3c tempest-CreateVolumesFromImageTest-1081655338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1430c0a-bbc7-44e4-9e72-5cc6aadcaeb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:11 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6c244507-351e-4943-b2e3-6b264ef92f3c tempest-CreateVolumesFromImageTest-1081655338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7910d8e1-4367-4c34-9f32-6a92c60c9d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:11 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-6c244507-351e-4943-b2e3-6b264ef92f3c tempest-CreateVolumesFromImageTest-1081655338 None] Volume 489159d0-470e-4219-97dd-5ce37db36a49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-489159d0-470e-4219-97dd-5ce37db36a49', 'volume_size': 1} Jul 10 16:11:11 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-6c244507-351e-4943-b2e3-6b264ef92f3c tempest-CreateVolumesFromImageTest-1081655338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:11:11 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-6c244507-351e-4943-b2e3-6b264ef92f3c tempest-CreateVolumesFromImageTest-1081655338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:11:11 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-6c244507-351e-4943-b2e3-6b264ef92f3c tempest-CreateVolumesFromImageTest-1081655338 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:11:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-47617335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=489159d0-470e-4219-97dd-5ce37db36a49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39b2a3edcb6d4fb1bf67ea17cd711f67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:11:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:11:11Z,use_quota=True,user_id='402dd651bd734f44a9457236a27535f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 16:11:11 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-6c244507-351e-4943-b2e3-6b264ef92f3c tempest-CreateVolumesFromImageTest-1081655338 None] Creating volume 489159d0-470e-4219-97dd-5ce37db36a49 {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 16:11:11 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-6c244507-351e-4943-b2e3-6b264ef92f3c tempest-CreateVolumesFromImageTest-1081655338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:11:11 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-6c244507-351e-4943-b2e3-6b264ef92f3c tempest-CreateVolumesFromImageTest-1081655338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:11:11 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-6c244507-351e-4943-b2e3-6b264ef92f3c tempest-CreateVolumesFromImageTest-1081655338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:11:11 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-6c244507-351e-4943-b2e3-6b264ef92f3c tempest-CreateVolumesFromImageTest-1081655338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:11:11 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-6c244507-351e-4943-b2e3-6b264ef92f3c tempest-CreateVolumesFromImageTest-1081655338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:11:11 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-6c244507-351e-4943-b2e3-6b264ef92f3c tempest-CreateVolumesFromImageTest-1081655338 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 16:11:11 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-6c244507-351e-4943-b2e3-6b264ef92f3c tempest-CreateVolumesFromImageTest-1081655338 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 16:11:11 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6c244507-351e-4943-b2e3-6b264ef92f3c tempest-CreateVolumesFromImageTest-1081655338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-489159d0-470e-4219-97dd-5ce37db36a49 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:11:11 devstack sudo[105492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-489159d0-470e-4219-97dd-5ce37db36a49 1073741824 Jul 10 16:11:11 devstack sudo[105492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:11:11 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d595811-b19f-421e-83b2-43aba505bb6a tempest-VolumeDependencyTests-487079426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 16:11:11 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-8d595811-b19f-421e-83b2-43aba505bb6a tempest-VolumeDependencyTests-487079426 None] Flow 'volume_create_manager' (ca70a118-9c91-4739-b900-5dd212ab0c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:11:11 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-8d595811-b19f-421e-83b2-43aba505bb6a tempest-VolumeDependencyTests-487079426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b7d86f2-ae18-40f2-89a3-1da0aef92a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:11 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-8d595811-b19f-421e-83b2-43aba505bb6a tempest-VolumeDependencyTests-487079426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b7d86f2-ae18-40f2-89a3-1da0aef92a93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:11:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1761304391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c4f93b5-3bba-4673-9d5e-4c0958a48a35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff43d15ccd3f4783ba32dad837d7ca89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:11:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:11:12Z,use_quota=True,user_id='6929acb9dce840d78ec984053432fc07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:11 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-8d595811-b19f-421e-83b2-43aba505bb6a tempest-VolumeDependencyTests-487079426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f333e7c0-21b1-442c-94a8-a439bfc4cf75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:11 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-8d595811-b19f-421e-83b2-43aba505bb6a tempest-VolumeDependencyTests-487079426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f333e7c0-21b1-442c-94a8-a439bfc4cf75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:11 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-8d595811-b19f-421e-83b2-43aba505bb6a tempest-VolumeDependencyTests-487079426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92b722c9-e827-4a69-8883-7823bbcfc092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:11 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-8d595811-b19f-421e-83b2-43aba505bb6a tempest-VolumeDependencyTests-487079426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92b722c9-e827-4a69-8883-7823bbcfc092) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c4f93b5-3bba-4673-9d5e-4c0958a48a35', 'volume_name': 'volume-7c4f93b5-3bba-4673-9d5e-4c0958a48a35', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:11 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-8d595811-b19f-421e-83b2-43aba505bb6a tempest-VolumeDependencyTests-487079426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2b1ed77-541a-4925-a95c-2c121204ad56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:11 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-8d595811-b19f-421e-83b2-43aba505bb6a tempest-VolumeDependencyTests-487079426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2b1ed77-541a-4925-a95c-2c121204ad56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:11 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-8d595811-b19f-421e-83b2-43aba505bb6a tempest-VolumeDependencyTests-487079426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8b64a8a-036f-4ee1-a2c8-c60e530d2a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:11 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-8d595811-b19f-421e-83b2-43aba505bb6a tempest-VolumeDependencyTests-487079426 None] Volume 7c4f93b5-3bba-4673-9d5e-4c0958a48a35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c4f93b5-3bba-4673-9d5e-4c0958a48a35', 'volume_size': 1} Jul 10 16:11:11 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-8d595811-b19f-421e-83b2-43aba505bb6a tempest-VolumeDependencyTests-487079426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:11:12 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffc5de35-dbf0-4f5f-8be2-6b38d2aa9e48 tempest-CreateVolumesFromImageTest-1081655338 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 16:11:12 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ffc5de35-dbf0-4f5f-8be2-6b38d2aa9e48 tempest-CreateVolumesFromImageTest-1081655338 None] Flow 'volume_create_manager' (63d19fd8-f89b-42a4-aa2c-83efcdbc4ecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:11:12 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ffc5de35-dbf0-4f5f-8be2-6b38d2aa9e48 tempest-CreateVolumesFromImageTest-1081655338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f762fa57-ed4d-4912-875a-6590c72a9b14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:12 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ffc5de35-dbf0-4f5f-8be2-6b38d2aa9e48 tempest-CreateVolumesFromImageTest-1081655338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f762fa57-ed4d-4912-875a-6590c72a9b14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:11:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-543145099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4ca947e-bce6-4e2a-ac95-6bad0e06342d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39b2a3edcb6d4fb1bf67ea17cd711f67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:11:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:11:12Z,use_quota=True,user_id='402dd651bd734f44a9457236a27535f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:12 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ffc5de35-dbf0-4f5f-8be2-6b38d2aa9e48 tempest-CreateVolumesFromImageTest-1081655338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb86ffec-bcbd-41f9-a27d-ba162f655740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:12 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ffc5de35-dbf0-4f5f-8be2-6b38d2aa9e48 tempest-CreateVolumesFromImageTest-1081655338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb86ffec-bcbd-41f9-a27d-ba162f655740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:12 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ffc5de35-dbf0-4f5f-8be2-6b38d2aa9e48 tempest-CreateVolumesFromImageTest-1081655338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dcaf44d-cf21-4ece-af89-b7d5ec1a56f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:12 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ffc5de35-dbf0-4f5f-8be2-6b38d2aa9e48 tempest-CreateVolumesFromImageTest-1081655338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dcaf44d-cf21-4ece-af89-b7d5ec1a56f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4ca947e-bce6-4e2a-ac95-6bad0e06342d', 'volume_name': 'volume-e4ca947e-bce6-4e2a-ac95-6bad0e06342d', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:12 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ffc5de35-dbf0-4f5f-8be2-6b38d2aa9e48 tempest-CreateVolumesFromImageTest-1081655338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56dd0e6e-e48d-416b-be11-ba3d6e11db2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:12 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ffc5de35-dbf0-4f5f-8be2-6b38d2aa9e48 tempest-CreateVolumesFromImageTest-1081655338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56dd0e6e-e48d-416b-be11-ba3d6e11db2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:12 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ffc5de35-dbf0-4f5f-8be2-6b38d2aa9e48 tempest-CreateVolumesFromImageTest-1081655338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2ec3ecd-c17f-485d-8e94-ce3336f64b9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:12 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-ffc5de35-dbf0-4f5f-8be2-6b38d2aa9e48 tempest-CreateVolumesFromImageTest-1081655338 None] Volume e4ca947e-bce6-4e2a-ac95-6bad0e06342d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4ca947e-bce6-4e2a-ac95-6bad0e06342d', 'volume_size': 1} Jul 10 16:11:12 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-ffc5de35-dbf0-4f5f-8be2-6b38d2aa9e48 tempest-CreateVolumesFromImageTest-1081655338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:11:12 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-1564abd1-9ecc-4522-8e70-0fed28554d6e tempest-CreateVolumesFromSnapshotTest-1937876261 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 16:11:12 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-1564abd1-9ecc-4522-8e70-0fed28554d6e tempest-CreateVolumesFromSnapshotTest-1937876261 None] Flow 'volume_create_manager' (3a02b6d3-04d5-4da4-989d-0139434d22e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:11:12 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-1564abd1-9ecc-4522-8e70-0fed28554d6e tempest-CreateVolumesFromSnapshotTest-1937876261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d86f9de-ec33-467f-ad9d-21381d88aabb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:12 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-1564abd1-9ecc-4522-8e70-0fed28554d6e tempest-CreateVolumesFromSnapshotTest-1937876261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d86f9de-ec33-467f-ad9d-21381d88aabb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:11:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1002994576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa0bcde3-519e-47f8-9f83-baa1d1d7eac3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='678e21887f8741fb9422fce1a779fd85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:11:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:11:12Z,use_quota=True,user_id='b738bea705274c419027b9dd4a126358',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:12 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-1564abd1-9ecc-4522-8e70-0fed28554d6e tempest-CreateVolumesFromSnapshotTest-1937876261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b974f9b4-e966-46f9-bfe9-454be0d47e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:12 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-1564abd1-9ecc-4522-8e70-0fed28554d6e tempest-CreateVolumesFromSnapshotTest-1937876261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b974f9b4-e966-46f9-bfe9-454be0d47e1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:12 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-1564abd1-9ecc-4522-8e70-0fed28554d6e tempest-CreateVolumesFromSnapshotTest-1937876261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2abbc750-7848-4cc0-84fa-38ebb047af43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:12 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-1564abd1-9ecc-4522-8e70-0fed28554d6e tempest-CreateVolumesFromSnapshotTest-1937876261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2abbc750-7848-4cc0-84fa-38ebb047af43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa0bcde3-519e-47f8-9f83-baa1d1d7eac3', 'volume_name': 'volume-aa0bcde3-519e-47f8-9f83-baa1d1d7eac3', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:12 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-1564abd1-9ecc-4522-8e70-0fed28554d6e tempest-CreateVolumesFromSnapshotTest-1937876261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3094993f-cd74-45b4-b235-2728a8d97295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:12 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-1564abd1-9ecc-4522-8e70-0fed28554d6e tempest-CreateVolumesFromSnapshotTest-1937876261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3094993f-cd74-45b4-b235-2728a8d97295) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:12 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-1564abd1-9ecc-4522-8e70-0fed28554d6e tempest-CreateVolumesFromSnapshotTest-1937876261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27e22886-88ea-4c8c-8dcc-f8ae41ce592f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:12 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-1564abd1-9ecc-4522-8e70-0fed28554d6e tempest-CreateVolumesFromSnapshotTest-1937876261 None] Volume aa0bcde3-519e-47f8-9f83-baa1d1d7eac3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa0bcde3-519e-47f8-9f83-baa1d1d7eac3', 'volume_size': 1} Jul 10 16:11:12 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-1564abd1-9ecc-4522-8e70-0fed28554d6e tempest-CreateVolumesFromSnapshotTest-1937876261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:11:12 devstack sudo[105492]: pam_unix(sudo:session): session closed for user root Jul 10 16:11:12 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6c244507-351e-4943-b2e3-6b264ef92f3c tempest-CreateVolumesFromImageTest-1081655338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-489159d0-470e-4219-97dd-5ce37db36a49 1073741824" returned: 0 in 1.035s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:11:12 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6c244507-351e-4943-b2e3-6b264ef92f3c tempest-CreateVolumesFromImageTest-1081655338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-489159d0-470e-4219-97dd-5ce37db36a49 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:11:12 devstack sudo[105499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-489159d0-470e-4219-97dd-5ce37db36a49 Jul 10 16:11:12 devstack sudo[105499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:11:12 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d6659ec-e258-40e1-ac5a-75170611497d tempest-CreateVolumesFromImageTest-1081655338 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 16:11:12 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-4d6659ec-e258-40e1-ac5a-75170611497d tempest-CreateVolumesFromImageTest-1081655338 None] Flow 'volume_create_manager' (b02ee491-264c-4425-97ec-d2962968b282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:11:12 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-4d6659ec-e258-40e1-ac5a-75170611497d tempest-CreateVolumesFromImageTest-1081655338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7e08247-9c48-4b93-ba9f-181312900bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:12 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-4d6659ec-e258-40e1-ac5a-75170611497d tempest-CreateVolumesFromImageTest-1081655338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7e08247-9c48-4b93-ba9f-181312900bec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:11:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2088114292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a064676-aba0-4dac-9946-03f5982f5d10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39b2a3edcb6d4fb1bf67ea17cd711f67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:11:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:11:13Z,use_quota=True,user_id='402dd651bd734f44a9457236a27535f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:12 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-4d6659ec-e258-40e1-ac5a-75170611497d tempest-CreateVolumesFromImageTest-1081655338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f8b4a05-d517-4e65-8c28-c940d1f8276d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:12 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-4d6659ec-e258-40e1-ac5a-75170611497d tempest-CreateVolumesFromImageTest-1081655338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f8b4a05-d517-4e65-8c28-c940d1f8276d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:12 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-4d6659ec-e258-40e1-ac5a-75170611497d tempest-CreateVolumesFromImageTest-1081655338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5144e9aa-6b1a-4dad-9ba6-0035c64051b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:12 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-4d6659ec-e258-40e1-ac5a-75170611497d tempest-CreateVolumesFromImageTest-1081655338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5144e9aa-6b1a-4dad-9ba6-0035c64051b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a064676-aba0-4dac-9946-03f5982f5d10', 'volume_name': 'volume-1a064676-aba0-4dac-9946-03f5982f5d10', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:12 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-4d6659ec-e258-40e1-ac5a-75170611497d tempest-CreateVolumesFromImageTest-1081655338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4501ac85-884a-4c10-aee2-7791af4cd406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:12 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-4d6659ec-e258-40e1-ac5a-75170611497d tempest-CreateVolumesFromImageTest-1081655338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4501ac85-884a-4c10-aee2-7791af4cd406) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:12 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-4d6659ec-e258-40e1-ac5a-75170611497d tempest-CreateVolumesFromImageTest-1081655338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7aac7fa0-3b2a-4d6a-89c0-258d84387fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:12 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-4d6659ec-e258-40e1-ac5a-75170611497d tempest-CreateVolumesFromImageTest-1081655338 None] Volume 1a064676-aba0-4dac-9946-03f5982f5d10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a064676-aba0-4dac-9946-03f5982f5d10', 'volume_size': 1} Jul 10 16:11:12 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-4d6659ec-e258-40e1-ac5a-75170611497d tempest-CreateVolumesFromImageTest-1081655338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:11:13 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-b321c6a0-dea0-4600-b8b9-c9fd0a1cc889 tempest-CreateVolumesFromImageTest-1081655338 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 16:11:13 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b321c6a0-dea0-4600-b8b9-c9fd0a1cc889 tempest-CreateVolumesFromImageTest-1081655338 None] Flow 'volume_create_manager' (7da2a040-a7d1-4b5a-a4e6-cc3cdb8216e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:11:13 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b321c6a0-dea0-4600-b8b9-c9fd0a1cc889 tempest-CreateVolumesFromImageTest-1081655338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc01e4c6-b973-4a11-b9f8-f40210837fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:13 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b321c6a0-dea0-4600-b8b9-c9fd0a1cc889 tempest-CreateVolumesFromImageTest-1081655338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc01e4c6-b973-4a11-b9f8-f40210837fd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:11:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-344374546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25793a81-dff0-48cb-9dc1-66662cf65fa7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39b2a3edcb6d4fb1bf67ea17cd711f67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:11:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:11:13Z,use_quota=True,user_id='402dd651bd734f44a9457236a27535f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:13 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b321c6a0-dea0-4600-b8b9-c9fd0a1cc889 tempest-CreateVolumesFromImageTest-1081655338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a113ac7d-4af0-4279-a92b-1ce6870163a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:13 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b321c6a0-dea0-4600-b8b9-c9fd0a1cc889 tempest-CreateVolumesFromImageTest-1081655338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a113ac7d-4af0-4279-a92b-1ce6870163a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:13 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b321c6a0-dea0-4600-b8b9-c9fd0a1cc889 tempest-CreateVolumesFromImageTest-1081655338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2756bc23-65d8-43a5-96d6-eaee0adb18ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:13 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b321c6a0-dea0-4600-b8b9-c9fd0a1cc889 tempest-CreateVolumesFromImageTest-1081655338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2756bc23-65d8-43a5-96d6-eaee0adb18ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25793a81-dff0-48cb-9dc1-66662cf65fa7', 'volume_name': 'volume-25793a81-dff0-48cb-9dc1-66662cf65fa7', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:13 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b321c6a0-dea0-4600-b8b9-c9fd0a1cc889 tempest-CreateVolumesFromImageTest-1081655338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c685e96a-bf83-40f3-bf79-311346b68007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:13 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b321c6a0-dea0-4600-b8b9-c9fd0a1cc889 tempest-CreateVolumesFromImageTest-1081655338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c685e96a-bf83-40f3-bf79-311346b68007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:13 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b321c6a0-dea0-4600-b8b9-c9fd0a1cc889 tempest-CreateVolumesFromImageTest-1081655338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab78ce09-6570-419f-941b-d8ad2ec1f412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:13 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-b321c6a0-dea0-4600-b8b9-c9fd0a1cc889 tempest-CreateVolumesFromImageTest-1081655338 None] Volume 25793a81-dff0-48cb-9dc1-66662cf65fa7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25793a81-dff0-48cb-9dc1-66662cf65fa7', 'volume_size': 1} Jul 10 16:11:13 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-b321c6a0-dea0-4600-b8b9-c9fd0a1cc889 tempest-CreateVolumesFromImageTest-1081655338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:11:13 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6c244507-351e-4943-b2e3-6b264ef92f3c tempest-CreateVolumesFromImageTest-1081655338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-489159d0-470e-4219-97dd-5ce37db36a49" returned: 0 in 0.854s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:11:13 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-6c244507-351e-4943-b2e3-6b264ef92f3c tempest-CreateVolumesFromImageTest-1081655338 None] <== create_volume: return (1932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 16:11:13 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-6c244507-351e-4943-b2e3-6b264ef92f3c tempest-CreateVolumesFromImageTest-1081655338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.934s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:11:13 devstack sudo[105499]: pam_unix(sudo:session): session closed for user root Jul 10 16:11:13 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-8d595811-b19f-421e-83b2-43aba505bb6a tempest-VolumeDependencyTests-487079426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.643s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:11:13 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-8d595811-b19f-421e-83b2-43aba505bb6a tempest-VolumeDependencyTests-487079426 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:11:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1761304391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c4f93b5-3bba-4673-9d5e-4c0958a48a35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff43d15ccd3f4783ba32dad837d7ca89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:11:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:11:12Z,use_quota=True,user_id='6929acb9dce840d78ec984053432fc07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 16:11:13 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-8d595811-b19f-421e-83b2-43aba505bb6a tempest-VolumeDependencyTests-487079426 None] Creating volume 7c4f93b5-3bba-4673-9d5e-4c0958a48a35 {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 16:11:13 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-8d595811-b19f-421e-83b2-43aba505bb6a tempest-VolumeDependencyTests-487079426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:11:13 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-8d595811-b19f-421e-83b2-43aba505bb6a tempest-VolumeDependencyTests-487079426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:11:13 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-8d595811-b19f-421e-83b2-43aba505bb6a tempest-VolumeDependencyTests-487079426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:11:13 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-8d595811-b19f-421e-83b2-43aba505bb6a tempest-VolumeDependencyTests-487079426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:11:13 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-8d595811-b19f-421e-83b2-43aba505bb6a tempest-VolumeDependencyTests-487079426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:11:13 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-8d595811-b19f-421e-83b2-43aba505bb6a tempest-VolumeDependencyTests-487079426 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 16:11:13 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-8d595811-b19f-421e-83b2-43aba505bb6a tempest-VolumeDependencyTests-487079426 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 16:11:13 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8d595811-b19f-421e-83b2-43aba505bb6a tempest-VolumeDependencyTests-487079426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7c4f93b5-3bba-4673-9d5e-4c0958a48a35 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:11:13 devstack sudo[105502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7c4f93b5-3bba-4673-9d5e-4c0958a48a35 1073741824 Jul 10 16:11:13 devstack sudo[105502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:11:13 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6c244507-351e-4943-b2e3-6b264ef92f3c tempest-CreateVolumesFromImageTest-1081655338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7910d8e1-4367-4c34-9f32-6a92c60c9d45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-489159d0-470e-4219-97dd-5ce37db36a49', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:13 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6c244507-351e-4943-b2e3-6b264ef92f3c tempest-CreateVolumesFromImageTest-1081655338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0177ebe-2839-4442-92e7-787f08ac9c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:13 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee4d4094-2390-402a-b1e1-8ac6ee1a990a tempest-CreateVolumesFromImageTest-1081655338 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 16:11:13 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ee4d4094-2390-402a-b1e1-8ac6ee1a990a tempest-CreateVolumesFromImageTest-1081655338 None] Flow 'volume_create_manager' (b21bd162-375f-44c1-979f-f6aa8c985a14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:11:13 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ee4d4094-2390-402a-b1e1-8ac6ee1a990a tempest-CreateVolumesFromImageTest-1081655338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (734db1d9-05b7-4318-8d1d-699db66d5f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:13 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-6c244507-351e-4943-b2e3-6b264ef92f3c tempest-CreateVolumesFromImageTest-1081655338 None] Volume volume-489159d0-470e-4219-97dd-5ce37db36a49 (489159d0-470e-4219-97dd-5ce37db36a49): created successfully Jul 10 16:11:13 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6c244507-351e-4943-b2e3-6b264ef92f3c tempest-CreateVolumesFromImageTest-1081655338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0177ebe-2839-4442-92e7-787f08ac9c4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:13 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6c244507-351e-4943-b2e3-6b264ef92f3c tempest-CreateVolumesFromImageTest-1081655338 None] Flow 'volume_create_manager' (0d19325f-ac07-4ba6-9085-875744f72afe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:11:13 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ee4d4094-2390-402a-b1e1-8ac6ee1a990a tempest-CreateVolumesFromImageTest-1081655338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (734db1d9-05b7-4318-8d1d-699db66d5f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:11:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1306594915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=154bd914-2472-4b32-ba51-e2c23bbae31e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39b2a3edcb6d4fb1bf67ea17cd711f67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:11:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:11:13Z,use_quota=True,user_id='402dd651bd734f44a9457236a27535f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:13 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ee4d4094-2390-402a-b1e1-8ac6ee1a990a tempest-CreateVolumesFromImageTest-1081655338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b26cf526-8c3d-4ab1-9324-40cf17281614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:13 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ee4d4094-2390-402a-b1e1-8ac6ee1a990a tempest-CreateVolumesFromImageTest-1081655338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b26cf526-8c3d-4ab1-9324-40cf17281614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:13 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ee4d4094-2390-402a-b1e1-8ac6ee1a990a tempest-CreateVolumesFromImageTest-1081655338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17a63467-f15b-4b23-af55-929709425677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:13 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ee4d4094-2390-402a-b1e1-8ac6ee1a990a tempest-CreateVolumesFromImageTest-1081655338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17a63467-f15b-4b23-af55-929709425677) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '154bd914-2472-4b32-ba51-e2c23bbae31e', 'volume_name': 'volume-154bd914-2472-4b32-ba51-e2c23bbae31e', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:13 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ee4d4094-2390-402a-b1e1-8ac6ee1a990a tempest-CreateVolumesFromImageTest-1081655338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21182840-d50f-434c-918a-8b32a2d7141e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:13 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ee4d4094-2390-402a-b1e1-8ac6ee1a990a tempest-CreateVolumesFromImageTest-1081655338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21182840-d50f-434c-918a-8b32a2d7141e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:13 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ee4d4094-2390-402a-b1e1-8ac6ee1a990a tempest-CreateVolumesFromImageTest-1081655338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27e0c564-44b2-4052-aeb4-64ae59f503f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:13 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-ee4d4094-2390-402a-b1e1-8ac6ee1a990a tempest-CreateVolumesFromImageTest-1081655338 None] Volume 154bd914-2472-4b32-ba51-e2c23bbae31e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-154bd914-2472-4b32-ba51-e2c23bbae31e', 'volume_size': 1} Jul 10 16:11:13 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-ee4d4094-2390-402a-b1e1-8ac6ee1a990a tempest-CreateVolumesFromImageTest-1081655338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:11:13 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-6c244507-351e-4943-b2e3-6b264ef92f3c tempest-CreateVolumesFromImageTest-1081655338 None] Created volume successfully. Jul 10 16:11:14 devstack sudo[105502]: pam_unix(sudo:session): session closed for user root Jul 10 16:11:14 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8d595811-b19f-421e-83b2-43aba505bb6a tempest-VolumeDependencyTests-487079426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7c4f93b5-3bba-4673-9d5e-4c0958a48a35 1073741824" returned: 0 in 0.859s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:11:14 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8d595811-b19f-421e-83b2-43aba505bb6a tempest-VolumeDependencyTests-487079426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7c4f93b5-3bba-4673-9d5e-4c0958a48a35 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:11:14 devstack sudo[105509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7c4f93b5-3bba-4673-9d5e-4c0958a48a35 Jul 10 16:11:14 devstack sudo[105509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:11:15 devstack sudo[105509]: pam_unix(sudo:session): session closed for user root Jul 10 16:11:15 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8d595811-b19f-421e-83b2-43aba505bb6a tempest-VolumeDependencyTests-487079426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7c4f93b5-3bba-4673-9d5e-4c0958a48a35" returned: 0 in 0.655s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:11:15 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-8d595811-b19f-421e-83b2-43aba505bb6a tempest-VolumeDependencyTests-487079426 None] <== create_volume: return (1557ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 16:11:15 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-8d595811-b19f-421e-83b2-43aba505bb6a tempest-VolumeDependencyTests-487079426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.559s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:11:15 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-ffc5de35-dbf0-4f5f-8be2-6b38d2aa9e48 tempest-CreateVolumesFromImageTest-1081655338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.722s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:11:15 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-ffc5de35-dbf0-4f5f-8be2-6b38d2aa9e48 tempest-CreateVolumesFromImageTest-1081655338 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:11:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-543145099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4ca947e-bce6-4e2a-ac95-6bad0e06342d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39b2a3edcb6d4fb1bf67ea17cd711f67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:11:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:11:12Z,use_quota=True,user_id='402dd651bd734f44a9457236a27535f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 16:11:15 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-ffc5de35-dbf0-4f5f-8be2-6b38d2aa9e48 tempest-CreateVolumesFromImageTest-1081655338 None] Creating volume e4ca947e-bce6-4e2a-ac95-6bad0e06342d {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 16:11:15 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-ffc5de35-dbf0-4f5f-8be2-6b38d2aa9e48 tempest-CreateVolumesFromImageTest-1081655338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:11:15 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-ffc5de35-dbf0-4f5f-8be2-6b38d2aa9e48 tempest-CreateVolumesFromImageTest-1081655338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:11:15 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-ffc5de35-dbf0-4f5f-8be2-6b38d2aa9e48 tempest-CreateVolumesFromImageTest-1081655338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:11:15 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-ffc5de35-dbf0-4f5f-8be2-6b38d2aa9e48 tempest-CreateVolumesFromImageTest-1081655338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:11:15 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-ffc5de35-dbf0-4f5f-8be2-6b38d2aa9e48 tempest-CreateVolumesFromImageTest-1081655338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:11:15 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-ffc5de35-dbf0-4f5f-8be2-6b38d2aa9e48 tempest-CreateVolumesFromImageTest-1081655338 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 16:11:15 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-ffc5de35-dbf0-4f5f-8be2-6b38d2aa9e48 tempest-CreateVolumesFromImageTest-1081655338 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 16:11:15 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ffc5de35-dbf0-4f5f-8be2-6b38d2aa9e48 tempest-CreateVolumesFromImageTest-1081655338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-e4ca947e-bce6-4e2a-ac95-6bad0e06342d 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:11:15 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-8d595811-b19f-421e-83b2-43aba505bb6a tempest-VolumeDependencyTests-487079426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8b64a8a-036f-4ee1-a2c8-c60e530d2a5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c4f93b5-3bba-4673-9d5e-4c0958a48a35', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:15 devstack sudo[105512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-e4ca947e-bce6-4e2a-ac95-6bad0e06342d 1073741824 Jul 10 16:11:15 devstack sudo[105512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:11:15 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-8d595811-b19f-421e-83b2-43aba505bb6a tempest-VolumeDependencyTests-487079426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4072372-b40e-44dc-ad15-c1cf0c70117d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:15 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-8d595811-b19f-421e-83b2-43aba505bb6a tempest-VolumeDependencyTests-487079426 None] Volume volume-7c4f93b5-3bba-4673-9d5e-4c0958a48a35 (7c4f93b5-3bba-4673-9d5e-4c0958a48a35): created successfully Jul 10 16:11:15 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-8d595811-b19f-421e-83b2-43aba505bb6a tempest-VolumeDependencyTests-487079426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4072372-b40e-44dc-ad15-c1cf0c70117d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:15 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-8d595811-b19f-421e-83b2-43aba505bb6a tempest-VolumeDependencyTests-487079426 None] Flow 'volume_create_manager' (ca70a118-9c91-4739-b900-5dd212ab0c30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:11:15 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-8d595811-b19f-421e-83b2-43aba505bb6a tempest-VolumeDependencyTests-487079426 None] Created volume successfully. Jul 10 16:11:15 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4f07e6c-13bf-47e3-acc2-1795b1a32d7e tempest-VolumeAndVolumeTypeFromImageTest-845300768 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 16:11:15 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f4f07e6c-13bf-47e3-acc2-1795b1a32d7e tempest-VolumeAndVolumeTypeFromImageTest-845300768 None] Flow 'volume_create_manager' (07198ed6-762e-4775-a6d2-e8881904b437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:11:15 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f4f07e6c-13bf-47e3-acc2-1795b1a32d7e tempest-VolumeAndVolumeTypeFromImageTest-845300768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edb38a19-a789-4e90-b743-ae82ac78fea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:15 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f4f07e6c-13bf-47e3-acc2-1795b1a32d7e tempest-VolumeAndVolumeTypeFromImageTest-845300768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edb38a19-a789-4e90-b743-ae82ac78fea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:11:15Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e005892-38b5-4421-8bc9-72b7c35ae367,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c323b81f6da4a36bcc1f57a47629059',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:11:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:11:15Z,use_quota=True,user_id='395374bcf6cb4beba7744037a996d349',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b3002e3-94b5-4d2f-9d8f-da7b3d8e78fd),volume_type_id=9b3002e3-94b5-4d2f-9d8f-da7b3d8e78fd)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:15 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f4f07e6c-13bf-47e3-acc2-1795b1a32d7e tempest-VolumeAndVolumeTypeFromImageTest-845300768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d24a0f4-0c3d-4641-ac9d-b056fa33e0e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:15 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f4f07e6c-13bf-47e3-acc2-1795b1a32d7e tempest-VolumeAndVolumeTypeFromImageTest-845300768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d24a0f4-0c3d-4641-ac9d-b056fa33e0e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:15 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f4f07e6c-13bf-47e3-acc2-1795b1a32d7e tempest-VolumeAndVolumeTypeFromImageTest-845300768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d4db88f-5c9c-45c2-93c5-da6333b82652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:15 devstack cinder-volume[87420]: DEBUG cinder.image.glance [None req-f4f07e6c-13bf-47e3-acc2-1795b1a32d7e tempest-VolumeAndVolumeTypeFromImageTest-845300768 None] Creating Keystone auth plugin from conf {{(pid=87420) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 10 16:11:15 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f4f07e6c-13bf-47e3-acc2-1795b1a32d7e tempest-VolumeAndVolumeTypeFromImageTest-845300768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d4db88f-5c9c-45c2-93c5-da6333b82652) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1e005892-38b5-4421-8bc9-72b7c35ae367', 'volume_name': 'volume-1e005892-38b5-4421-8bc9-72b7c35ae367', 'volume_size': 1, 'image_id': '73efcd67-743d-49f4-86ed-d422969992c3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/73efcd67-743d-49f4-86ed-d422969992c3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd3076a1d552c6c4d0ea631b41b5944d0', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2c323b81f6da4a36bcc1f57a47629059', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '05bab033de70e3c445ac97a4993d914fa95e370bcd5b049269d777dc1e2c7baea94ded5dee8d59ee77fa4a54008fbeaf451f34cc81b2bae5d5bcd3d4ffd46dd9', 'id': '73efcd67-743d-49f4-86ed-d422969992c3', 'created_at': datetime.datetime(2026, 7, 10, 14, 11, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 14, 11, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/73efcd67-743d-49f4-86ed-d422969992c3/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:15 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f4f07e6c-13bf-47e3-acc2-1795b1a32d7e tempest-VolumeAndVolumeTypeFromImageTest-845300768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ca5d1db-c869-411f-8556-d4648f2141f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:15 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f4f07e6c-13bf-47e3-acc2-1795b1a32d7e tempest-VolumeAndVolumeTypeFromImageTest-845300768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ca5d1db-c869-411f-8556-d4648f2141f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:15 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f4f07e6c-13bf-47e3-acc2-1795b1a32d7e tempest-VolumeAndVolumeTypeFromImageTest-845300768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12a4c859-44db-47cb-bc39-bc25f459281f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:15 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-f4f07e6c-13bf-47e3-acc2-1795b1a32d7e tempest-VolumeAndVolumeTypeFromImageTest-845300768 None] Volume 1e005892-38b5-4421-8bc9-72b7c35ae367: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1e005892-38b5-4421-8bc9-72b7c35ae367', 'volume_size': 1, 'image_id': '73efcd67-743d-49f4-86ed-d422969992c3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/73efcd67-743d-49f4-86ed-d422969992c3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd3076a1d552c6c4d0ea631b41b5944d0', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2c323b81f6da4a36bcc1f57a47629059', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '05bab033de70e3c445ac97a4993d914fa95e370bcd5b049269d777dc1e2c7baea94ded5dee8d59ee77fa4a54008fbeaf451f34cc81b2bae5d5bcd3d4ffd46dd9', 'id': '73efcd67-743d-49f4-86ed-d422969992c3', 'created_at': datetime.datetime(2026, 7, 10, 14, 11, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 14, 11, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/73efcd67-743d-49f4-86ed-d422969992c3/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 10 16:11:15 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4f07e6c-13bf-47e3-acc2-1795b1a32d7e tempest-VolumeAndVolumeTypeFromImageTest-845300768 None] Trying to clone 1e005892-38b5-4421-8bc9-72b7c35ae367 from image 73efcd67-743d-49f4-86ed-d422969992c3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/73efcd67-743d-49f4-86ed-d422969992c3', 'metadata': {}}]). {{(pid=87420) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 10 16:11:15 devstack cinder-volume[87420]: DEBUG cinder.image.image_utils [None req-f4f07e6c-13bf-47e3-acc2-1795b1a32d7e tempest-VolumeAndVolumeTypeFromImageTest-845300768 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_73efcd67-743d-49f4-86ed-d422969992c3_062kjt5ldevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87420) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 10 16:11:15 devstack sudo[105512]: pam_unix(sudo:session): session closed for user root Jul 10 16:11:15 devstack cinder-volume[87420]: INFO cinder.image.image_utils [None req-f4f07e6c-13bf-47e3-acc2-1795b1a32d7e tempest-VolumeAndVolumeTypeFromImageTest-845300768 None] Image download 0.00 MB at 0.00 MB/s Jul 10 16:11:15 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ffc5de35-dbf0-4f5f-8be2-6b38d2aa9e48 tempest-CreateVolumesFromImageTest-1081655338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-e4ca947e-bce6-4e2a-ac95-6bad0e06342d 1073741824" returned: 0 in 0.890s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:11:16 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6ec7464-0aa6-4217-bfd6-d69c86648b41]: (4, 'raw') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:11:16 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f4f07e6c-13bf-47e3-acc2-1795b1a32d7e tempest-VolumeAndVolumeTypeFromImageTest-845300768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_73efcd67-743d-49f4-86ed-d422969992c3_062kjt5ldevstack@QuobyteHD {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:11:16 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ffc5de35-dbf0-4f5f-8be2-6b38d2aa9e48 tempest-CreateVolumesFromImageTest-1081655338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-e4ca947e-bce6-4e2a-ac95-6bad0e06342d {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:11:16 devstack sudo[105519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-e4ca947e-bce6-4e2a-ac95-6bad0e06342d Jul 10 16:11:16 devstack sudo[105519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:11:16 devstack sudo[105518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_73efcd67-743d-49f4-86ed-d422969992c3_062kjt5ldevstack@QuobyteHD Jul 10 16:11:16 devstack sudo[105518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:11:16 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-5c7c4552-77e5-4f7f-bde2-fcba5fa6f4dc tempest-VolumeDependencyTests-487079426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:11:16 devstack sudo[105519]: pam_unix(sudo:session): session closed for user root Jul 10 16:11:16 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ffc5de35-dbf0-4f5f-8be2-6b38d2aa9e48 tempest-CreateVolumesFromImageTest-1081655338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-e4ca947e-bce6-4e2a-ac95-6bad0e06342d" returned: 0 in 0.714s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:11:16 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-ffc5de35-dbf0-4f5f-8be2-6b38d2aa9e48 tempest-CreateVolumesFromImageTest-1081655338 None] <== create_volume: return (1669ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 16:11:16 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-ffc5de35-dbf0-4f5f-8be2-6b38d2aa9e48 tempest-CreateVolumesFromImageTest-1081655338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.673s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:11:16 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-1564abd1-9ecc-4522-8e70-0fed28554d6e tempest-CreateVolumesFromSnapshotTest-1937876261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.194s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:11:16 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-1564abd1-9ecc-4522-8e70-0fed28554d6e tempest-CreateVolumesFromSnapshotTest-1937876261 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:11:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1002994576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa0bcde3-519e-47f8-9f83-baa1d1d7eac3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='678e21887f8741fb9422fce1a779fd85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:11:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:11:12Z,use_quota=True,user_id='b738bea705274c419027b9dd4a126358',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 16:11:16 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-1564abd1-9ecc-4522-8e70-0fed28554d6e tempest-CreateVolumesFromSnapshotTest-1937876261 None] Creating volume aa0bcde3-519e-47f8-9f83-baa1d1d7eac3 {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 16:11:16 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-1564abd1-9ecc-4522-8e70-0fed28554d6e tempest-CreateVolumesFromSnapshotTest-1937876261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:11:16 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-1564abd1-9ecc-4522-8e70-0fed28554d6e tempest-CreateVolumesFromSnapshotTest-1937876261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:11:16 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-1564abd1-9ecc-4522-8e70-0fed28554d6e tempest-CreateVolumesFromSnapshotTest-1937876261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:11:16 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-1564abd1-9ecc-4522-8e70-0fed28554d6e tempest-CreateVolumesFromSnapshotTest-1937876261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:11:16 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-1564abd1-9ecc-4522-8e70-0fed28554d6e tempest-CreateVolumesFromSnapshotTest-1937876261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:11:16 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-1564abd1-9ecc-4522-8e70-0fed28554d6e tempest-CreateVolumesFromSnapshotTest-1937876261 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 16:11:16 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-1564abd1-9ecc-4522-8e70-0fed28554d6e tempest-CreateVolumesFromSnapshotTest-1937876261 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 16:11:16 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-1564abd1-9ecc-4522-8e70-0fed28554d6e tempest-CreateVolumesFromSnapshotTest-1937876261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-aa0bcde3-519e-47f8-9f83-baa1d1d7eac3 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:11:16 devstack sudo[105518]: pam_unix(sudo:session): session closed for user root Jul 10 16:11:16 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ffc5de35-dbf0-4f5f-8be2-6b38d2aa9e48 tempest-CreateVolumesFromImageTest-1081655338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2ec3ecd-c17f-485d-8e94-ce3336f64b9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4ca947e-bce6-4e2a-ac95-6bad0e06342d', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:16 devstack sudo[105525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-aa0bcde3-519e-47f8-9f83-baa1d1d7eac3 1073741824 Jul 10 16:11:16 devstack sudo[105525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:11:16 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ffc5de35-dbf0-4f5f-8be2-6b38d2aa9e48 tempest-CreateVolumesFromImageTest-1081655338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4040d3ca-3a39-40d5-b4b7-6d66f63f4f0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:16 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f4f07e6c-13bf-47e3-acc2-1795b1a32d7e tempest-VolumeAndVolumeTypeFromImageTest-845300768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_73efcd67-743d-49f4-86ed-d422969992c3_062kjt5ldevstack@QuobyteHD" returned: 0 in 0.786s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:11:16 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f4f07e6c-13bf-47e3-acc2-1795b1a32d7e tempest-VolumeAndVolumeTypeFromImageTest-845300768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_73efcd67-743d-49f4-86ed-d422969992c3_062kjt5ldevstack@QuobyteHD {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:11:16 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-ffc5de35-dbf0-4f5f-8be2-6b38d2aa9e48 tempest-CreateVolumesFromImageTest-1081655338 None] Volume volume-e4ca947e-bce6-4e2a-ac95-6bad0e06342d (e4ca947e-bce6-4e2a-ac95-6bad0e06342d): created successfully Jul 10 16:11:16 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ffc5de35-dbf0-4f5f-8be2-6b38d2aa9e48 tempest-CreateVolumesFromImageTest-1081655338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4040d3ca-3a39-40d5-b4b7-6d66f63f4f0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:16 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ffc5de35-dbf0-4f5f-8be2-6b38d2aa9e48 tempest-CreateVolumesFromImageTest-1081655338 None] Flow 'volume_create_manager' (63d19fd8-f89b-42a4-aa2c-83efcdbc4ecb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:11:16 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-ffc5de35-dbf0-4f5f-8be2-6b38d2aa9e48 tempest-CreateVolumesFromImageTest-1081655338 None] Created volume successfully. Jul 10 16:11:16 devstack sudo[105527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_73efcd67-743d-49f4-86ed-d422969992c3_062kjt5ldevstack@QuobyteHD Jul 10 16:11:16 devstack sudo[105527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:11:17 devstack cinder-volume[87420]: DEBUG oslo_service.periodic_task [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87420) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 16:11:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:11:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:11:17 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:11:17 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:11:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:11:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:11:17 devstack sudo[105535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:11:17 devstack sudo[105535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:11:17 devstack sudo[105527]: pam_unix(sudo:session): session closed for user root Jul 10 16:11:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f4f07e6c-13bf-47e3-acc2-1795b1a32d7e tempest-VolumeAndVolumeTypeFromImageTest-845300768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_73efcd67-743d-49f4-86ed-d422969992c3_062kjt5ldevstack@QuobyteHD" returned: 1 in 0.752s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:11:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f4f07e6c-13bf-47e3-acc2-1795b1a32d7e tempest-VolumeAndVolumeTypeFromImageTest-845300768 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_73efcd67-743d-49f4-86ed-d422969992c3_062kjt5ldevstack@QuobyteHD' failed. Not Retrying. {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 16:11:17 devstack cinder-volume[87420]: DEBUG cinder.image.image_utils [None req-f4f07e6c-13bf-47e3-acc2-1795b1a32d7e tempest-VolumeAndVolumeTypeFromImageTest-845300768 None] Temporary image 73efcd67-743d-49f4-86ed-d422969992c3 is fetched for user 395374bcf6cb4beba7744037a996d349. {{(pid=87420) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 10 16:11:17 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[e32510bd-fffc-4315-a642-74f35834b003]: (4, 'raw') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:11:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f4f07e6c-13bf-47e3-acc2-1795b1a32d7e tempest-VolumeAndVolumeTypeFromImageTest-845300768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_73efcd67-743d-49f4-86ed-d422969992c3_062kjt5ldevstack@QuobyteHD {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:11:17 devstack sudo[105525]: pam_unix(sudo:session): session closed for user root Jul 10 16:11:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-1564abd1-9ecc-4522-8e70-0fed28554d6e tempest-CreateVolumesFromSnapshotTest-1937876261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-aa0bcde3-519e-47f8-9f83-baa1d1d7eac3 1073741824" returned: 0 in 0.911s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:11:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-1564abd1-9ecc-4522-8e70-0fed28554d6e tempest-CreateVolumesFromSnapshotTest-1937876261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-aa0bcde3-519e-47f8-9f83-baa1d1d7eac3 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:11:17 devstack sudo[105538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-aa0bcde3-519e-47f8-9f83-baa1d1d7eac3 Jul 10 16:11:17 devstack sudo[105538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:11:17 devstack sudo[105537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_73efcd67-743d-49f4-86ed-d422969992c3_062kjt5ldevstack@QuobyteHD Jul 10 16:11:17 devstack sudo[105537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:11:18 devstack sudo[105535]: pam_unix(sudo:session): session closed for user root Jul 10 16:11:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.701s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:11:18 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:11:18 devstack cinder-volume[87420]: DEBUG oslo_service.periodic_task [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Running periodic task VolumeManager._thread_info {{(pid=87420) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 16:11:18 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] thread count: 29 {{(pid=87420) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 16:11:18 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] thread info: [<_MainThread(MainThread, started 133639250378880)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87420) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 16:11:18 devstack sudo[105538]: pam_unix(sudo:session): session closed for user root Jul 10 16:11:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-1564abd1-9ecc-4522-8e70-0fed28554d6e tempest-CreateVolumesFromSnapshotTest-1937876261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-aa0bcde3-519e-47f8-9f83-baa1d1d7eac3" returned: 0 in 0.665s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:11:18 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-1564abd1-9ecc-4522-8e70-0fed28554d6e tempest-CreateVolumesFromSnapshotTest-1937876261 None] <== create_volume: return (1617ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 16:11:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-1564abd1-9ecc-4522-8e70-0fed28554d6e tempest-CreateVolumesFromSnapshotTest-1937876261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.620s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:11:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-4d6659ec-e258-40e1-ac5a-75170611497d tempest-CreateVolumesFromImageTest-1081655338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.551s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:11:18 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-4d6659ec-e258-40e1-ac5a-75170611497d tempest-CreateVolumesFromImageTest-1081655338 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:11:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2088114292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a064676-aba0-4dac-9946-03f5982f5d10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39b2a3edcb6d4fb1bf67ea17cd711f67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:11:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:11:13Z,use_quota=True,user_id='402dd651bd734f44a9457236a27535f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 16:11:18 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-4d6659ec-e258-40e1-ac5a-75170611497d tempest-CreateVolumesFromImageTest-1081655338 None] Creating volume 1a064676-aba0-4dac-9946-03f5982f5d10 {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 16:11:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-4d6659ec-e258-40e1-ac5a-75170611497d tempest-CreateVolumesFromImageTest-1081655338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:11:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-4d6659ec-e258-40e1-ac5a-75170611497d tempest-CreateVolumesFromImageTest-1081655338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:11:18 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-4d6659ec-e258-40e1-ac5a-75170611497d tempest-CreateVolumesFromImageTest-1081655338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:11:18 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-4d6659ec-e258-40e1-ac5a-75170611497d tempest-CreateVolumesFromImageTest-1081655338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:11:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-4d6659ec-e258-40e1-ac5a-75170611497d tempest-CreateVolumesFromImageTest-1081655338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:11:18 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-4d6659ec-e258-40e1-ac5a-75170611497d tempest-CreateVolumesFromImageTest-1081655338 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 16:11:18 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-4d6659ec-e258-40e1-ac5a-75170611497d tempest-CreateVolumesFromImageTest-1081655338 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 16:11:18 devstack sudo[105537]: pam_unix(sudo:session): session closed for user root Jul 10 16:11:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4d6659ec-e258-40e1-ac5a-75170611497d tempest-CreateVolumesFromImageTest-1081655338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1a064676-aba0-4dac-9946-03f5982f5d10 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:11:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f4f07e6c-13bf-47e3-acc2-1795b1a32d7e tempest-VolumeAndVolumeTypeFromImageTest-845300768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_73efcd67-743d-49f4-86ed-d422969992c3_062kjt5ldevstack@QuobyteHD" returned: 0 in 0.769s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:11:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f4f07e6c-13bf-47e3-acc2-1795b1a32d7e tempest-VolumeAndVolumeTypeFromImageTest-845300768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_73efcd67-743d-49f4-86ed-d422969992c3_062kjt5ldevstack@QuobyteHD {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:11:18 devstack sudo[105545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1a064676-aba0-4dac-9946-03f5982f5d10 1073741824 Jul 10 16:11:18 devstack sudo[105545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:11:18 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-1564abd1-9ecc-4522-8e70-0fed28554d6e tempest-CreateVolumesFromSnapshotTest-1937876261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27e22886-88ea-4c8c-8dcc-f8ae41ce592f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa0bcde3-519e-47f8-9f83-baa1d1d7eac3', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:18 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-1564abd1-9ecc-4522-8e70-0fed28554d6e tempest-CreateVolumesFromSnapshotTest-1937876261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cac171c-f322-47f7-9f1c-549b35aafe00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:18 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-1564abd1-9ecc-4522-8e70-0fed28554d6e tempest-CreateVolumesFromSnapshotTest-1937876261 None] Volume volume-aa0bcde3-519e-47f8-9f83-baa1d1d7eac3 (aa0bcde3-519e-47f8-9f83-baa1d1d7eac3): created successfully Jul 10 16:11:18 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-1564abd1-9ecc-4522-8e70-0fed28554d6e tempest-CreateVolumesFromSnapshotTest-1937876261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cac171c-f322-47f7-9f1c-549b35aafe00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:18 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-1564abd1-9ecc-4522-8e70-0fed28554d6e tempest-CreateVolumesFromSnapshotTest-1937876261 None] Flow 'volume_create_manager' (3a02b6d3-04d5-4da4-989d-0139434d22e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:11:18 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-1564abd1-9ecc-4522-8e70-0fed28554d6e tempest-CreateVolumesFromSnapshotTest-1937876261 None] Created volume successfully. Jul 10 16:11:18 devstack sudo[105546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_73efcd67-743d-49f4-86ed-d422969992c3_062kjt5ldevstack@QuobyteHD Jul 10 16:11:18 devstack sudo[105546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:11:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-d949f657-0829-439f-a33f-2b793b2a2a00 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:11:19 devstack sudo[105546]: pam_unix(sudo:session): session closed for user root Jul 10 16:11:19 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f4f07e6c-13bf-47e3-acc2-1795b1a32d7e tempest-VolumeAndVolumeTypeFromImageTest-845300768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_73efcd67-743d-49f4-86ed-d422969992c3_062kjt5ldevstack@QuobyteHD" returned: 1 in 0.777s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:11:19 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f4f07e6c-13bf-47e3-acc2-1795b1a32d7e tempest-VolumeAndVolumeTypeFromImageTest-845300768 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_73efcd67-743d-49f4-86ed-d422969992c3_062kjt5ldevstack@QuobyteHD' failed. Not Retrying. {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 16:11:19 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-f4f07e6c-13bf-47e3-acc2-1795b1a32d7e tempest-VolumeAndVolumeTypeFromImageTest-845300768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:11:19 devstack sudo[105545]: pam_unix(sudo:session): session closed for user root Jul 10 16:11:19 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4d6659ec-e258-40e1-ac5a-75170611497d tempest-CreateVolumesFromImageTest-1081655338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1a064676-aba0-4dac-9946-03f5982f5d10 1073741824" returned: 0 in 0.842s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:11:19 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4d6659ec-e258-40e1-ac5a-75170611497d tempest-CreateVolumesFromImageTest-1081655338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1a064676-aba0-4dac-9946-03f5982f5d10 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:11:19 devstack sudo[105556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1a064676-aba0-4dac-9946-03f5982f5d10 Jul 10 16:11:19 devstack sudo[105556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:11:19 devstack sudo[105556]: pam_unix(sudo:session): session closed for user root Jul 10 16:11:19 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4d6659ec-e258-40e1-ac5a-75170611497d tempest-CreateVolumesFromImageTest-1081655338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1a064676-aba0-4dac-9946-03f5982f5d10" returned: 0 in 0.657s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:11:19 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-4d6659ec-e258-40e1-ac5a-75170611497d tempest-CreateVolumesFromImageTest-1081655338 None] <== create_volume: return (1538ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 16:11:19 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-4d6659ec-e258-40e1-ac5a-75170611497d tempest-CreateVolumesFromImageTest-1081655338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.544s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:11:19 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-b321c6a0-dea0-4600-b8b9-c9fd0a1cc889 tempest-CreateVolumesFromImageTest-1081655338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.673s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:11:19 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-b321c6a0-dea0-4600-b8b9-c9fd0a1cc889 tempest-CreateVolumesFromImageTest-1081655338 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:11:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-344374546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25793a81-dff0-48cb-9dc1-66662cf65fa7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39b2a3edcb6d4fb1bf67ea17cd711f67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:11:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:11:13Z,use_quota=True,user_id='402dd651bd734f44a9457236a27535f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 16:11:19 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-b321c6a0-dea0-4600-b8b9-c9fd0a1cc889 tempest-CreateVolumesFromImageTest-1081655338 None] Creating volume 25793a81-dff0-48cb-9dc1-66662cf65fa7 {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 16:11:19 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-b321c6a0-dea0-4600-b8b9-c9fd0a1cc889 tempest-CreateVolumesFromImageTest-1081655338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:11:19 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-b321c6a0-dea0-4600-b8b9-c9fd0a1cc889 tempest-CreateVolumesFromImageTest-1081655338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:11:19 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-b321c6a0-dea0-4600-b8b9-c9fd0a1cc889 tempest-CreateVolumesFromImageTest-1081655338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:11:19 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-b321c6a0-dea0-4600-b8b9-c9fd0a1cc889 tempest-CreateVolumesFromImageTest-1081655338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:11:19 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-b321c6a0-dea0-4600-b8b9-c9fd0a1cc889 tempest-CreateVolumesFromImageTest-1081655338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:11:19 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-b321c6a0-dea0-4600-b8b9-c9fd0a1cc889 tempest-CreateVolumesFromImageTest-1081655338 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 16:11:19 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-b321c6a0-dea0-4600-b8b9-c9fd0a1cc889 tempest-CreateVolumesFromImageTest-1081655338 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 16:11:19 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-b321c6a0-dea0-4600-b8b9-c9fd0a1cc889 tempest-CreateVolumesFromImageTest-1081655338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-25793a81-dff0-48cb-9dc1-66662cf65fa7 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:11:19 devstack sudo[105559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-25793a81-dff0-48cb-9dc1-66662cf65fa7 1073741824 Jul 10 16:11:19 devstack sudo[105559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:11:19 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-4d6659ec-e258-40e1-ac5a-75170611497d tempest-CreateVolumesFromImageTest-1081655338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7aac7fa0-3b2a-4d6a-89c0-258d84387fcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a064676-aba0-4dac-9946-03f5982f5d10', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:19 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-4d6659ec-e258-40e1-ac5a-75170611497d tempest-CreateVolumesFromImageTest-1081655338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b631752-07b9-4935-b8b3-626aba1c2985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:19 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-4d6659ec-e258-40e1-ac5a-75170611497d tempest-CreateVolumesFromImageTest-1081655338 None] Volume volume-1a064676-aba0-4dac-9946-03f5982f5d10 (1a064676-aba0-4dac-9946-03f5982f5d10): created successfully Jul 10 16:11:19 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-4d6659ec-e258-40e1-ac5a-75170611497d tempest-CreateVolumesFromImageTest-1081655338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b631752-07b9-4935-b8b3-626aba1c2985) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:19 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-4d6659ec-e258-40e1-ac5a-75170611497d tempest-CreateVolumesFromImageTest-1081655338 None] Flow 'volume_create_manager' (b02ee491-264c-4425-97ec-d2962968b282) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:11:20 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-4d6659ec-e258-40e1-ac5a-75170611497d tempest-CreateVolumesFromImageTest-1081655338 None] Created volume successfully. Jul 10 16:11:20 devstack sudo[105559]: pam_unix(sudo:session): session closed for user root Jul 10 16:11:20 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-b321c6a0-dea0-4600-b8b9-c9fd0a1cc889 tempest-CreateVolumesFromImageTest-1081655338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-25793a81-dff0-48cb-9dc1-66662cf65fa7 1073741824" returned: 0 in 0.810s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:11:20 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-b321c6a0-dea0-4600-b8b9-c9fd0a1cc889 tempest-CreateVolumesFromImageTest-1081655338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-25793a81-dff0-48cb-9dc1-66662cf65fa7 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:11:20 devstack sudo[105565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-25793a81-dff0-48cb-9dc1-66662cf65fa7 Jul 10 16:11:20 devstack sudo[105565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:11:21 devstack sudo[105565]: pam_unix(sudo:session): session closed for user root Jul 10 16:11:21 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-b321c6a0-dea0-4600-b8b9-c9fd0a1cc889 tempest-CreateVolumesFromImageTest-1081655338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-25793a81-dff0-48cb-9dc1-66662cf65fa7" returned: 0 in 0.648s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:11:21 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-b321c6a0-dea0-4600-b8b9-c9fd0a1cc889 tempest-CreateVolumesFromImageTest-1081655338 None] <== create_volume: return (1552ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 16:11:21 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-b321c6a0-dea0-4600-b8b9-c9fd0a1cc889 tempest-CreateVolumesFromImageTest-1081655338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.555s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:11:21 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-ee4d4094-2390-402a-b1e1-8ac6ee1a990a tempest-CreateVolumesFromImageTest-1081655338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.804s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:11:21 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-ee4d4094-2390-402a-b1e1-8ac6ee1a990a tempest-CreateVolumesFromImageTest-1081655338 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:11:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1306594915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=154bd914-2472-4b32-ba51-e2c23bbae31e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39b2a3edcb6d4fb1bf67ea17cd711f67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:11:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:11:13Z,use_quota=True,user_id='402dd651bd734f44a9457236a27535f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 16:11:21 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-ee4d4094-2390-402a-b1e1-8ac6ee1a990a tempest-CreateVolumesFromImageTest-1081655338 None] Creating volume 154bd914-2472-4b32-ba51-e2c23bbae31e {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 16:11:21 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-ee4d4094-2390-402a-b1e1-8ac6ee1a990a tempest-CreateVolumesFromImageTest-1081655338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:11:21 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-ee4d4094-2390-402a-b1e1-8ac6ee1a990a tempest-CreateVolumesFromImageTest-1081655338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:11:21 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-ee4d4094-2390-402a-b1e1-8ac6ee1a990a tempest-CreateVolumesFromImageTest-1081655338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:11:21 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-ee4d4094-2390-402a-b1e1-8ac6ee1a990a tempest-CreateVolumesFromImageTest-1081655338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:11:21 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-ee4d4094-2390-402a-b1e1-8ac6ee1a990a tempest-CreateVolumesFromImageTest-1081655338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:11:21 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-ee4d4094-2390-402a-b1e1-8ac6ee1a990a tempest-CreateVolumesFromImageTest-1081655338 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 16:11:21 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-ee4d4094-2390-402a-b1e1-8ac6ee1a990a tempest-CreateVolumesFromImageTest-1081655338 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 16:11:21 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ee4d4094-2390-402a-b1e1-8ac6ee1a990a tempest-CreateVolumesFromImageTest-1081655338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-154bd914-2472-4b32-ba51-e2c23bbae31e 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:11:21 devstack sudo[105569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-154bd914-2472-4b32-ba51-e2c23bbae31e 1073741824 Jul 10 16:11:21 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b321c6a0-dea0-4600-b8b9-c9fd0a1cc889 tempest-CreateVolumesFromImageTest-1081655338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab78ce09-6570-419f-941b-d8ad2ec1f412) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25793a81-dff0-48cb-9dc1-66662cf65fa7', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:21 devstack sudo[105569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:11:21 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b321c6a0-dea0-4600-b8b9-c9fd0a1cc889 tempest-CreateVolumesFromImageTest-1081655338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7e51770-e66b-4ec4-9790-d4f39e42f14c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:21 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-b321c6a0-dea0-4600-b8b9-c9fd0a1cc889 tempest-CreateVolumesFromImageTest-1081655338 None] Volume volume-25793a81-dff0-48cb-9dc1-66662cf65fa7 (25793a81-dff0-48cb-9dc1-66662cf65fa7): created successfully Jul 10 16:11:21 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b321c6a0-dea0-4600-b8b9-c9fd0a1cc889 tempest-CreateVolumesFromImageTest-1081655338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7e51770-e66b-4ec4-9790-d4f39e42f14c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:21 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b321c6a0-dea0-4600-b8b9-c9fd0a1cc889 tempest-CreateVolumesFromImageTest-1081655338 None] Flow 'volume_create_manager' (7da2a040-a7d1-4b5a-a4e6-cc3cdb8216e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:11:21 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-b321c6a0-dea0-4600-b8b9-c9fd0a1cc889 tempest-CreateVolumesFromImageTest-1081655338 None] Created volume successfully. Jul 10 16:11:22 devstack sudo[105569]: pam_unix(sudo:session): session closed for user root Jul 10 16:11:22 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ee4d4094-2390-402a-b1e1-8ac6ee1a990a tempest-CreateVolumesFromImageTest-1081655338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-154bd914-2472-4b32-ba51-e2c23bbae31e 1073741824" returned: 0 in 0.841s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:11:22 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ee4d4094-2390-402a-b1e1-8ac6ee1a990a tempest-CreateVolumesFromImageTest-1081655338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-154bd914-2472-4b32-ba51-e2c23bbae31e {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:11:22 devstack sudo[105576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-154bd914-2472-4b32-ba51-e2c23bbae31e Jul 10 16:11:22 devstack sudo[105576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:11:22 devstack sudo[105576]: pam_unix(sudo:session): session closed for user root Jul 10 16:11:23 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ee4d4094-2390-402a-b1e1-8ac6ee1a990a tempest-CreateVolumesFromImageTest-1081655338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-154bd914-2472-4b32-ba51-e2c23bbae31e" returned: 0 in 0.640s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:11:23 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-ee4d4094-2390-402a-b1e1-8ac6ee1a990a tempest-CreateVolumesFromImageTest-1081655338 None] <== create_volume: return (1521ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 16:11:23 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-ee4d4094-2390-402a-b1e1-8ac6ee1a990a tempest-CreateVolumesFromImageTest-1081655338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.525s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:11:23 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-5c7c4552-77e5-4f7f-bde2-fcba5fa6f4dc tempest-VolumeDependencyTests-487079426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.495s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:11:23 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ee4d4094-2390-402a-b1e1-8ac6ee1a990a tempest-CreateVolumesFromImageTest-1081655338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27e0c564-44b2-4052-aeb4-64ae59f503f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-154bd914-2472-4b32-ba51-e2c23bbae31e', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:23 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ee4d4094-2390-402a-b1e1-8ac6ee1a990a tempest-CreateVolumesFromImageTest-1081655338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b4a0612-59f6-4a47-9cfe-8b369e28fae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:23 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-5c7c4552-77e5-4f7f-bde2-fcba5fa6f4dc tempest-VolumeDependencyTests-487079426 None] Creating offline snapshot ed21540a-9463-4857-888d-fa64b45b2a39 of volume 7c4f93b5-3bba-4673-9d5e-4c0958a48a35 {{(pid=87420) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 16:11:23 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-ee4d4094-2390-402a-b1e1-8ac6ee1a990a tempest-CreateVolumesFromImageTest-1081655338 None] Volume volume-154bd914-2472-4b32-ba51-e2c23bbae31e (154bd914-2472-4b32-ba51-e2c23bbae31e): created successfully Jul 10 16:11:23 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ee4d4094-2390-402a-b1e1-8ac6ee1a990a tempest-CreateVolumesFromImageTest-1081655338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b4a0612-59f6-4a47-9cfe-8b369e28fae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:23 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ee4d4094-2390-402a-b1e1-8ac6ee1a990a tempest-CreateVolumesFromImageTest-1081655338 None] Flow 'volume_create_manager' (b21bd162-375f-44c1-979f-f6aa8c985a14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:11:23 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c6b7d87-ac18-4139-90fb-b040ee20a7f0]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:11:23 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-5c7c4552-77e5-4f7f-bde2-fcba5fa6f4dc tempest-VolumeDependencyTests-487079426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7c4f93b5-3bba-4673-9d5e-4c0958a48a35 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:11:23 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-ee4d4094-2390-402a-b1e1-8ac6ee1a990a tempest-CreateVolumesFromImageTest-1081655338 None] Created volume successfully. Jul 10 16:11:23 devstack sudo[105579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7c4f93b5-3bba-4673-9d5e-4c0958a48a35 Jul 10 16:11:23 devstack sudo[105579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:11:23 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-45f889d6-1003-45e9-b4e8-95ce9d2c774a tempest-CreateVolumesFromImageTest-1081655338 None] Acquiring lock "cinder-154bd914-2472-4b32-ba51-e2c23bbae31e-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:11:23 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-45f889d6-1003-45e9-b4e8-95ce9d2c774a tempest-CreateVolumesFromImageTest-1081655338 None] Lock "cinder-154bd914-2472-4b32-ba51-e2c23bbae31e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:11:23 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-45f889d6-1003-45e9-b4e8-95ce9d2c774a tempest-CreateVolumesFromImageTest-1081655338 None] Acquiring lock "cinder-quobyte-154bd914-2472-4b32-ba51-e2c23bbae31e" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:11:23 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-45f889d6-1003-45e9-b4e8-95ce9d2c774a tempest-CreateVolumesFromImageTest-1081655338 None] Lock "cinder-quobyte-154bd914-2472-4b32-ba51-e2c23bbae31e" acquired by "delete_volume" :: waited 0.014s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:11:23 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b928e2c-965a-426f-8c9e-08c577b95f55]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:11:23 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-45f889d6-1003-45e9-b4e8-95ce9d2c774a tempest-CreateVolumesFromImageTest-1081655338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-154bd914-2472-4b32-ba51-e2c23bbae31e {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:11:23 devstack sudo[105581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-154bd914-2472-4b32-ba51-e2c23bbae31e Jul 10 16:11:23 devstack sudo[105581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:11:23 devstack sudo[105579]: pam_unix(sudo:session): session closed for user root Jul 10 16:11:23 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-5c7c4552-77e5-4f7f-bde2-fcba5fa6f4dc tempest-VolumeDependencyTests-487079426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7c4f93b5-3bba-4673-9d5e-4c0958a48a35" returned: 0 in 0.792s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:11:23 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-5c7c4552-77e5-4f7f-bde2-fcba5fa6f4dc tempest-VolumeDependencyTests-487079426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7c4f93b5-3bba-4673-9d5e-4c0958a48a35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7c4f93b5-3bba-4673-9d5e-4c0958a48a35.ed21540a-9463-4857-888d-fa64b45b2a39 1G {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:11:23 devstack sudo[105587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7c4f93b5-3bba-4673-9d5e-4c0958a48a35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7c4f93b5-3bba-4673-9d5e-4c0958a48a35.ed21540a-9463-4857-888d-fa64b45b2a39 1G Jul 10 16:11:23 devstack sudo[105587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:11:24 devstack sudo[105581]: pam_unix(sudo:session): session closed for user root Jul 10 16:11:24 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-45f889d6-1003-45e9-b4e8-95ce9d2c774a tempest-CreateVolumesFromImageTest-1081655338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-154bd914-2472-4b32-ba51-e2c23bbae31e" returned: 0 in 0.785s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:11:24 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-45f889d6-1003-45e9-b4e8-95ce9d2c774a tempest-CreateVolumesFromImageTest-1081655338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-154bd914-2472-4b32-ba51-e2c23bbae31e {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:11:24 devstack sudo[105592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-154bd914-2472-4b32-ba51-e2c23bbae31e Jul 10 16:11:24 devstack sudo[105592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:11:24 devstack sudo[105587]: pam_unix(sudo:session): session closed for user root Jul 10 16:11:24 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-5c7c4552-77e5-4f7f-bde2-fcba5fa6f4dc tempest-VolumeDependencyTests-487079426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7c4f93b5-3bba-4673-9d5e-4c0958a48a35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7c4f93b5-3bba-4673-9d5e-4c0958a48a35.ed21540a-9463-4857-888d-fa64b45b2a39 1G" returned: 0 in 0.823s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:11:24 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-5c7c4552-77e5-4f7f-bde2-fcba5fa6f4dc tempest-VolumeDependencyTests-487079426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c4f93b5-3bba-4673-9d5e-4c0958a48a35 -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7c4f93b5-3bba-4673-9d5e-4c0958a48a35.ed21540a-9463-4857-888d-fa64b45b2a39 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:11:24 devstack sudo[105599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c4f93b5-3bba-4673-9d5e-4c0958a48a35 -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7c4f93b5-3bba-4673-9d5e-4c0958a48a35.ed21540a-9463-4857-888d-fa64b45b2a39 Jul 10 16:11:24 devstack sudo[105599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:11:24 devstack sudo[105592]: pam_unix(sudo:session): session closed for user root Jul 10 16:11:24 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-45f889d6-1003-45e9-b4e8-95ce9d2c774a tempest-CreateVolumesFromImageTest-1081655338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-154bd914-2472-4b32-ba51-e2c23bbae31e" returned: 0 in 0.666s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:11:24 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-45f889d6-1003-45e9-b4e8-95ce9d2c774a tempest-CreateVolumesFromImageTest-1081655338 None] Lock "cinder-quobyte-154bd914-2472-4b32-ba51-e2c23bbae31e" released by "delete_volume" :: held 1.492s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:11:25 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-45f889d6-1003-45e9-b4e8-95ce9d2c774a tempest-CreateVolumesFromImageTest-1081655338 None] Created reservations ['586daacb-7e5c-4a35-b6e6-80fd419fc174', '69ade524-9927-4c6e-8903-ce57e419ba1e', '24534b2e-a3c0-4da7-bfd6-687fa31416b9', 'dcda1467-5a0e-4bdf-9254-99fbbecbd7ea'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:11:25 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-45f889d6-1003-45e9-b4e8-95ce9d2c774a tempest-CreateVolumesFromImageTest-1081655338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:11:25 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-45f889d6-1003-45e9-b4e8-95ce9d2c774a tempest-CreateVolumesFromImageTest-1081655338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:11:25 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-45f889d6-1003-45e9-b4e8-95ce9d2c774a tempest-CreateVolumesFromImageTest-1081655338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:11:25 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-45f889d6-1003-45e9-b4e8-95ce9d2c774a tempest-CreateVolumesFromImageTest-1081655338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:11:25 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-45f889d6-1003-45e9-b4e8-95ce9d2c774a tempest-CreateVolumesFromImageTest-1081655338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:11:25 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-45f889d6-1003-45e9-b4e8-95ce9d2c774a tempest-CreateVolumesFromImageTest-1081655338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:11:25 devstack sudo[105602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:11:25 devstack sudo[105602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:11:25 devstack sudo[105599]: pam_unix(sudo:session): session closed for user root Jul 10 16:11:25 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-5c7c4552-77e5-4f7f-bde2-fcba5fa6f4dc tempest-VolumeDependencyTests-487079426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c4f93b5-3bba-4673-9d5e-4c0958a48a35 -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7c4f93b5-3bba-4673-9d5e-4c0958a48a35.ed21540a-9463-4857-888d-fa64b45b2a39" returned: 0 in 0.686s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:11:25 devstack cinder-volume[87420]: WARNING cinder.volume.drivers.remotefs [None req-5c7c4552-77e5-4f7f-bde2-fcba5fa6f4dc tempest-VolumeDependencyTests-487079426 None] /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7c4f93b5-3bba-4673-9d5e-4c0958a48a35.ed21540a-9463-4857-888d-fa64b45b2a39 is being set with open permissions: ugo+rw Jul 10 16:11:25 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-5c7c4552-77e5-4f7f-bde2-fcba5fa6f4dc tempest-VolumeDependencyTests-487079426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7c4f93b5-3bba-4673-9d5e-4c0958a48a35.ed21540a-9463-4857-888d-fa64b45b2a39 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:11:25 devstack sudo[105607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7c4f93b5-3bba-4673-9d5e-4c0958a48a35.ed21540a-9463-4857-888d-fa64b45b2a39 Jul 10 16:11:25 devstack sudo[105607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:11:25 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-9f724971-2e40-4564-bfd8-8230ef7ceaca tempest-CreateVolumesFromImageTest-1081655338 None] Acquiring lock "cinder-25793a81-dff0-48cb-9dc1-66662cf65fa7-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:11:25 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-9f724971-2e40-4564-bfd8-8230ef7ceaca tempest-CreateVolumesFromImageTest-1081655338 None] Lock "cinder-25793a81-dff0-48cb-9dc1-66662cf65fa7-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:11:25 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-9f724971-2e40-4564-bfd8-8230ef7ceaca tempest-CreateVolumesFromImageTest-1081655338 None] Acquiring lock "cinder-quobyte-25793a81-dff0-48cb-9dc1-66662cf65fa7" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:11:25 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-9f724971-2e40-4564-bfd8-8230ef7ceaca tempest-CreateVolumesFromImageTest-1081655338 None] Lock "cinder-quobyte-25793a81-dff0-48cb-9dc1-66662cf65fa7" acquired by "delete_volume" :: waited 0.019s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:11:25 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[39161fbd-932a-4e66-a984-e61c53e2667e]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:11:25 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-9f724971-2e40-4564-bfd8-8230ef7ceaca tempest-CreateVolumesFromImageTest-1081655338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-25793a81-dff0-48cb-9dc1-66662cf65fa7 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:11:25 devstack sudo[105602]: pam_unix(sudo:session): session closed for user root Jul 10 16:11:25 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-45f889d6-1003-45e9-b4e8-95ce9d2c774a tempest-CreateVolumesFromImageTest-1081655338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.703s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:11:25 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-45f889d6-1003-45e9-b4e8-95ce9d2c774a tempest-CreateVolumesFromImageTest-1081655338 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:11:25 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-45f889d6-1003-45e9-b4e8-95ce9d2c774a tempest-CreateVolumesFromImageTest-1081655338 None] Deleted volume successfully. Jul 10 16:11:25 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-45f889d6-1003-45e9-b4e8-95ce9d2c774a tempest-CreateVolumesFromImageTest-1081655338 None] Lock "cinder-154bd914-2472-4b32-ba51-e2c23bbae31e-delete_volume" released by "delete_volume" :: held 2.436s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:11:25 devstack sudo[105610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-25793a81-dff0-48cb-9dc1-66662cf65fa7 Jul 10 16:11:25 devstack sudo[105610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:11:26 devstack sudo[105607]: pam_unix(sudo:session): session closed for user root Jul 10 16:11:26 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-5c7c4552-77e5-4f7f-bde2-fcba5fa6f4dc tempest-VolumeDependencyTests-487079426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7c4f93b5-3bba-4673-9d5e-4c0958a48a35.ed21540a-9463-4857-888d-fa64b45b2a39" returned: 0 in 0.704s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:11:26 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-5c7c4552-77e5-4f7f-bde2-fcba5fa6f4dc tempest-VolumeDependencyTests-487079426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7c4f93b5-3bba-4673-9d5e-4c0958a48a35.info {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:11:26 devstack sudo[105613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7c4f93b5-3bba-4673-9d5e-4c0958a48a35.info Jul 10 16:11:26 devstack sudo[105613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:11:26 devstack sudo[105610]: pam_unix(sudo:session): session closed for user root Jul 10 16:11:26 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-9f724971-2e40-4564-bfd8-8230ef7ceaca tempest-CreateVolumesFromImageTest-1081655338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-25793a81-dff0-48cb-9dc1-66662cf65fa7" returned: 0 in 0.772s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:11:26 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-9f724971-2e40-4564-bfd8-8230ef7ceaca tempest-CreateVolumesFromImageTest-1081655338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-25793a81-dff0-48cb-9dc1-66662cf65fa7 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:11:26 devstack sudo[105618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-25793a81-dff0-48cb-9dc1-66662cf65fa7 Jul 10 16:11:26 devstack sudo[105618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:11:26 devstack sudo[105613]: pam_unix(sudo:session): session closed for user root Jul 10 16:11:26 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-5c7c4552-77e5-4f7f-bde2-fcba5fa6f4dc tempest-VolumeDependencyTests-487079426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7c4f93b5-3bba-4673-9d5e-4c0958a48a35.info" returned: 0 in 0.649s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:11:26 devstack cinder-volume[87420]: WARNING cinder.volume.drivers.remotefs [None req-5c7c4552-77e5-4f7f-bde2-fcba5fa6f4dc tempest-VolumeDependencyTests-487079426 None] /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7c4f93b5-3bba-4673-9d5e-4c0958a48a35.info is being set with open permissions: ugo+rw Jul 10 16:11:26 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-5c7c4552-77e5-4f7f-bde2-fcba5fa6f4dc tempest-VolumeDependencyTests-487079426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7c4f93b5-3bba-4673-9d5e-4c0958a48a35.info {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:11:26 devstack sudo[105621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7c4f93b5-3bba-4673-9d5e-4c0958a48a35.info Jul 10 16:11:26 devstack sudo[105621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:11:27 devstack sudo[105618]: pam_unix(sudo:session): session closed for user root Jul 10 16:11:27 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-9f724971-2e40-4564-bfd8-8230ef7ceaca tempest-CreateVolumesFromImageTest-1081655338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-25793a81-dff0-48cb-9dc1-66662cf65fa7" returned: 0 in 0.691s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:11:27 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-9f724971-2e40-4564-bfd8-8230ef7ceaca tempest-CreateVolumesFromImageTest-1081655338 None] Lock "cinder-quobyte-25793a81-dff0-48cb-9dc1-66662cf65fa7" released by "delete_volume" :: held 1.512s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:11:27 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-9f724971-2e40-4564-bfd8-8230ef7ceaca tempest-CreateVolumesFromImageTest-1081655338 None] Created reservations ['ce5c11cc-e909-40f8-8b1e-95e9dec112dd', '219f2bb7-2673-4029-a5d1-1f6423003895', 'f24178a5-ac26-4eff-a06b-8dbb79656ef7', '3c30640c-82f8-4c22-a612-58fc5e0f8f1f'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:11:27 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-9f724971-2e40-4564-bfd8-8230ef7ceaca tempest-CreateVolumesFromImageTest-1081655338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:11:27 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-9f724971-2e40-4564-bfd8-8230ef7ceaca tempest-CreateVolumesFromImageTest-1081655338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:11:27 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-9f724971-2e40-4564-bfd8-8230ef7ceaca tempest-CreateVolumesFromImageTest-1081655338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:11:27 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-9f724971-2e40-4564-bfd8-8230ef7ceaca tempest-CreateVolumesFromImageTest-1081655338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:11:27 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-9f724971-2e40-4564-bfd8-8230ef7ceaca tempest-CreateVolumesFromImageTest-1081655338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:11:27 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-9f724971-2e40-4564-bfd8-8230ef7ceaca tempest-CreateVolumesFromImageTest-1081655338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:11:27 devstack sudo[105624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:11:27 devstack sudo[105624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:11:27 devstack sudo[105621]: pam_unix(sudo:session): session closed for user root Jul 10 16:11:27 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-5c7c4552-77e5-4f7f-bde2-fcba5fa6f4dc tempest-VolumeDependencyTests-487079426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7c4f93b5-3bba-4673-9d5e-4c0958a48a35.info" returned: 0 in 0.671s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:11:27 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-5c7c4552-77e5-4f7f-bde2-fcba5fa6f4dc tempest-VolumeDependencyTests-487079426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.455s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:11:27 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-d949f657-0829-439f-a33f-2b793b2a2a00 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.593s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:11:27 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-d949f657-0829-439f-a33f-2b793b2a2a00 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Creating offline snapshot f7d6a443-ccfa-4e36-a091-4ef7dc684d94 of volume aa0bcde3-519e-47f8-9f83-baa1d1d7eac3 {{(pid=87420) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 16:11:27 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-5c7c4552-77e5-4f7f-bde2-fcba5fa6f4dc tempest-VolumeDependencyTests-487079426 None] Create snapshot completed successfully Jul 10 16:11:27 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d05f79f-04d1-4f7f-bbaf-01e4acd5dbc5]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:11:27 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d949f657-0829-439f-a33f-2b793b2a2a00 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-aa0bcde3-519e-47f8-9f83-baa1d1d7eac3 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:11:27 devstack sudo[105627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-aa0bcde3-519e-47f8-9f83-baa1d1d7eac3 Jul 10 16:11:27 devstack sudo[105627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:11:27 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-184b4f11-34ff-459f-93de-a665a282707c tempest-CreateVolumesFromImageTest-1081655338 None] Acquiring lock "cinder-1a064676-aba0-4dac-9946-03f5982f5d10-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:11:27 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-184b4f11-34ff-459f-93de-a665a282707c tempest-CreateVolumesFromImageTest-1081655338 None] Lock "cinder-1a064676-aba0-4dac-9946-03f5982f5d10-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:11:27 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-184b4f11-34ff-459f-93de-a665a282707c tempest-CreateVolumesFromImageTest-1081655338 None] Acquiring lock "cinder-quobyte-1a064676-aba0-4dac-9946-03f5982f5d10" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:11:27 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-184b4f11-34ff-459f-93de-a665a282707c tempest-CreateVolumesFromImageTest-1081655338 None] Lock "cinder-quobyte-1a064676-aba0-4dac-9946-03f5982f5d10" acquired by "delete_volume" :: waited 0.020s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:11:27 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6072d96-a1a6-4db9-8184-9bb302883d30]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:11:27 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-184b4f11-34ff-459f-93de-a665a282707c tempest-CreateVolumesFromImageTest-1081655338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1a064676-aba0-4dac-9946-03f5982f5d10 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:11:28 devstack sudo[105624]: pam_unix(sudo:session): session closed for user root Jul 10 16:11:28 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-9f724971-2e40-4564-bfd8-8230ef7ceaca tempest-CreateVolumesFromImageTest-1081655338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.715s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:11:28 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-9f724971-2e40-4564-bfd8-8230ef7ceaca tempest-CreateVolumesFromImageTest-1081655338 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:11:28 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-9f724971-2e40-4564-bfd8-8230ef7ceaca tempest-CreateVolumesFromImageTest-1081655338 None] Deleted volume successfully. Jul 10 16:11:28 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-9f724971-2e40-4564-bfd8-8230ef7ceaca tempest-CreateVolumesFromImageTest-1081655338 None] Lock "cinder-25793a81-dff0-48cb-9dc1-66662cf65fa7-delete_volume" released by "delete_volume" :: held 2.449s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:11:28 devstack sudo[105630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1a064676-aba0-4dac-9946-03f5982f5d10 Jul 10 16:11:28 devstack sudo[105630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:11:28 devstack sudo[105627]: pam_unix(sudo:session): session closed for user root Jul 10 16:11:28 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d949f657-0829-439f-a33f-2b793b2a2a00 tempest-CreateVolumesFromSnapshotTest-1937876261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-aa0bcde3-519e-47f8-9f83-baa1d1d7eac3" returned: 0 in 0.915s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:11:28 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d949f657-0829-439f-a33f-2b793b2a2a00 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-aa0bcde3-519e-47f8-9f83-baa1d1d7eac3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-aa0bcde3-519e-47f8-9f83-baa1d1d7eac3.f7d6a443-ccfa-4e36-a091-4ef7dc684d94 1G {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:11:28 devstack sudo[105635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-aa0bcde3-519e-47f8-9f83-baa1d1d7eac3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-aa0bcde3-519e-47f8-9f83-baa1d1d7eac3.f7d6a443-ccfa-4e36-a091-4ef7dc684d94 1G Jul 10 16:11:28 devstack sudo[105635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:11:28 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-b907d919-2b1b-4182-a330-40785a7f14f7 tempest-VolumeDependencyTests-487079426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 16:11:28 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b907d919-2b1b-4182-a330-40785a7f14f7 tempest-VolumeDependencyTests-487079426 None] Flow 'volume_create_manager' (e8cd86c4-3049-4031-bae3-394576f4bd97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:11:28 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b907d919-2b1b-4182-a330-40785a7f14f7 tempest-VolumeDependencyTests-487079426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ffb2d86-2683-44d4-90ee-2fe7c94347c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:28 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b907d919-2b1b-4182-a330-40785a7f14f7 tempest-VolumeDependencyTests-487079426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ffb2d86-2683-44d4-90ee-2fe7c94347c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:11:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-738886308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2892ae94-b522-4de4-92b3-9b6a5a90e540,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff43d15ccd3f4783ba32dad837d7ca89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:11:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ed21540a-9463-4857-888d-fa64b45b2a39,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:11:29Z,use_quota=True,user_id='6929acb9dce840d78ec984053432fc07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:28 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b907d919-2b1b-4182-a330-40785a7f14f7 tempest-VolumeDependencyTests-487079426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b3493eb-4f1b-4936-bf90-908a8c6ca7ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:28 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b907d919-2b1b-4182-a330-40785a7f14f7 tempest-VolumeDependencyTests-487079426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b3493eb-4f1b-4936-bf90-908a8c6ca7ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:28 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b907d919-2b1b-4182-a330-40785a7f14f7 tempest-VolumeDependencyTests-487079426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f23d715-e269-46ee-8af7-12b741ccf80e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:28 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b907d919-2b1b-4182-a330-40785a7f14f7 tempest-VolumeDependencyTests-487079426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f23d715-e269-46ee-8af7-12b741ccf80e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2892ae94-b522-4de4-92b3-9b6a5a90e540', 'volume_name': 'volume-2892ae94-b522-4de4-92b3-9b6a5a90e540', 'volume_size': 1, 'snapshot_id': 'ed21540a-9463-4857-888d-fa64b45b2a39'}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:28 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b907d919-2b1b-4182-a330-40785a7f14f7 tempest-VolumeDependencyTests-487079426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d922dde-8076-41aa-aeda-45ee814ae609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:28 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b907d919-2b1b-4182-a330-40785a7f14f7 tempest-VolumeDependencyTests-487079426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d922dde-8076-41aa-aeda-45ee814ae609) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:28 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b907d919-2b1b-4182-a330-40785a7f14f7 tempest-VolumeDependencyTests-487079426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e416025-6bde-4401-b356-f25184ed3bcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:28 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-b907d919-2b1b-4182-a330-40785a7f14f7 tempest-VolumeDependencyTests-487079426 None] Volume 2892ae94-b522-4de4-92b3-9b6a5a90e540: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2892ae94-b522-4de4-92b3-9b6a5a90e540', 'volume_size': 1, 'snapshot_id': 'ed21540a-9463-4857-888d-fa64b45b2a39'} Jul 10 16:11:28 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-b907d919-2b1b-4182-a330-40785a7f14f7 tempest-VolumeDependencyTests-487079426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:11:28 devstack sudo[105630]: pam_unix(sudo:session): session closed for user root Jul 10 16:11:28 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-184b4f11-34ff-459f-93de-a665a282707c tempest-CreateVolumesFromImageTest-1081655338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1a064676-aba0-4dac-9946-03f5982f5d10" returned: 0 in 0.870s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:11:28 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-184b4f11-34ff-459f-93de-a665a282707c tempest-CreateVolumesFromImageTest-1081655338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1a064676-aba0-4dac-9946-03f5982f5d10 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:11:28 devstack sudo[105640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1a064676-aba0-4dac-9946-03f5982f5d10 Jul 10 16:11:28 devstack sudo[105640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:11:29 devstack sudo[105635]: pam_unix(sudo:session): session closed for user root Jul 10 16:11:29 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d949f657-0829-439f-a33f-2b793b2a2a00 tempest-CreateVolumesFromSnapshotTest-1937876261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-aa0bcde3-519e-47f8-9f83-baa1d1d7eac3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-aa0bcde3-519e-47f8-9f83-baa1d1d7eac3.f7d6a443-ccfa-4e36-a091-4ef7dc684d94 1G" returned: 0 in 0.843s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:11:29 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d949f657-0829-439f-a33f-2b793b2a2a00 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa0bcde3-519e-47f8-9f83-baa1d1d7eac3 -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-aa0bcde3-519e-47f8-9f83-baa1d1d7eac3.f7d6a443-ccfa-4e36-a091-4ef7dc684d94 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:11:29 devstack sudo[105645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa0bcde3-519e-47f8-9f83-baa1d1d7eac3 -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-aa0bcde3-519e-47f8-9f83-baa1d1d7eac3.f7d6a443-ccfa-4e36-a091-4ef7dc684d94 Jul 10 16:11:29 devstack sudo[105645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:11:29 devstack sudo[105640]: pam_unix(sudo:session): session closed for user root Jul 10 16:11:29 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-184b4f11-34ff-459f-93de-a665a282707c tempest-CreateVolumesFromImageTest-1081655338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1a064676-aba0-4dac-9946-03f5982f5d10" returned: 0 in 0.682s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:11:29 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-184b4f11-34ff-459f-93de-a665a282707c tempest-CreateVolumesFromImageTest-1081655338 None] Lock "cinder-quobyte-1a064676-aba0-4dac-9946-03f5982f5d10" released by "delete_volume" :: held 1.604s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:11:29 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-184b4f11-34ff-459f-93de-a665a282707c tempest-CreateVolumesFromImageTest-1081655338 None] Created reservations ['28acb2b1-f95e-4230-a7e4-103b351407ae', '75895f56-a1bb-44ff-a650-e9ee302f77ff', 'ccdddd14-026d-4be3-9d03-c71315832b68', '87b1b235-e5df-4126-850b-2fd0f1409950'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:11:29 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-184b4f11-34ff-459f-93de-a665a282707c tempest-CreateVolumesFromImageTest-1081655338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:11:29 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-184b4f11-34ff-459f-93de-a665a282707c tempest-CreateVolumesFromImageTest-1081655338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:11:29 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-184b4f11-34ff-459f-93de-a665a282707c tempest-CreateVolumesFromImageTest-1081655338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:11:29 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-184b4f11-34ff-459f-93de-a665a282707c tempest-CreateVolumesFromImageTest-1081655338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:11:29 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-184b4f11-34ff-459f-93de-a665a282707c tempest-CreateVolumesFromImageTest-1081655338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:11:29 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-184b4f11-34ff-459f-93de-a665a282707c tempest-CreateVolumesFromImageTest-1081655338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:11:29 devstack sudo[105648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:11:29 devstack sudo[105648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:11:29 devstack sudo[105645]: pam_unix(sudo:session): session closed for user root Jul 10 16:11:29 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d949f657-0829-439f-a33f-2b793b2a2a00 tempest-CreateVolumesFromSnapshotTest-1937876261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa0bcde3-519e-47f8-9f83-baa1d1d7eac3 -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-aa0bcde3-519e-47f8-9f83-baa1d1d7eac3.f7d6a443-ccfa-4e36-a091-4ef7dc684d94" returned: 0 in 0.696s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:11:29 devstack cinder-volume[87420]: WARNING cinder.volume.drivers.remotefs [None req-d949f657-0829-439f-a33f-2b793b2a2a00 tempest-CreateVolumesFromSnapshotTest-1937876261 None] /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-aa0bcde3-519e-47f8-9f83-baa1d1d7eac3.f7d6a443-ccfa-4e36-a091-4ef7dc684d94 is being set with open permissions: ugo+rw Jul 10 16:11:29 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d949f657-0829-439f-a33f-2b793b2a2a00 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-aa0bcde3-519e-47f8-9f83-baa1d1d7eac3.f7d6a443-ccfa-4e36-a091-4ef7dc684d94 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:11:29 devstack sudo[105653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-aa0bcde3-519e-47f8-9f83-baa1d1d7eac3.f7d6a443-ccfa-4e36-a091-4ef7dc684d94 Jul 10 16:11:30 devstack sudo[105653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:11:30 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-4eb62494-361a-473e-8906-eb2fafc665e5 tempest-CreateVolumesFromImageTest-1081655338 None] Acquiring lock "cinder-e4ca947e-bce6-4e2a-ac95-6bad0e06342d-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:11:30 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-4eb62494-361a-473e-8906-eb2fafc665e5 tempest-CreateVolumesFromImageTest-1081655338 None] Lock "cinder-e4ca947e-bce6-4e2a-ac95-6bad0e06342d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:11:30 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-4eb62494-361a-473e-8906-eb2fafc665e5 tempest-CreateVolumesFromImageTest-1081655338 None] Acquiring lock "cinder-quobyte-e4ca947e-bce6-4e2a-ac95-6bad0e06342d" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:11:30 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-4eb62494-361a-473e-8906-eb2fafc665e5 tempest-CreateVolumesFromImageTest-1081655338 None] Lock "cinder-quobyte-e4ca947e-bce6-4e2a-ac95-6bad0e06342d" acquired by "delete_volume" :: waited 0.024s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:11:30 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf1f0cdc-113b-4a28-b485-7638b689c4ff]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:11:30 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4eb62494-361a-473e-8906-eb2fafc665e5 tempest-CreateVolumesFromImageTest-1081655338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-e4ca947e-bce6-4e2a-ac95-6bad0e06342d {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:11:30 devstack sudo[105655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-e4ca947e-bce6-4e2a-ac95-6bad0e06342d Jul 10 16:11:30 devstack sudo[105655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:11:30 devstack sudo[105648]: pam_unix(sudo:session): session closed for user root Jul 10 16:11:30 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-184b4f11-34ff-459f-93de-a665a282707c tempest-CreateVolumesFromImageTest-1081655338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.688s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:11:30 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-184b4f11-34ff-459f-93de-a665a282707c tempest-CreateVolumesFromImageTest-1081655338 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:11:30 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-184b4f11-34ff-459f-93de-a665a282707c tempest-CreateVolumesFromImageTest-1081655338 None] Deleted volume successfully. Jul 10 16:11:30 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-184b4f11-34ff-459f-93de-a665a282707c tempest-CreateVolumesFromImageTest-1081655338 None] Lock "cinder-1a064676-aba0-4dac-9946-03f5982f5d10-delete_volume" released by "delete_volume" :: held 2.522s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:11:30 devstack sudo[105653]: pam_unix(sudo:session): session closed for user root Jul 10 16:11:30 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d949f657-0829-439f-a33f-2b793b2a2a00 tempest-CreateVolumesFromSnapshotTest-1937876261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-aa0bcde3-519e-47f8-9f83-baa1d1d7eac3.f7d6a443-ccfa-4e36-a091-4ef7dc684d94" returned: 0 in 0.694s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:11:30 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d949f657-0829-439f-a33f-2b793b2a2a00 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-aa0bcde3-519e-47f8-9f83-baa1d1d7eac3.info {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:11:30 devstack sudo[105659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-aa0bcde3-519e-47f8-9f83-baa1d1d7eac3.info Jul 10 16:11:30 devstack sudo[105659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:11:31 devstack sudo[105655]: pam_unix(sudo:session): session closed for user root Jul 10 16:11:31 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4eb62494-361a-473e-8906-eb2fafc665e5 tempest-CreateVolumesFromImageTest-1081655338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-e4ca947e-bce6-4e2a-ac95-6bad0e06342d" returned: 0 in 0.804s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:11:31 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4eb62494-361a-473e-8906-eb2fafc665e5 tempest-CreateVolumesFromImageTest-1081655338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-e4ca947e-bce6-4e2a-ac95-6bad0e06342d {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:11:31 devstack sudo[105664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-e4ca947e-bce6-4e2a-ac95-6bad0e06342d Jul 10 16:11:31 devstack sudo[105664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:11:31 devstack sudo[105659]: pam_unix(sudo:session): session closed for user root Jul 10 16:11:31 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d949f657-0829-439f-a33f-2b793b2a2a00 tempest-CreateVolumesFromSnapshotTest-1937876261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-aa0bcde3-519e-47f8-9f83-baa1d1d7eac3.info" returned: 0 in 0.657s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:11:31 devstack cinder-volume[87420]: WARNING cinder.volume.drivers.remotefs [None req-d949f657-0829-439f-a33f-2b793b2a2a00 tempest-CreateVolumesFromSnapshotTest-1937876261 None] /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-aa0bcde3-519e-47f8-9f83-baa1d1d7eac3.info is being set with open permissions: ugo+rw Jul 10 16:11:31 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d949f657-0829-439f-a33f-2b793b2a2a00 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-aa0bcde3-519e-47f8-9f83-baa1d1d7eac3.info {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:11:31 devstack sudo[105667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-aa0bcde3-519e-47f8-9f83-baa1d1d7eac3.info Jul 10 16:11:31 devstack sudo[105667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:11:31 devstack sudo[105664]: pam_unix(sudo:session): session closed for user root Jul 10 16:11:31 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4eb62494-361a-473e-8906-eb2fafc665e5 tempest-CreateVolumesFromImageTest-1081655338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-e4ca947e-bce6-4e2a-ac95-6bad0e06342d" returned: 0 in 0.637s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:11:31 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-4eb62494-361a-473e-8906-eb2fafc665e5 tempest-CreateVolumesFromImageTest-1081655338 None] Lock "cinder-quobyte-e4ca947e-bce6-4e2a-ac95-6bad0e06342d" released by "delete_volume" :: held 1.492s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:11:31 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-4eb62494-361a-473e-8906-eb2fafc665e5 tempest-CreateVolumesFromImageTest-1081655338 None] Created reservations ['be347346-2545-4c32-9158-b0a0cb3c045e', '0e037b9b-8e26-49d0-884f-6328d230b2dd', 'a5c37fd0-26dd-47b7-9ffe-4c694f026922', 'ae4a11d8-57f6-4ccc-9792-8d258e9f1393'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:11:31 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-4eb62494-361a-473e-8906-eb2fafc665e5 tempest-CreateVolumesFromImageTest-1081655338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:11:31 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-4eb62494-361a-473e-8906-eb2fafc665e5 tempest-CreateVolumesFromImageTest-1081655338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:11:31 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-4eb62494-361a-473e-8906-eb2fafc665e5 tempest-CreateVolumesFromImageTest-1081655338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:11:31 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-4eb62494-361a-473e-8906-eb2fafc665e5 tempest-CreateVolumesFromImageTest-1081655338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:11:31 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-4eb62494-361a-473e-8906-eb2fafc665e5 tempest-CreateVolumesFromImageTest-1081655338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:11:31 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4eb62494-361a-473e-8906-eb2fafc665e5 tempest-CreateVolumesFromImageTest-1081655338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:11:31 devstack sudo[105670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:11:31 devstack sudo[105670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:11:31 devstack sudo[105667]: pam_unix(sudo:session): session closed for user root Jul 10 16:11:31 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d949f657-0829-439f-a33f-2b793b2a2a00 tempest-CreateVolumesFromSnapshotTest-1937876261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-aa0bcde3-519e-47f8-9f83-baa1d1d7eac3.info" returned: 0 in 0.640s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:11:32 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-d949f657-0829-439f-a33f-2b793b2a2a00 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.545s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:11:32 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-f4f07e6c-13bf-47e3-acc2-1795b1a32d7e tempest-VolumeAndVolumeTypeFromImageTest-845300768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.834s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:11:32 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-f4f07e6c-13bf-47e3-acc2-1795b1a32d7e tempest-VolumeAndVolumeTypeFromImageTest-845300768 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:11:15Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e005892-38b5-4421-8bc9-72b7c35ae367,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c323b81f6da4a36bcc1f57a47629059',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:11:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:11:15Z,use_quota=True,user_id='395374bcf6cb4beba7744037a996d349',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b3002e3-94b5-4d2f-9d8f-da7b3d8e78fd),volume_type_id=9b3002e3-94b5-4d2f-9d8f-da7b3d8e78fd)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 16:11:32 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-f4f07e6c-13bf-47e3-acc2-1795b1a32d7e tempest-VolumeAndVolumeTypeFromImageTest-845300768 None] Creating volume 1e005892-38b5-4421-8bc9-72b7c35ae367 {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 16:11:32 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-f4f07e6c-13bf-47e3-acc2-1795b1a32d7e tempest-VolumeAndVolumeTypeFromImageTest-845300768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:11:32 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-f4f07e6c-13bf-47e3-acc2-1795b1a32d7e tempest-VolumeAndVolumeTypeFromImageTest-845300768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:11:32 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-f4f07e6c-13bf-47e3-acc2-1795b1a32d7e tempest-VolumeAndVolumeTypeFromImageTest-845300768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:11:32 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-f4f07e6c-13bf-47e3-acc2-1795b1a32d7e tempest-VolumeAndVolumeTypeFromImageTest-845300768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:11:32 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-f4f07e6c-13bf-47e3-acc2-1795b1a32d7e tempest-VolumeAndVolumeTypeFromImageTest-845300768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:11:32 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-f4f07e6c-13bf-47e3-acc2-1795b1a32d7e tempest-VolumeAndVolumeTypeFromImageTest-845300768 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 16:11:32 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-f4f07e6c-13bf-47e3-acc2-1795b1a32d7e tempest-VolumeAndVolumeTypeFromImageTest-845300768 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 16:11:32 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f4f07e6c-13bf-47e3-acc2-1795b1a32d7e tempest-VolumeAndVolumeTypeFromImageTest-845300768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1e005892-38b5-4421-8bc9-72b7c35ae367 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:11:32 devstack sudo[105673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1e005892-38b5-4421-8bc9-72b7c35ae367 1073741824 Jul 10 16:11:32 devstack sudo[105673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:11:32 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-d949f657-0829-439f-a33f-2b793b2a2a00 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Create snapshot completed successfully Jul 10 16:11:32 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-ff2f6522-584a-4bbc-aff8-eedd13932c1a tempest-CreateVolumesFromImageTest-1081655338 None] Acquiring lock "cinder-489159d0-470e-4219-97dd-5ce37db36a49-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:11:32 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-ff2f6522-584a-4bbc-aff8-eedd13932c1a tempest-CreateVolumesFromImageTest-1081655338 None] Lock "cinder-489159d0-470e-4219-97dd-5ce37db36a49-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:11:32 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-ff2f6522-584a-4bbc-aff8-eedd13932c1a tempest-CreateVolumesFromImageTest-1081655338 None] Acquiring lock "cinder-quobyte-489159d0-470e-4219-97dd-5ce37db36a49" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:11:32 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-ff2f6522-584a-4bbc-aff8-eedd13932c1a tempest-CreateVolumesFromImageTest-1081655338 None] Lock "cinder-quobyte-489159d0-470e-4219-97dd-5ce37db36a49" acquired by "delete_volume" :: waited 0.028s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:11:32 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf78626-ee90-467e-94fe-b64ef5a15d40]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:11:32 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ff2f6522-584a-4bbc-aff8-eedd13932c1a tempest-CreateVolumesFromImageTest-1081655338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-489159d0-470e-4219-97dd-5ce37db36a49 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:11:32 devstack sudo[105670]: pam_unix(sudo:session): session closed for user root Jul 10 16:11:32 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4eb62494-361a-473e-8906-eb2fafc665e5 tempest-CreateVolumesFromImageTest-1081655338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.756s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:11:32 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-4eb62494-361a-473e-8906-eb2fafc665e5 tempest-CreateVolumesFromImageTest-1081655338 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:11:32 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-4eb62494-361a-473e-8906-eb2fafc665e5 tempest-CreateVolumesFromImageTest-1081655338 None] Deleted volume successfully. Jul 10 16:11:32 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-4eb62494-361a-473e-8906-eb2fafc665e5 tempest-CreateVolumesFromImageTest-1081655338 None] Lock "cinder-e4ca947e-bce6-4e2a-ac95-6bad0e06342d-delete_volume" released by "delete_volume" :: held 2.482s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:11:32 devstack sudo[105676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-489159d0-470e-4219-97dd-5ce37db36a49 Jul 10 16:11:32 devstack sudo[105676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:11:32 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-39dc7e93-8e84-4829-884d-92780ad8f161 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 16:11:32 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-39dc7e93-8e84-4829-884d-92780ad8f161 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Flow 'volume_create_manager' (0764cf31-51f1-48d4-88ba-a182e6edef17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:11:33 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-39dc7e93-8e84-4829-884d-92780ad8f161 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5aa8feec-6fa2-43ad-9bd5-335d8b948552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:33 devstack sudo[105673]: pam_unix(sudo:session): session closed for user root Jul 10 16:11:33 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f4f07e6c-13bf-47e3-acc2-1795b1a32d7e tempest-VolumeAndVolumeTypeFromImageTest-845300768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1e005892-38b5-4421-8bc9-72b7c35ae367 1073741824" returned: 0 in 0.998s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:11:33 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-39dc7e93-8e84-4829-884d-92780ad8f161 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5aa8feec-6fa2-43ad-9bd5-335d8b948552) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:11:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-986567745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00e89551-b7a0-4b20-a11d-1da1c0368d13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='678e21887f8741fb9422fce1a779fd85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:11:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:11:33Z,use_quota=True,user_id='b738bea705274c419027b9dd4a126358',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:33 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-39dc7e93-8e84-4829-884d-92780ad8f161 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b46825b-f8b1-4e5e-8792-5e4035704dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:33 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-39dc7e93-8e84-4829-884d-92780ad8f161 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b46825b-f8b1-4e5e-8792-5e4035704dfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:33 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-39dc7e93-8e84-4829-884d-92780ad8f161 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61dfeaf4-b66a-4435-b30c-ddff39e79d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:33 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-39dc7e93-8e84-4829-884d-92780ad8f161 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61dfeaf4-b66a-4435-b30c-ddff39e79d07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00e89551-b7a0-4b20-a11d-1da1c0368d13', 'volume_name': 'volume-00e89551-b7a0-4b20-a11d-1da1c0368d13', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:33 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-39dc7e93-8e84-4829-884d-92780ad8f161 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a7153a0-a7ee-412f-93c6-ca223e7a91d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:33 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-39dc7e93-8e84-4829-884d-92780ad8f161 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a7153a0-a7ee-412f-93c6-ca223e7a91d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:33 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-39dc7e93-8e84-4829-884d-92780ad8f161 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (932bb816-790d-40cb-b860-dd47e8046c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:33 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-39dc7e93-8e84-4829-884d-92780ad8f161 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Volume 00e89551-b7a0-4b20-a11d-1da1c0368d13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00e89551-b7a0-4b20-a11d-1da1c0368d13', 'volume_size': 1} Jul 10 16:11:33 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-39dc7e93-8e84-4829-884d-92780ad8f161 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:11:33 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f4f07e6c-13bf-47e3-acc2-1795b1a32d7e tempest-VolumeAndVolumeTypeFromImageTest-845300768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1e005892-38b5-4421-8bc9-72b7c35ae367 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:11:33 devstack sudo[105682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1e005892-38b5-4421-8bc9-72b7c35ae367 Jul 10 16:11:33 devstack sudo[105682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:11:33 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-a89c1d7b-bf9a-44b7-87dd-6a2cc6d074b2 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 16:11:33 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-a89c1d7b-bf9a-44b7-87dd-6a2cc6d074b2 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Flow 'volume_create_manager' (d1078c19-7478-46c3-b123-abaf191e1123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:11:33 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-a89c1d7b-bf9a-44b7-87dd-6a2cc6d074b2 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ad5c3d0-47c3-49f0-b833-0fc76447d02a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:33 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-a89c1d7b-bf9a-44b7-87dd-6a2cc6d074b2 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ad5c3d0-47c3-49f0-b833-0fc76447d02a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:11:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-98855908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3912bc6-d421-4f30-8879-5af749e14a7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='678e21887f8741fb9422fce1a779fd85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:11:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:11:33Z,use_quota=True,user_id='b738bea705274c419027b9dd4a126358',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:33 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-a89c1d7b-bf9a-44b7-87dd-6a2cc6d074b2 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea836dd8-27e1-4836-9195-d9598e9b6601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:33 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-a89c1d7b-bf9a-44b7-87dd-6a2cc6d074b2 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea836dd8-27e1-4836-9195-d9598e9b6601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:33 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-a89c1d7b-bf9a-44b7-87dd-6a2cc6d074b2 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82bd2725-59f4-485d-a4c3-c77c5a768392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:33 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-a89c1d7b-bf9a-44b7-87dd-6a2cc6d074b2 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82bd2725-59f4-485d-a4c3-c77c5a768392) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3912bc6-d421-4f30-8879-5af749e14a7d', 'volume_name': 'volume-c3912bc6-d421-4f30-8879-5af749e14a7d', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:33 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-a89c1d7b-bf9a-44b7-87dd-6a2cc6d074b2 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6460b11c-c643-4a4a-8792-2597a55940cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:33 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-a89c1d7b-bf9a-44b7-87dd-6a2cc6d074b2 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6460b11c-c643-4a4a-8792-2597a55940cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:33 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-a89c1d7b-bf9a-44b7-87dd-6a2cc6d074b2 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe274daa-a7cf-4f80-af37-7978eee06e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:33 devstack sudo[105676]: pam_unix(sudo:session): session closed for user root Jul 10 16:11:33 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-a89c1d7b-bf9a-44b7-87dd-6a2cc6d074b2 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Volume c3912bc6-d421-4f30-8879-5af749e14a7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3912bc6-d421-4f30-8879-5af749e14a7d', 'volume_size': 1} Jul 10 16:11:33 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-a89c1d7b-bf9a-44b7-87dd-6a2cc6d074b2 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:11:33 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ff2f6522-584a-4bbc-aff8-eedd13932c1a tempest-CreateVolumesFromImageTest-1081655338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-489159d0-470e-4219-97dd-5ce37db36a49" returned: 0 in 0.978s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:11:33 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ff2f6522-584a-4bbc-aff8-eedd13932c1a tempest-CreateVolumesFromImageTest-1081655338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-489159d0-470e-4219-97dd-5ce37db36a49 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:11:33 devstack sudo[105687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-489159d0-470e-4219-97dd-5ce37db36a49 Jul 10 16:11:33 devstack sudo[105687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:11:33 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-13ff03d4-bbb4-4b50-bcf9-bd56d7ac913f tempest-CreateVolumesFromSnapshotTest-1937876261 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 16:11:33 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-13ff03d4-bbb4-4b50-bcf9-bd56d7ac913f tempest-CreateVolumesFromSnapshotTest-1937876261 None] Flow 'volume_create_manager' (349ba1f9-7b5d-429e-a591-1ca662b60388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:11:33 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-13ff03d4-bbb4-4b50-bcf9-bd56d7ac913f tempest-CreateVolumesFromSnapshotTest-1937876261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24f67342-c3b1-47ad-8788-bb1030e5c5d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:33 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-13ff03d4-bbb4-4b50-bcf9-bd56d7ac913f tempest-CreateVolumesFromSnapshotTest-1937876261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24f67342-c3b1-47ad-8788-bb1030e5c5d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:11:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-289412801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa0fbae9-8218-499a-9938-9f838f11ee8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='678e21887f8741fb9422fce1a779fd85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:11:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:11:34Z,use_quota=True,user_id='b738bea705274c419027b9dd4a126358',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:33 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-13ff03d4-bbb4-4b50-bcf9-bd56d7ac913f tempest-CreateVolumesFromSnapshotTest-1937876261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6a0b374-9ad3-4496-ab58-77dfcdcdc9d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:33 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-13ff03d4-bbb4-4b50-bcf9-bd56d7ac913f tempest-CreateVolumesFromSnapshotTest-1937876261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6a0b374-9ad3-4496-ab58-77dfcdcdc9d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:33 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-13ff03d4-bbb4-4b50-bcf9-bd56d7ac913f tempest-CreateVolumesFromSnapshotTest-1937876261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5425926-5b06-4346-977f-dd834d302256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:33 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-13ff03d4-bbb4-4b50-bcf9-bd56d7ac913f tempest-CreateVolumesFromSnapshotTest-1937876261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5425926-5b06-4346-977f-dd834d302256) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa0fbae9-8218-499a-9938-9f838f11ee8d', 'volume_name': 'volume-fa0fbae9-8218-499a-9938-9f838f11ee8d', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:33 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-13ff03d4-bbb4-4b50-bcf9-bd56d7ac913f tempest-CreateVolumesFromSnapshotTest-1937876261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95325ab8-25a6-4609-98e3-705a1cbb4964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:33 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-13ff03d4-bbb4-4b50-bcf9-bd56d7ac913f tempest-CreateVolumesFromSnapshotTest-1937876261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95325ab8-25a6-4609-98e3-705a1cbb4964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:33 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-13ff03d4-bbb4-4b50-bcf9-bd56d7ac913f tempest-CreateVolumesFromSnapshotTest-1937876261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc5f948b-d03f-445d-a8ba-2d36f717da90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:33 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-13ff03d4-bbb4-4b50-bcf9-bd56d7ac913f tempest-CreateVolumesFromSnapshotTest-1937876261 None] Volume fa0fbae9-8218-499a-9938-9f838f11ee8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa0fbae9-8218-499a-9938-9f838f11ee8d', 'volume_size': 1} Jul 10 16:11:33 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-13ff03d4-bbb4-4b50-bcf9-bd56d7ac913f tempest-CreateVolumesFromSnapshotTest-1937876261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:11:33 devstack sudo[105682]: pam_unix(sudo:session): session closed for user root Jul 10 16:11:33 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f4f07e6c-13bf-47e3-acc2-1795b1a32d7e tempest-VolumeAndVolumeTypeFromImageTest-845300768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1e005892-38b5-4421-8bc9-72b7c35ae367" returned: 0 in 0.793s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:11:33 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-f4f07e6c-13bf-47e3-acc2-1795b1a32d7e tempest-VolumeAndVolumeTypeFromImageTest-845300768 None] <== create_volume: return (1876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 16:11:33 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-f4f07e6c-13bf-47e3-acc2-1795b1a32d7e tempest-VolumeAndVolumeTypeFromImageTest-845300768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.879s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:11:33 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-b907d919-2b1b-4182-a330-40785a7f14f7 tempest-VolumeDependencyTests-487079426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 5.157s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:11:33 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-b907d919-2b1b-4182-a330-40785a7f14f7 tempest-VolumeDependencyTests-487079426 None] Acquiring lock "cinder-quobyte-ed21540a-9463-4857-888d-fa64b45b2a39-2892ae94-b522-4de4-92b3-9b6a5a90e540" by "_create_volume_from_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:11:33 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-b907d919-2b1b-4182-a330-40785a7f14f7 tempest-VolumeDependencyTests-487079426 None] Lock "cinder-quobyte-ed21540a-9463-4857-888d-fa64b45b2a39-2892ae94-b522-4de4-92b3-9b6a5a90e540" acquired by "_create_volume_from_snapshot" :: waited 0.030s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:11:33 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-b907d919-2b1b-4182-a330-40785a7f14f7 tempest-VolumeDependencyTests-487079426 None] Creating volume 2892ae94-b522-4de4-92b3-9b6a5a90e540 from snapshot ed21540a-9463-4857-888d-fa64b45b2a39 {{(pid=87420) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 10 16:11:33 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-b907d919-2b1b-4182-a330-40785a7f14f7 tempest-VolumeDependencyTests-487079426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:11:33 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-b907d919-2b1b-4182-a330-40785a7f14f7 tempest-VolumeDependencyTests-487079426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:11:33 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-b907d919-2b1b-4182-a330-40785a7f14f7 tempest-VolumeDependencyTests-487079426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:11:33 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-b907d919-2b1b-4182-a330-40785a7f14f7 tempest-VolumeDependencyTests-487079426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:11:33 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-b907d919-2b1b-4182-a330-40785a7f14f7 tempest-VolumeDependencyTests-487079426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:11:33 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-b907d919-2b1b-4182-a330-40785a7f14f7 tempest-VolumeDependencyTests-487079426 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 16:11:33 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-b907d919-2b1b-4182-a330-40785a7f14f7 tempest-VolumeDependencyTests-487079426 None] Acquiring lock "cinder-quobyte-2892ae94-b522-4de4-92b3-9b6a5a90e540" by "_copy_volume_from_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:11:33 devstack cinder-volume[87420]: DEBUG cinder.volume.volume_utils [None req-f4f07e6c-13bf-47e3-acc2-1795b1a32d7e tempest-VolumeAndVolumeTypeFromImageTest-845300768 None] Attempting download of 73efcd67-743d-49f4-86ed-d422969992c3 ((None, [{'url': 'file:///opt/stack/data/glance/images/73efcd67-743d-49f4-86ed-d422969992c3', 'metadata': {}}])) to volume 1e005892-38b5-4421-8bc9-72b7c35ae367. {{(pid=87420) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 10 16:11:33 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-b907d919-2b1b-4182-a330-40785a7f14f7 tempest-VolumeDependencyTests-487079426 None] Lock "cinder-quobyte-2892ae94-b522-4de4-92b3-9b6a5a90e540" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:11:33 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-b907d919-2b1b-4182-a330-40785a7f14f7 tempest-VolumeDependencyTests-487079426 None] snapshot: ed21540a-9463-4857-888d-fa64b45b2a39, volume: 2892ae94-b522-4de4-92b3-9b6a5a90e540, {{(pid=87420) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 16:11:34 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-b907d919-2b1b-4182-a330-40785a7f14f7 tempest-VolumeDependencyTests-487079426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:11:34 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-b907d919-2b1b-4182-a330-40785a7f14f7 tempest-VolumeDependencyTests-487079426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:11:34 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-b907d919-2b1b-4182-a330-40785a7f14f7 tempest-VolumeDependencyTests-487079426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:11:34 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-b907d919-2b1b-4182-a330-40785a7f14f7 tempest-VolumeDependencyTests-487079426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:11:34 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-b907d919-2b1b-4182-a330-40785a7f14f7 tempest-VolumeDependencyTests-487079426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:11:34 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4289e97-c2b4-4fc7-a395-fcdd9aad2cfe]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:11:34 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-b907d919-2b1b-4182-a330-40785a7f14f7 tempest-VolumeDependencyTests-487079426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7c4f93b5-3bba-4673-9d5e-4c0958a48a35.ed21540a-9463-4857-888d-fa64b45b2a39 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:11:34 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[74efb432-3005-4238-9496-c4d2c6ac01c2]: (4, 'raw') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:11:34 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f4f07e6c-13bf-47e3-acc2-1795b1a32d7e tempest-VolumeAndVolumeTypeFromImageTest-845300768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_73efcd67-743d-49f4-86ed-d422969992c3_h_12v3_u {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:11:34 devstack sudo[105691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7c4f93b5-3bba-4673-9d5e-4c0958a48a35.ed21540a-9463-4857-888d-fa64b45b2a39 Jul 10 16:11:34 devstack sudo[105691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:11:34 devstack sudo[105692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_73efcd67-743d-49f4-86ed-d422969992c3_h_12v3_u Jul 10 16:11:34 devstack sudo[105692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:11:34 devstack sudo[105687]: pam_unix(sudo:session): session closed for user root Jul 10 16:11:34 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ff2f6522-584a-4bbc-aff8-eedd13932c1a tempest-CreateVolumesFromImageTest-1081655338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-489159d0-470e-4219-97dd-5ce37db36a49" returned: 0 in 0.819s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:11:34 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-ff2f6522-584a-4bbc-aff8-eedd13932c1a tempest-CreateVolumesFromImageTest-1081655338 None] Lock "cinder-quobyte-489159d0-470e-4219-97dd-5ce37db36a49" released by "delete_volume" :: held 1.871s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:11:34 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-c625a0f9-8638-4081-943c-afb14a407295 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 16:11:34 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c625a0f9-8638-4081-943c-afb14a407295 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Flow 'volume_create_manager' (95898dc1-99d3-4f4d-9124-8ae9563fd60e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:11:34 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c625a0f9-8638-4081-943c-afb14a407295 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b598d46-cc8f-4f70-a153-a094f55b4832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:34 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c625a0f9-8638-4081-943c-afb14a407295 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b598d46-cc8f-4f70-a153-a094f55b4832) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:11:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-358144113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d07f338-490c-431c-9402-521660f9c023,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='678e21887f8741fb9422fce1a779fd85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:11:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:11:34Z,use_quota=True,user_id='b738bea705274c419027b9dd4a126358',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:34 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c625a0f9-8638-4081-943c-afb14a407295 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (944eed32-b452-4959-8412-ee2c54d36bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:34 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c625a0f9-8638-4081-943c-afb14a407295 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (944eed32-b452-4959-8412-ee2c54d36bee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:34 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c625a0f9-8638-4081-943c-afb14a407295 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13164788-aeb5-4bc1-b34a-a5e892812d5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:34 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c625a0f9-8638-4081-943c-afb14a407295 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13164788-aeb5-4bc1-b34a-a5e892812d5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d07f338-490c-431c-9402-521660f9c023', 'volume_name': 'volume-5d07f338-490c-431c-9402-521660f9c023', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:34 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c625a0f9-8638-4081-943c-afb14a407295 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dae95c6-18a5-4b69-bded-ec29d4e68d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:34 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c625a0f9-8638-4081-943c-afb14a407295 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dae95c6-18a5-4b69-bded-ec29d4e68d97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:34 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c625a0f9-8638-4081-943c-afb14a407295 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8fd4f16-dd7a-4d71-92a5-c7f0035f70da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:34 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-c625a0f9-8638-4081-943c-afb14a407295 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Volume 5d07f338-490c-431c-9402-521660f9c023: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d07f338-490c-431c-9402-521660f9c023', 'volume_size': 1} Jul 10 16:11:34 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-c625a0f9-8638-4081-943c-afb14a407295 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:11:34 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-ff2f6522-584a-4bbc-aff8-eedd13932c1a tempest-CreateVolumesFromImageTest-1081655338 None] Created reservations ['79f268a1-f347-4362-8889-5b2b454f26d1', '2795effc-12fd-45f4-9a3d-046284ed547b', 'a51bc7b6-33c5-4b6a-9751-23a3065c37a4', '44b4c040-c7b3-4c8b-981a-178f899d2fb6'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:11:34 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-ff2f6522-584a-4bbc-aff8-eedd13932c1a tempest-CreateVolumesFromImageTest-1081655338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:11:34 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-ff2f6522-584a-4bbc-aff8-eedd13932c1a tempest-CreateVolumesFromImageTest-1081655338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:11:34 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-ff2f6522-584a-4bbc-aff8-eedd13932c1a tempest-CreateVolumesFromImageTest-1081655338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:11:34 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-ff2f6522-584a-4bbc-aff8-eedd13932c1a tempest-CreateVolumesFromImageTest-1081655338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:11:34 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-ff2f6522-584a-4bbc-aff8-eedd13932c1a tempest-CreateVolumesFromImageTest-1081655338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:11:34 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ff2f6522-584a-4bbc-aff8-eedd13932c1a tempest-CreateVolumesFromImageTest-1081655338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:11:34 devstack sudo[105696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:11:34 devstack sudo[105696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:11:34 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-5506ad59-6206-4654-a1be-8f7ae4f3ea95 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 16:11:35 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-5506ad59-6206-4654-a1be-8f7ae4f3ea95 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Flow 'volume_create_manager' (58bd2b94-2e3f-4986-8918-c2ded612a634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:11:35 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-5506ad59-6206-4654-a1be-8f7ae4f3ea95 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bf26360-839f-494d-8f36-657732fdb18d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:35 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-5506ad59-6206-4654-a1be-8f7ae4f3ea95 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bf26360-839f-494d-8f36-657732fdb18d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:11:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1505186460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bc50b6d-445a-4c3b-91be-5bc4dfd09734,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='678e21887f8741fb9422fce1a779fd85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:11:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:11:35Z,use_quota=True,user_id='b738bea705274c419027b9dd4a126358',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:35 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-5506ad59-6206-4654-a1be-8f7ae4f3ea95 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea3319ea-0513-4c8d-81be-ed40925b1f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:35 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-5506ad59-6206-4654-a1be-8f7ae4f3ea95 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea3319ea-0513-4c8d-81be-ed40925b1f45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:35 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-5506ad59-6206-4654-a1be-8f7ae4f3ea95 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56dd60ea-0b4c-4430-b54f-105e1dff9d0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:35 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-5506ad59-6206-4654-a1be-8f7ae4f3ea95 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56dd60ea-0b4c-4430-b54f-105e1dff9d0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5bc50b6d-445a-4c3b-91be-5bc4dfd09734', 'volume_name': 'volume-5bc50b6d-445a-4c3b-91be-5bc4dfd09734', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:35 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-5506ad59-6206-4654-a1be-8f7ae4f3ea95 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c939e5f1-004a-4e1f-9eeb-c94c8557520d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:35 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-5506ad59-6206-4654-a1be-8f7ae4f3ea95 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c939e5f1-004a-4e1f-9eeb-c94c8557520d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:35 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-5506ad59-6206-4654-a1be-8f7ae4f3ea95 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94ed3af7-a764-4921-9123-aa2ecbb65863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:35 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-5506ad59-6206-4654-a1be-8f7ae4f3ea95 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Volume 5bc50b6d-445a-4c3b-91be-5bc4dfd09734: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5bc50b6d-445a-4c3b-91be-5bc4dfd09734', 'volume_size': 1} Jul 10 16:11:35 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-5506ad59-6206-4654-a1be-8f7ae4f3ea95 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:11:35 devstack sudo[105691]: pam_unix(sudo:session): session closed for user root Jul 10 16:11:35 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-b907d919-2b1b-4182-a330-40785a7f14f7 tempest-VolumeDependencyTests-487079426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7c4f93b5-3bba-4673-9d5e-4c0958a48a35.ed21540a-9463-4857-888d-fa64b45b2a39" returned: 0 in 1.136s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:11:35 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-b907d919-2b1b-4182-a330-40785a7f14f7 tempest-VolumeDependencyTests-487079426 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c4f93b5-3bba-4673-9d5e-4c0958a48a35(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87420) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 16:11:35 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-b907d919-2b1b-4182-a330-40785a7f14f7 tempest-VolumeDependencyTests-487079426 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7c4f93b5-3bba-4673-9d5e-4c0958a48a35 {{(pid=87420) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 16:11:35 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-b907d919-2b1b-4182-a330-40785a7f14f7 tempest-VolumeDependencyTests-487079426 None] Creating direct copy from snapshot {{(pid=87420) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 16:11:35 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[11396892-023d-4a5f-8d79-f9fba4668fa6]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:11:35 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-b907d919-2b1b-4182-a330-40785a7f14f7 tempest-VolumeDependencyTests-487079426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7c4f93b5-3bba-4673-9d5e-4c0958a48a35 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:11:35 devstack sudo[105692]: pam_unix(sudo:session): session closed for user root Jul 10 16:11:35 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f4f07e6c-13bf-47e3-acc2-1795b1a32d7e tempest-VolumeAndVolumeTypeFromImageTest-845300768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_73efcd67-743d-49f4-86ed-d422969992c3_h_12v3_u" returned: 0 in 1.106s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:11:35 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f4f07e6c-13bf-47e3-acc2-1795b1a32d7e tempest-VolumeAndVolumeTypeFromImageTest-845300768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_73efcd67-743d-49f4-86ed-d422969992c3_h_12v3_u {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:11:35 devstack sudo[105703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7c4f93b5-3bba-4673-9d5e-4c0958a48a35 Jul 10 16:11:35 devstack sudo[105703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:11:35 devstack sudo[105704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_73efcd67-743d-49f4-86ed-d422969992c3_h_12v3_u Jul 10 16:11:35 devstack sudo[105704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:11:35 devstack sudo[105696]: pam_unix(sudo:session): session closed for user root Jul 10 16:11:35 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ff2f6522-584a-4bbc-aff8-eedd13932c1a tempest-CreateVolumesFromImageTest-1081655338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.814s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:11:35 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-ff2f6522-584a-4bbc-aff8-eedd13932c1a tempest-CreateVolumesFromImageTest-1081655338 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:11:35 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-ff2f6522-584a-4bbc-aff8-eedd13932c1a tempest-CreateVolumesFromImageTest-1081655338 None] Deleted volume successfully. Jul 10 16:11:35 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-ff2f6522-584a-4bbc-aff8-eedd13932c1a tempest-CreateVolumesFromImageTest-1081655338 None] Lock "cinder-489159d0-470e-4219-97dd-5ce37db36a49-delete_volume" released by "delete_volume" :: held 3.086s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:11:36 devstack sudo[105704]: pam_unix(sudo:session): session closed for user root Jul 10 16:11:36 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f4f07e6c-13bf-47e3-acc2-1795b1a32d7e tempest-VolumeAndVolumeTypeFromImageTest-845300768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_73efcd67-743d-49f4-86ed-d422969992c3_h_12v3_u" returned: 1 in 0.820s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:11:36 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f4f07e6c-13bf-47e3-acc2-1795b1a32d7e tempest-VolumeAndVolumeTypeFromImageTest-845300768 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_73efcd67-743d-49f4-86ed-d422969992c3_h_12v3_u' failed. Not Retrying. {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 16:11:36 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d8d807a-750e-4d67-bfcc-6975eda74bcc]: (4, 'raw') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:11:36 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f4f07e6c-13bf-47e3-acc2-1795b1a32d7e tempest-VolumeAndVolumeTypeFromImageTest-845300768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_73efcd67-743d-49f4-86ed-d422969992c3_062kjt5ldevstack@QuobyteHD {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:11:36 devstack sudo[105703]: pam_unix(sudo:session): session closed for user root Jul 10 16:11:36 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-b907d919-2b1b-4182-a330-40785a7f14f7 tempest-VolumeDependencyTests-487079426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7c4f93b5-3bba-4673-9d5e-4c0958a48a35" returned: 0 in 0.878s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:11:36 devstack cinder-volume[87420]: DEBUG cinder.utils [None req-b907d919-2b1b-4182-a330-40785a7f14f7 tempest-VolumeDependencyTests-487079426 None] Path /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-2892ae94-b522-4de4-92b3-9b6a5a90e540 not found in is_blk_device check {{(pid=87420) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 16:11:36 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-b907d919-2b1b-4182-a330-40785a7f14f7 tempest-VolumeDependencyTests-487079426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7c4f93b5-3bba-4673-9d5e-4c0958a48a35 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-2892ae94-b522-4de4-92b3-9b6a5a90e540 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:11:36 devstack sudo[105714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7c4f93b5-3bba-4673-9d5e-4c0958a48a35 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-2892ae94-b522-4de4-92b3-9b6a5a90e540 Jul 10 16:11:36 devstack sudo[105714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:11:36 devstack sudo[105713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_73efcd67-743d-49f4-86ed-d422969992c3_062kjt5ldevstack@QuobyteHD Jul 10 16:11:36 devstack sudo[105713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:11:36 devstack sudo[105713]: pam_unix(sudo:session): session closed for user root Jul 10 16:11:36 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f4f07e6c-13bf-47e3-acc2-1795b1a32d7e tempest-VolumeAndVolumeTypeFromImageTest-845300768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_73efcd67-743d-49f4-86ed-d422969992c3_062kjt5ldevstack@QuobyteHD" returned: 0 in 0.785s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:11:36 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f4f07e6c-13bf-47e3-acc2-1795b1a32d7e tempest-VolumeAndVolumeTypeFromImageTest-845300768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_73efcd67-743d-49f4-86ed-d422969992c3_062kjt5ldevstack@QuobyteHD {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:11:36 devstack sudo[105723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_73efcd67-743d-49f4-86ed-d422969992c3_062kjt5ldevstack@QuobyteHD Jul 10 16:11:36 devstack sudo[105723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:11:38 devstack sudo[105723]: pam_unix(sudo:session): session closed for user root Jul 10 16:11:38 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f4f07e6c-13bf-47e3-acc2-1795b1a32d7e tempest-VolumeAndVolumeTypeFromImageTest-845300768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_73efcd67-743d-49f4-86ed-d422969992c3_062kjt5ldevstack@QuobyteHD" returned: 1 in 1.393s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:11:38 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f4f07e6c-13bf-47e3-acc2-1795b1a32d7e tempest-VolumeAndVolumeTypeFromImageTest-845300768 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_73efcd67-743d-49f4-86ed-d422969992c3_062kjt5ldevstack@QuobyteHD' failed. Not Retrying. {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 16:11:38 devstack cinder-volume[87420]: DEBUG cinder.image.image_utils [None req-f4f07e6c-13bf-47e3-acc2-1795b1a32d7e tempest-VolumeAndVolumeTypeFromImageTest-845300768 None] 73efcd67-743d-49f4-86ed-d422969992c3 was raw, converting to raw {{(pid=87420) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 10 16:11:38 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f4f07e6c-13bf-47e3-acc2-1795b1a32d7e tempest-VolumeAndVolumeTypeFromImageTest-845300768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_73efcd67-743d-49f4-86ed-d422969992c3_062kjt5ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1e005892-38b5-4421-8bc9-72b7c35ae367 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:11:38 devstack sudo[105734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_73efcd67-743d-49f4-86ed-d422969992c3_062kjt5ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1e005892-38b5-4421-8bc9-72b7c35ae367 Jul 10 16:11:38 devstack sudo[105734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:11:38 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-57383045-45a0-4a5e-aad1-1637c3dc3305 tempest-CinderUnicodeTest-510159742 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 16:11:38 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-57383045-45a0-4a5e-aad1-1637c3dc3305 tempest-CinderUnicodeTest-510159742 None] Flow 'volume_create_manager' (51f68ea7-0ecf-477d-9fe9-3446f2b64019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:11:39 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-57383045-45a0-4a5e-aad1-1637c3dc3305 tempest-CinderUnicodeTest-510159742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82c0cf19-71eb-47ff-afbb-140e47341318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:39 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-57383045-45a0-4a5e-aad1-1637c3dc3305 tempest-CinderUnicodeTest-510159742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82c0cf19-71eb-47ff-afbb-140e47341318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:11:38Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1ac23fc-9417-4458-810a-9bc959af620c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0062d2dd0c1f41bc900d72dd8e968d3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:11:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:11:39Z,use_quota=True,user_id='0bd69d1aa640430383f4a5f311da8700',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:39 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-57383045-45a0-4a5e-aad1-1637c3dc3305 tempest-CinderUnicodeTest-510159742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc12e3f4-fd11-4ceb-98c8-da6f577fc703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:39 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-57383045-45a0-4a5e-aad1-1637c3dc3305 tempest-CinderUnicodeTest-510159742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc12e3f4-fd11-4ceb-98c8-da6f577fc703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:39 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-57383045-45a0-4a5e-aad1-1637c3dc3305 tempest-CinderUnicodeTest-510159742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d83f248-e6a9-4731-b5cf-d6a6e81f58e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:39 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-57383045-45a0-4a5e-aad1-1637c3dc3305 tempest-CinderUnicodeTest-510159742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d83f248-e6a9-4731-b5cf-d6a6e81f58e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1ac23fc-9417-4458-810a-9bc959af620c', 'volume_name': 'volume-e1ac23fc-9417-4458-810a-9bc959af620c', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:39 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-57383045-45a0-4a5e-aad1-1637c3dc3305 tempest-CinderUnicodeTest-510159742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e847c408-4ab5-43d2-839f-2653a9dc3a1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:39 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-57383045-45a0-4a5e-aad1-1637c3dc3305 tempest-CinderUnicodeTest-510159742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e847c408-4ab5-43d2-839f-2653a9dc3a1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:39 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-57383045-45a0-4a5e-aad1-1637c3dc3305 tempest-CinderUnicodeTest-510159742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76769f80-346b-4e6f-8e56-e0be75240a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:39 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-57383045-45a0-4a5e-aad1-1637c3dc3305 tempest-CinderUnicodeTest-510159742 None] Volume e1ac23fc-9417-4458-810a-9bc959af620c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1ac23fc-9417-4458-810a-9bc959af620c', 'volume_size': 1} Jul 10 16:11:39 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-57383045-45a0-4a5e-aad1-1637c3dc3305 tempest-CinderUnicodeTest-510159742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:11:40 devstack sudo[105734]: pam_unix(sudo:session): session closed for user root Jul 10 16:11:40 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f4f07e6c-13bf-47e3-acc2-1795b1a32d7e tempest-VolumeAndVolumeTypeFromImageTest-845300768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_73efcd67-743d-49f4-86ed-d422969992c3_062kjt5ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1e005892-38b5-4421-8bc9-72b7c35ae367" returned: 0 in 2.056s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:11:40 devstack cinder-volume[87420]: DEBUG cinder.image.image_utils [None req-f4f07e6c-13bf-47e3-acc2-1795b1a32d7e tempest-VolumeAndVolumeTypeFromImageTest-845300768 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_73efcd67-743d-49f4-86ed-d422969992c3_062kjt5ldevstack@QuobyteHD, size 0.00 MB, duration 2.06 sec, destination /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1e005892-38b5-4421-8bc9-72b7c35ae367 {{(pid=87420) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 16:11:40 devstack cinder-volume[87420]: INFO cinder.image.image_utils [None req-f4f07e6c-13bf-47e3-acc2-1795b1a32d7e tempest-VolumeAndVolumeTypeFromImageTest-845300768 None] Converted 0.00 MB image at 0.00 MB/s Jul 10 16:11:40 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f4f07e6c-13bf-47e3-acc2-1795b1a32d7e tempest-VolumeAndVolumeTypeFromImageTest-845300768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1e005892-38b5-4421-8bc9-72b7c35ae367 1G {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:11:40 devstack sudo[105776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1e005892-38b5-4421-8bc9-72b7c35ae367 1G Jul 10 16:11:40 devstack sudo[105776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:11:41 devstack sudo[105776]: pam_unix(sudo:session): session closed for user root Jul 10 16:11:41 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f4f07e6c-13bf-47e3-acc2-1795b1a32d7e tempest-VolumeAndVolumeTypeFromImageTest-845300768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1e005892-38b5-4421-8bc9-72b7c35ae367 1G" returned: 0 in 1.445s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:11:41 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ca33571-5654-4ca8-86f5-078d2b13e7b3]: (4, 'raw') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:11:41 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f4f07e6c-13bf-47e3-acc2-1795b1a32d7e tempest-VolumeAndVolumeTypeFromImageTest-845300768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1e005892-38b5-4421-8bc9-72b7c35ae367 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:11:41 devstack sudo[105781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1e005892-38b5-4421-8bc9-72b7c35ae367 Jul 10 16:11:41 devstack sudo[105781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:11:41 devstack sudo[105714]: pam_unix(sudo:session): session closed for user root Jul 10 16:11:41 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-b907d919-2b1b-4182-a330-40785a7f14f7 tempest-VolumeDependencyTests-487079426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7c4f93b5-3bba-4673-9d5e-4c0958a48a35 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-2892ae94-b522-4de4-92b3-9b6a5a90e540" returned: 0 in 5.897s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:11:41 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[00277472-d5a5-47cb-bf62-f669e31546d7]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:11:41 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-b907d919-2b1b-4182-a330-40785a7f14f7 tempest-VolumeDependencyTests-487079426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7c4f93b5-3bba-4673-9d5e-4c0958a48a35 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:11:42 devstack sudo[105783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7c4f93b5-3bba-4673-9d5e-4c0958a48a35 Jul 10 16:11:42 devstack sudo[105783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:11:42 devstack sudo[105781]: pam_unix(sudo:session): session closed for user root Jul 10 16:11:42 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f4f07e6c-13bf-47e3-acc2-1795b1a32d7e tempest-VolumeAndVolumeTypeFromImageTest-845300768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1e005892-38b5-4421-8bc9-72b7c35ae367" returned: 0 in 0.730s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:11:42 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f4f07e6c-13bf-47e3-acc2-1795b1a32d7e tempest-VolumeAndVolumeTypeFromImageTest-845300768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1e005892-38b5-4421-8bc9-72b7c35ae367 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:11:42 devstack sudo[105787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1e005892-38b5-4421-8bc9-72b7c35ae367 Jul 10 16:11:42 devstack sudo[105787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:11:42 devstack sudo[105783]: pam_unix(sudo:session): session closed for user root Jul 10 16:11:42 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-b907d919-2b1b-4182-a330-40785a7f14f7 tempest-VolumeDependencyTests-487079426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7c4f93b5-3bba-4673-9d5e-4c0958a48a35" returned: 0 in 0.958s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:11:42 devstack cinder-volume[87420]: DEBUG cinder.image.image_utils [None req-b907d919-2b1b-4182-a330-40785a7f14f7 tempest-VolumeDependencyTests-487079426 None] Image conversion details: src /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7c4f93b5-3bba-4673-9d5e-4c0958a48a35, size 1024.00 MB, duration 5.90 sec, destination /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-2892ae94-b522-4de4-92b3-9b6a5a90e540 {{(pid=87420) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 16:11:42 devstack cinder-volume[87420]: INFO cinder.image.image_utils [None req-b907d919-2b1b-4182-a330-40785a7f14f7 tempest-VolumeDependencyTests-487079426 None] Converted 1024.00 MB image at 173.62 MB/s Jul 10 16:11:42 devstack cinder-volume[87420]: WARNING cinder.volume.drivers.remotefs [None req-b907d919-2b1b-4182-a330-40785a7f14f7 tempest-VolumeDependencyTests-487079426 None] /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-2892ae94-b522-4de4-92b3-9b6a5a90e540 is being set with open permissions: ugo+rw Jul 10 16:11:42 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-b907d919-2b1b-4182-a330-40785a7f14f7 tempest-VolumeDependencyTests-487079426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-2892ae94-b522-4de4-92b3-9b6a5a90e540 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:11:42 devstack sudo[105792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-2892ae94-b522-4de4-92b3-9b6a5a90e540 Jul 10 16:11:42 devstack sudo[105792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:11:43 devstack sudo[105787]: pam_unix(sudo:session): session closed for user root Jul 10 16:11:43 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f4f07e6c-13bf-47e3-acc2-1795b1a32d7e tempest-VolumeAndVolumeTypeFromImageTest-845300768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1e005892-38b5-4421-8bc9-72b7c35ae367" returned: 1 in 0.764s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:11:43 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f4f07e6c-13bf-47e3-acc2-1795b1a32d7e tempest-VolumeAndVolumeTypeFromImageTest-845300768 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1e005892-38b5-4421-8bc9-72b7c35ae367' failed. Not Retrying. {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 16:11:43 devstack cinder-volume[87420]: DEBUG cinder.volume.volume_utils [None req-f4f07e6c-13bf-47e3-acc2-1795b1a32d7e tempest-VolumeAndVolumeTypeFromImageTest-845300768 None] Downloaded image 73efcd67-743d-49f4-86ed-d422969992c3 ((None, [{'url': 'file:///opt/stack/data/glance/images/73efcd67-743d-49f4-86ed-d422969992c3', 'metadata': {}}])) to volume 1e005892-38b5-4421-8bc9-72b7c35ae367 successfully. {{(pid=87420) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 10 16:11:43 devstack cinder-volume[87420]: DEBUG cinder.image.image_utils [None req-f4f07e6c-13bf-47e3-acc2-1795b1a32d7e tempest-VolumeAndVolumeTypeFromImageTest-845300768 None] Temporary image 73efcd67-743d-49f4-86ed-d422969992c3 for user 395374bcf6cb4beba7744037a996d349 is deleted. {{(pid=87420) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 10 16:11:43 devstack cinder-volume[87420]: DEBUG cinder.volume.volume_utils [None req-f4f07e6c-13bf-47e3-acc2-1795b1a32d7e tempest-VolumeAndVolumeTypeFromImageTest-845300768 None] Marking volume 1e005892-38b5-4421-8bc9-72b7c35ae367 as bootable. {{(pid=87420) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 10 16:11:43 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4f07e6c-13bf-47e3-acc2-1795b1a32d7e tempest-VolumeAndVolumeTypeFromImageTest-845300768 None] Copying metadata from image 73efcd67-743d-49f4-86ed-d422969992c3 to 1e005892-38b5-4421-8bc9-72b7c35ae367. {{(pid=87420) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 10 16:11:43 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4f07e6c-13bf-47e3-acc2-1795b1a32d7e tempest-VolumeAndVolumeTypeFromImageTest-845300768 None] Creating volume glance metadata for volume 1e005892-38b5-4421-8bc9-72b7c35ae367 backed by image 73efcd67-743d-49f4-86ed-d422969992c3 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '73efcd67-743d-49f4-86ed-d422969992c3', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'd3076a1d552c6c4d0ea631b41b5944d0', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87420) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 10 16:11:43 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f4f07e6c-13bf-47e3-acc2-1795b1a32d7e tempest-VolumeAndVolumeTypeFromImageTest-845300768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12a4c859-44db-47cb-bc39-bc25f459281f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e005892-38b5-4421-8bc9-72b7c35ae367', 'volume_size': 1, 'image_id': '73efcd67-743d-49f4-86ed-d422969992c3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/73efcd67-743d-49f4-86ed-d422969992c3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd3076a1d552c6c4d0ea631b41b5944d0', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2c323b81f6da4a36bcc1f57a47629059', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '05bab033de70e3c445ac97a4993d914fa95e370bcd5b049269d777dc1e2c7baea94ded5dee8d59ee77fa4a54008fbeaf451f34cc81b2bae5d5bcd3d4ffd46dd9', 'id': '73efcd67-743d-49f4-86ed-d422969992c3', 'created_at': datetime.datetime(2026, 7, 10, 14, 11, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 14, 11, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/73efcd67-743d-49f4-86ed-d422969992c3/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:43 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f4f07e6c-13bf-47e3-acc2-1795b1a32d7e tempest-VolumeAndVolumeTypeFromImageTest-845300768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8586070c-3aaa-4543-9fc9-d6d77856d18f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:43 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-f4f07e6c-13bf-47e3-acc2-1795b1a32d7e tempest-VolumeAndVolumeTypeFromImageTest-845300768 None] Volume volume-1e005892-38b5-4421-8bc9-72b7c35ae367 (1e005892-38b5-4421-8bc9-72b7c35ae367): created successfully Jul 10 16:11:43 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f4f07e6c-13bf-47e3-acc2-1795b1a32d7e tempest-VolumeAndVolumeTypeFromImageTest-845300768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8586070c-3aaa-4543-9fc9-d6d77856d18f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:43 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-f4f07e6c-13bf-47e3-acc2-1795b1a32d7e tempest-VolumeAndVolumeTypeFromImageTest-845300768 None] Flow 'volume_create_manager' (07198ed6-762e-4775-a6d2-e8881904b437) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:11:43 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-f4f07e6c-13bf-47e3-acc2-1795b1a32d7e tempest-VolumeAndVolumeTypeFromImageTest-845300768 None] Created volume successfully. Jul 10 16:11:43 devstack sudo[105792]: pam_unix(sudo:session): session closed for user root Jul 10 16:11:43 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-b907d919-2b1b-4182-a330-40785a7f14f7 tempest-VolumeDependencyTests-487079426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-2892ae94-b522-4de4-92b3-9b6a5a90e540" returned: 0 in 0.653s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:11:43 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-b907d919-2b1b-4182-a330-40785a7f14f7 tempest-VolumeDependencyTests-487079426 None] Lock "cinder-quobyte-2892ae94-b522-4de4-92b3-9b6a5a90e540" released by "_copy_volume_from_snapshot" :: held 9.655s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:11:43 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-b907d919-2b1b-4182-a330-40785a7f14f7 tempest-VolumeDependencyTests-487079426 None] Lock "cinder-quobyte-ed21540a-9463-4857-888d-fa64b45b2a39-2892ae94-b522-4de4-92b3-9b6a5a90e540" released by "_create_volume_from_snapshot" :: held 9.693s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:11:43 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-b907d919-2b1b-4182-a330-40785a7f14f7 tempest-VolumeDependencyTests-487079426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.723s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:11:43 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-39dc7e93-8e84-4829-884d-92780ad8f161 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.554s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:11:43 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-39dc7e93-8e84-4829-884d-92780ad8f161 tempest-CreateVolumesFromSnapshotTest-1937876261 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:11:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-986567745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00e89551-b7a0-4b20-a11d-1da1c0368d13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='678e21887f8741fb9422fce1a779fd85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:11:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:11:33Z,use_quota=True,user_id='b738bea705274c419027b9dd4a126358',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 16:11:43 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-39dc7e93-8e84-4829-884d-92780ad8f161 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Creating volume 00e89551-b7a0-4b20-a11d-1da1c0368d13 {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 16:11:43 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-39dc7e93-8e84-4829-884d-92780ad8f161 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:11:43 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-39dc7e93-8e84-4829-884d-92780ad8f161 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:11:43 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-39dc7e93-8e84-4829-884d-92780ad8f161 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:11:43 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-39dc7e93-8e84-4829-884d-92780ad8f161 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:11:43 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-39dc7e93-8e84-4829-884d-92780ad8f161 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:11:43 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-39dc7e93-8e84-4829-884d-92780ad8f161 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 16:11:43 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-39dc7e93-8e84-4829-884d-92780ad8f161 tempest-CreateVolumesFromSnapshotTest-1937876261 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 16:11:43 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-39dc7e93-8e84-4829-884d-92780ad8f161 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-00e89551-b7a0-4b20-a11d-1da1c0368d13 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:11:43 devstack sudo[105799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-00e89551-b7a0-4b20-a11d-1da1c0368d13 1073741824 Jul 10 16:11:43 devstack sudo[105799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:11:43 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b907d919-2b1b-4182-a330-40785a7f14f7 tempest-VolumeDependencyTests-487079426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e416025-6bde-4401-b356-f25184ed3bcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2892ae94-b522-4de4-92b3-9b6a5a90e540', 'volume_size': 1, 'snapshot_id': 'ed21540a-9463-4857-888d-fa64b45b2a39'}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:43 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b907d919-2b1b-4182-a330-40785a7f14f7 tempest-VolumeDependencyTests-487079426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fdd9e15-3e1a-4152-9f90-2b1082d43246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:43 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-b907d919-2b1b-4182-a330-40785a7f14f7 tempest-VolumeDependencyTests-487079426 None] Volume volume-2892ae94-b522-4de4-92b3-9b6a5a90e540 (2892ae94-b522-4de4-92b3-9b6a5a90e540): created successfully Jul 10 16:11:43 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b907d919-2b1b-4182-a330-40785a7f14f7 tempest-VolumeDependencyTests-487079426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fdd9e15-3e1a-4152-9f90-2b1082d43246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:43 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b907d919-2b1b-4182-a330-40785a7f14f7 tempest-VolumeDependencyTests-487079426 None] Flow 'volume_create_manager' (e8cd86c4-3049-4031-bae3-394576f4bd97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:11:43 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-b907d919-2b1b-4182-a330-40785a7f14f7 tempest-VolumeDependencyTests-487079426 None] Created volume successfully. Jul 10 16:11:43 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-903f99bd-cea3-4538-95da-76efb7618c26 tempest-VolumeAndVolumeTypeFromImageTest-845300768 None] Acquiring lock "cinder-1e005892-38b5-4421-8bc9-72b7c35ae367-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:11:43 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-903f99bd-cea3-4538-95da-76efb7618c26 tempest-VolumeAndVolumeTypeFromImageTest-845300768 None] Lock "cinder-1e005892-38b5-4421-8bc9-72b7c35ae367-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:11:43 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-903f99bd-cea3-4538-95da-76efb7618c26 tempest-VolumeAndVolumeTypeFromImageTest-845300768 None] Acquiring lock "cinder-quobyte-1e005892-38b5-4421-8bc9-72b7c35ae367" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:11:43 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-903f99bd-cea3-4538-95da-76efb7618c26 tempest-VolumeAndVolumeTypeFromImageTest-845300768 None] Lock "cinder-quobyte-1e005892-38b5-4421-8bc9-72b7c35ae367" acquired by "delete_volume" :: waited 0.018s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:11:43 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[12510e1a-720e-41ca-8b9a-a874a3913df1]: (4, 'raw') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:11:43 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-903f99bd-cea3-4538-95da-76efb7618c26 tempest-VolumeAndVolumeTypeFromImageTest-845300768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1e005892-38b5-4421-8bc9-72b7c35ae367 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:11:43 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-884faaad-3815-4327-8061-a81191547acf tempest-VolumeDependencyTests-487079426 None] Acquiring lock "cinder-ed21540a-9463-4857-888d-fa64b45b2a39-delete_snapshot" by "delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:11:44 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-884faaad-3815-4327-8061-a81191547acf tempest-VolumeDependencyTests-487079426 None] Lock "cinder-ed21540a-9463-4857-888d-fa64b45b2a39-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:11:44 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-884faaad-3815-4327-8061-a81191547acf tempest-VolumeDependencyTests-487079426 None] Acquiring lock "cinder-quobyte-7c4f93b5-3bba-4673-9d5e-4c0958a48a35" by "delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:11:44 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-884faaad-3815-4327-8061-a81191547acf tempest-VolumeDependencyTests-487079426 None] Lock "cinder-quobyte-7c4f93b5-3bba-4673-9d5e-4c0958a48a35" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:11:44 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-884faaad-3815-4327-8061-a81191547acf tempest-VolumeDependencyTests-487079426 None] Acquiring lock "cinder-quobyte-ed21540a-9463-4857-888d-fa64b45b2a39" by "_delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:11:44 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-884faaad-3815-4327-8061-a81191547acf tempest-VolumeDependencyTests-487079426 None] Lock "cinder-quobyte-ed21540a-9463-4857-888d-fa64b45b2a39" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:11:44 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-884faaad-3815-4327-8061-a81191547acf tempest-VolumeDependencyTests-487079426 None] Deleting offline snapshot ed21540a-9463-4857-888d-fa64b45b2a39 of volume 7c4f93b5-3bba-4673-9d5e-4c0958a48a35 {{(pid=87420) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 16:11:44 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-884faaad-3815-4327-8061-a81191547acf tempest-VolumeDependencyTests-487079426 None] snapshot_file for this snap is: volume-7c4f93b5-3bba-4673-9d5e-4c0958a48a35.ed21540a-9463-4857-888d-fa64b45b2a39 {{(pid=87420) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 16:11:44 devstack sudo[105801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1e005892-38b5-4421-8bc9-72b7c35ae367 Jul 10 16:11:44 devstack sudo[105801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:11:44 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b62393-22ad-4c8e-b7c9-b7a0db4661da]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:11:44 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-884faaad-3815-4327-8061-a81191547acf tempest-VolumeDependencyTests-487079426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7c4f93b5-3bba-4673-9d5e-4c0958a48a35.ed21540a-9463-4857-888d-fa64b45b2a39 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:11:44 devstack sudo[105803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7c4f93b5-3bba-4673-9d5e-4c0958a48a35.ed21540a-9463-4857-888d-fa64b45b2a39 Jul 10 16:11:44 devstack sudo[105803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:11:44 devstack sudo[105799]: pam_unix(sudo:session): session closed for user root Jul 10 16:11:44 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-39dc7e93-8e84-4829-884d-92780ad8f161 tempest-CreateVolumesFromSnapshotTest-1937876261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-00e89551-b7a0-4b20-a11d-1da1c0368d13 1073741824" returned: 0 in 0.860s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:11:44 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-39dc7e93-8e84-4829-884d-92780ad8f161 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-00e89551-b7a0-4b20-a11d-1da1c0368d13 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:11:44 devstack sudo[105809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-00e89551-b7a0-4b20-a11d-1da1c0368d13 Jul 10 16:11:44 devstack sudo[105809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:11:44 devstack sudo[105801]: pam_unix(sudo:session): session closed for user root Jul 10 16:11:44 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-903f99bd-cea3-4538-95da-76efb7618c26 tempest-VolumeAndVolumeTypeFromImageTest-845300768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1e005892-38b5-4421-8bc9-72b7c35ae367" returned: 0 in 0.857s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:11:44 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-903f99bd-cea3-4538-95da-76efb7618c26 tempest-VolumeAndVolumeTypeFromImageTest-845300768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1e005892-38b5-4421-8bc9-72b7c35ae367 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:11:44 devstack sudo[105815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1e005892-38b5-4421-8bc9-72b7c35ae367 Jul 10 16:11:44 devstack sudo[105815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:11:44 devstack sudo[105803]: pam_unix(sudo:session): session closed for user root Jul 10 16:11:44 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-884faaad-3815-4327-8061-a81191547acf tempest-VolumeDependencyTests-487079426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7c4f93b5-3bba-4673-9d5e-4c0958a48a35.ed21540a-9463-4857-888d-fa64b45b2a39" returned: 0 in 0.839s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:11:44 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-884faaad-3815-4327-8061-a81191547acf tempest-VolumeDependencyTests-487079426 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c4f93b5-3bba-4673-9d5e-4c0958a48a35(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87420) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 16:11:44 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[56c29b6e-cdfa-4aca-8241-8176f862715a]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:11:44 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-884faaad-3815-4327-8061-a81191547acf tempest-VolumeDependencyTests-487079426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7c4f93b5-3bba-4673-9d5e-4c0958a48a35 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:11:45 devstack sudo[105818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7c4f93b5-3bba-4673-9d5e-4c0958a48a35 Jul 10 16:11:45 devstack sudo[105818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:11:45 devstack sudo[105809]: pam_unix(sudo:session): session closed for user root Jul 10 16:11:45 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-39dc7e93-8e84-4829-884d-92780ad8f161 tempest-CreateVolumesFromSnapshotTest-1937876261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-00e89551-b7a0-4b20-a11d-1da1c0368d13" returned: 0 in 0.671s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:11:45 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-39dc7e93-8e84-4829-884d-92780ad8f161 tempest-CreateVolumesFromSnapshotTest-1937876261 None] <== create_volume: return (1584ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 16:11:45 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-39dc7e93-8e84-4829-884d-92780ad8f161 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.587s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:11:45 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-a89c1d7b-bf9a-44b7-87dd-6a2cc6d074b2 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.735s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:11:45 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-a89c1d7b-bf9a-44b7-87dd-6a2cc6d074b2 tempest-CreateVolumesFromSnapshotTest-1937876261 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:11:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-98855908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3912bc6-d421-4f30-8879-5af749e14a7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='678e21887f8741fb9422fce1a779fd85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:11:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:11:33Z,use_quota=True,user_id='b738bea705274c419027b9dd4a126358',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 16:11:45 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-a89c1d7b-bf9a-44b7-87dd-6a2cc6d074b2 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Creating volume c3912bc6-d421-4f30-8879-5af749e14a7d {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 16:11:45 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-a89c1d7b-bf9a-44b7-87dd-6a2cc6d074b2 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:11:45 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-a89c1d7b-bf9a-44b7-87dd-6a2cc6d074b2 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:11:45 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-a89c1d7b-bf9a-44b7-87dd-6a2cc6d074b2 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:11:45 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-a89c1d7b-bf9a-44b7-87dd-6a2cc6d074b2 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:11:45 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-a89c1d7b-bf9a-44b7-87dd-6a2cc6d074b2 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:11:45 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-a89c1d7b-bf9a-44b7-87dd-6a2cc6d074b2 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 16:11:45 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-a89c1d7b-bf9a-44b7-87dd-6a2cc6d074b2 tempest-CreateVolumesFromSnapshotTest-1937876261 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 16:11:45 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a89c1d7b-bf9a-44b7-87dd-6a2cc6d074b2 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-c3912bc6-d421-4f30-8879-5af749e14a7d 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:11:45 devstack sudo[105821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-c3912bc6-d421-4f30-8879-5af749e14a7d 1073741824 Jul 10 16:11:45 devstack sudo[105821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:11:45 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-39dc7e93-8e84-4829-884d-92780ad8f161 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (932bb816-790d-40cb-b860-dd47e8046c75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00e89551-b7a0-4b20-a11d-1da1c0368d13', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:45 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-39dc7e93-8e84-4829-884d-92780ad8f161 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d0ea4df-6be2-459a-81b1-c07d77694814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:45 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-39dc7e93-8e84-4829-884d-92780ad8f161 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Volume volume-00e89551-b7a0-4b20-a11d-1da1c0368d13 (00e89551-b7a0-4b20-a11d-1da1c0368d13): created successfully Jul 10 16:11:45 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-39dc7e93-8e84-4829-884d-92780ad8f161 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d0ea4df-6be2-459a-81b1-c07d77694814) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:45 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-39dc7e93-8e84-4829-884d-92780ad8f161 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Flow 'volume_create_manager' (0764cf31-51f1-48d4-88ba-a182e6edef17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:11:45 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-39dc7e93-8e84-4829-884d-92780ad8f161 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Created volume successfully. Jul 10 16:11:45 devstack sudo[105815]: pam_unix(sudo:session): session closed for user root Jul 10 16:11:45 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-903f99bd-cea3-4538-95da-76efb7618c26 tempest-VolumeAndVolumeTypeFromImageTest-845300768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1e005892-38b5-4421-8bc9-72b7c35ae367" returned: 1 in 0.781s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:11:45 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-903f99bd-cea3-4538-95da-76efb7618c26 tempest-VolumeAndVolumeTypeFromImageTest-845300768 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1e005892-38b5-4421-8bc9-72b7c35ae367' failed. Not Retrying. {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 16:11:45 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-903f99bd-cea3-4538-95da-76efb7618c26 tempest-VolumeAndVolumeTypeFromImageTest-845300768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1e005892-38b5-4421-8bc9-72b7c35ae367 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:11:45 devstack sudo[105826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1e005892-38b5-4421-8bc9-72b7c35ae367 Jul 10 16:11:45 devstack sudo[105826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:11:45 devstack sudo[105818]: pam_unix(sudo:session): session closed for user root Jul 10 16:11:45 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-884faaad-3815-4327-8061-a81191547acf tempest-VolumeDependencyTests-487079426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7c4f93b5-3bba-4673-9d5e-4c0958a48a35" returned: 0 in 0.811s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:11:45 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-884faaad-3815-4327-8061-a81191547acf tempest-VolumeDependencyTests-487079426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7c4f93b5-3bba-4673-9d5e-4c0958a48a35.ed21540a-9463-4857-888d-fa64b45b2a39 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:11:45 devstack sudo[105831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7c4f93b5-3bba-4673-9d5e-4c0958a48a35.ed21540a-9463-4857-888d-fa64b45b2a39 Jul 10 16:11:45 devstack sudo[105831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:11:46 devstack sudo[105821]: pam_unix(sudo:session): session closed for user root Jul 10 16:11:46 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a89c1d7b-bf9a-44b7-87dd-6a2cc6d074b2 tempest-CreateVolumesFromSnapshotTest-1937876261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-c3912bc6-d421-4f30-8879-5af749e14a7d 1073741824" returned: 0 in 0.889s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:11:46 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a89c1d7b-bf9a-44b7-87dd-6a2cc6d074b2 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-c3912bc6-d421-4f30-8879-5af749e14a7d {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:11:46 devstack sudo[105843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-c3912bc6-d421-4f30-8879-5af749e14a7d Jul 10 16:11:46 devstack sudo[105843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:11:46 devstack sudo[105826]: pam_unix(sudo:session): session closed for user root Jul 10 16:11:46 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-903f99bd-cea3-4538-95da-76efb7618c26 tempest-VolumeAndVolumeTypeFromImageTest-845300768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1e005892-38b5-4421-8bc9-72b7c35ae367" returned: 0 in 0.728s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:11:46 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-903f99bd-cea3-4538-95da-76efb7618c26 tempest-VolumeAndVolumeTypeFromImageTest-845300768 None] Lock "cinder-quobyte-1e005892-38b5-4421-8bc9-72b7c35ae367" released by "delete_volume" :: held 2.446s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:11:46 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-903f99bd-cea3-4538-95da-76efb7618c26 tempest-VolumeAndVolumeTypeFromImageTest-845300768 None] Created reservations ['7ebe4a12-775d-493d-b6c8-01cd614db7f3', '49a4e4cc-baf8-4f9e-9ad9-97e19dd4833e', 'e0ff634f-894a-46e4-a14a-29d46f952445', '0dec5caf-30e3-4205-83e2-97716b1eeed1'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:11:46 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-903f99bd-cea3-4538-95da-76efb7618c26 tempest-VolumeAndVolumeTypeFromImageTest-845300768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:11:46 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-903f99bd-cea3-4538-95da-76efb7618c26 tempest-VolumeAndVolumeTypeFromImageTest-845300768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:11:46 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-903f99bd-cea3-4538-95da-76efb7618c26 tempest-VolumeAndVolumeTypeFromImageTest-845300768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:11:46 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-903f99bd-cea3-4538-95da-76efb7618c26 tempest-VolumeAndVolumeTypeFromImageTest-845300768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:11:46 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-903f99bd-cea3-4538-95da-76efb7618c26 tempest-VolumeAndVolumeTypeFromImageTest-845300768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:11:46 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-903f99bd-cea3-4538-95da-76efb7618c26 tempest-VolumeAndVolumeTypeFromImageTest-845300768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:11:46 devstack sudo[105850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:11:46 devstack sudo[105850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:11:46 devstack sudo[105831]: pam_unix(sudo:session): session closed for user root Jul 10 16:11:46 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-884faaad-3815-4327-8061-a81191547acf tempest-VolumeDependencyTests-487079426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7c4f93b5-3bba-4673-9d5e-4c0958a48a35.ed21540a-9463-4857-888d-fa64b45b2a39" returned: 0 in 0.846s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:11:46 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-884faaad-3815-4327-8061-a81191547acf tempest-VolumeDependencyTests-487079426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7c4f93b5-3bba-4673-9d5e-4c0958a48a35.ed21540a-9463-4857-888d-fa64b45b2a39 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:11:46 devstack sudo[105852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7c4f93b5-3bba-4673-9d5e-4c0958a48a35.ed21540a-9463-4857-888d-fa64b45b2a39 Jul 10 16:11:46 devstack sudo[105852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:11:46 devstack sudo[105843]: pam_unix(sudo:session): session closed for user root Jul 10 16:11:46 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a89c1d7b-bf9a-44b7-87dd-6a2cc6d074b2 tempest-CreateVolumesFromSnapshotTest-1937876261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-c3912bc6-d421-4f30-8879-5af749e14a7d" returned: 0 in 0.698s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:11:46 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-a89c1d7b-bf9a-44b7-87dd-6a2cc6d074b2 tempest-CreateVolumesFromSnapshotTest-1937876261 None] <== create_volume: return (1635ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 16:11:46 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-a89c1d7b-bf9a-44b7-87dd-6a2cc6d074b2 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.639s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:11:46 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-13ff03d4-bbb4-4b50-bcf9-bd56d7ac913f tempest-CreateVolumesFromSnapshotTest-1937876261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.985s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:11:46 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-13ff03d4-bbb4-4b50-bcf9-bd56d7ac913f tempest-CreateVolumesFromSnapshotTest-1937876261 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:11:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-289412801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa0fbae9-8218-499a-9938-9f838f11ee8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='678e21887f8741fb9422fce1a779fd85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:11:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:11:34Z,use_quota=True,user_id='b738bea705274c419027b9dd4a126358',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 16:11:46 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-13ff03d4-bbb4-4b50-bcf9-bd56d7ac913f tempest-CreateVolumesFromSnapshotTest-1937876261 None] Creating volume fa0fbae9-8218-499a-9938-9f838f11ee8d {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 16:11:46 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-13ff03d4-bbb4-4b50-bcf9-bd56d7ac913f tempest-CreateVolumesFromSnapshotTest-1937876261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:11:46 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-13ff03d4-bbb4-4b50-bcf9-bd56d7ac913f tempest-CreateVolumesFromSnapshotTest-1937876261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:11:46 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-13ff03d4-bbb4-4b50-bcf9-bd56d7ac913f tempest-CreateVolumesFromSnapshotTest-1937876261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:11:46 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-13ff03d4-bbb4-4b50-bcf9-bd56d7ac913f tempest-CreateVolumesFromSnapshotTest-1937876261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:11:46 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-13ff03d4-bbb4-4b50-bcf9-bd56d7ac913f tempest-CreateVolumesFromSnapshotTest-1937876261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:11:46 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-13ff03d4-bbb4-4b50-bcf9-bd56d7ac913f tempest-CreateVolumesFromSnapshotTest-1937876261 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 16:11:46 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-13ff03d4-bbb4-4b50-bcf9-bd56d7ac913f tempest-CreateVolumesFromSnapshotTest-1937876261 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 16:11:46 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-13ff03d4-bbb4-4b50-bcf9-bd56d7ac913f tempest-CreateVolumesFromSnapshotTest-1937876261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-fa0fbae9-8218-499a-9938-9f838f11ee8d 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:11:46 devstack sudo[105855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-fa0fbae9-8218-499a-9938-9f838f11ee8d 1073741824 Jul 10 16:11:46 devstack sudo[105855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:11:46 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-a89c1d7b-bf9a-44b7-87dd-6a2cc6d074b2 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe274daa-a7cf-4f80-af37-7978eee06e66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3912bc6-d421-4f30-8879-5af749e14a7d', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:46 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-a89c1d7b-bf9a-44b7-87dd-6a2cc6d074b2 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8821170b-a244-487b-ae65-85869a0c4eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:47 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-a89c1d7b-bf9a-44b7-87dd-6a2cc6d074b2 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Volume volume-c3912bc6-d421-4f30-8879-5af749e14a7d (c3912bc6-d421-4f30-8879-5af749e14a7d): created successfully Jul 10 16:11:47 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-a89c1d7b-bf9a-44b7-87dd-6a2cc6d074b2 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8821170b-a244-487b-ae65-85869a0c4eaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:47 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-a89c1d7b-bf9a-44b7-87dd-6a2cc6d074b2 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Flow 'volume_create_manager' (d1078c19-7478-46c3-b123-abaf191e1123) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:11:47 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-a89c1d7b-bf9a-44b7-87dd-6a2cc6d074b2 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Created volume successfully. Jul 10 16:11:47 devstack sudo[105850]: pam_unix(sudo:session): session closed for user root Jul 10 16:11:47 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-903f99bd-cea3-4538-95da-76efb7618c26 tempest-VolumeAndVolumeTypeFromImageTest-845300768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.759s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:11:47 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-903f99bd-cea3-4538-95da-76efb7618c26 tempest-VolumeAndVolumeTypeFromImageTest-845300768 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:11:47 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-903f99bd-cea3-4538-95da-76efb7618c26 tempest-VolumeAndVolumeTypeFromImageTest-845300768 None] Deleted volume successfully. Jul 10 16:11:47 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-903f99bd-cea3-4538-95da-76efb7618c26 tempest-VolumeAndVolumeTypeFromImageTest-845300768 None] Lock "cinder-1e005892-38b5-4421-8bc9-72b7c35ae367-delete_volume" released by "delete_volume" :: held 3.443s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:11:47 devstack sudo[105852]: pam_unix(sudo:session): session closed for user root Jul 10 16:11:47 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-884faaad-3815-4327-8061-a81191547acf tempest-VolumeDependencyTests-487079426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7c4f93b5-3bba-4673-9d5e-4c0958a48a35.ed21540a-9463-4857-888d-fa64b45b2a39" returned: 0 in 0.834s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:11:47 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-884faaad-3815-4327-8061-a81191547acf tempest-VolumeDependencyTests-487079426 None] Lock "cinder-quobyte-ed21540a-9463-4857-888d-fa64b45b2a39" released by "_delete_snapshot" :: held 3.450s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:11:47 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-884faaad-3815-4327-8061-a81191547acf tempest-VolumeDependencyTests-487079426 None] Lock "cinder-quobyte-7c4f93b5-3bba-4673-9d5e-4c0958a48a35" released by "delete_snapshot" :: held 3.478s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:11:47 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-884faaad-3815-4327-8061-a81191547acf tempest-VolumeDependencyTests-487079426 None] Created reservations ['880efd28-f598-4abc-81a6-0c7256d3b844', '836e6885-8db7-4c7f-898a-e5a5da7d474c', '8b21dbdc-a607-49b8-8fa2-e02fb08f9fb6', '2b257e76-18ab-465e-95af-a015782aa4bc'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:11:47 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-884faaad-3815-4327-8061-a81191547acf tempest-VolumeDependencyTests-487079426 None] Delete snapshot completed successfully. Jul 10 16:11:47 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-884faaad-3815-4327-8061-a81191547acf tempest-VolumeDependencyTests-487079426 None] Lock "cinder-ed21540a-9463-4857-888d-fa64b45b2a39-delete_snapshot" released by "delete_snapshot" :: held 3.633s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:11:47 devstack sudo[105855]: pam_unix(sudo:session): session closed for user root Jul 10 16:11:47 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-13ff03d4-bbb4-4b50-bcf9-bd56d7ac913f tempest-CreateVolumesFromSnapshotTest-1937876261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-fa0fbae9-8218-499a-9938-9f838f11ee8d 1073741824" returned: 0 in 0.983s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:11:47 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-13ff03d4-bbb4-4b50-bcf9-bd56d7ac913f tempest-CreateVolumesFromSnapshotTest-1937876261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-fa0fbae9-8218-499a-9938-9f838f11ee8d {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:11:47 devstack sudo[105863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-fa0fbae9-8218-499a-9938-9f838f11ee8d Jul 10 16:11:47 devstack sudo[105863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:11:48 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-2b836f84-7b85-44c3-a389-e6fc7c5e9244 tempest-VolumeDependencyTests-487079426 None] Acquiring lock "cinder-7c4f93b5-3bba-4673-9d5e-4c0958a48a35-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:11:48 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-2b836f84-7b85-44c3-a389-e6fc7c5e9244 tempest-VolumeDependencyTests-487079426 None] Lock "cinder-7c4f93b5-3bba-4673-9d5e-4c0958a48a35-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:11:48 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-2b836f84-7b85-44c3-a389-e6fc7c5e9244 tempest-VolumeDependencyTests-487079426 None] Acquiring lock "cinder-quobyte-7c4f93b5-3bba-4673-9d5e-4c0958a48a35" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:11:48 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-2b836f84-7b85-44c3-a389-e6fc7c5e9244 tempest-VolumeDependencyTests-487079426 None] Lock "cinder-quobyte-7c4f93b5-3bba-4673-9d5e-4c0958a48a35" acquired by "delete_volume" :: waited 0.019s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:11:48 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[c894542b-833a-4a73-8934-b3e98f11f96c]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:11:48 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-2b836f84-7b85-44c3-a389-e6fc7c5e9244 tempest-VolumeDependencyTests-487079426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7c4f93b5-3bba-4673-9d5e-4c0958a48a35 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:11:48 devstack sudo[105865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7c4f93b5-3bba-4673-9d5e-4c0958a48a35 Jul 10 16:11:48 devstack sudo[105865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:11:48 devstack sudo[105863]: pam_unix(sudo:session): session closed for user root Jul 10 16:11:48 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-13ff03d4-bbb4-4b50-bcf9-bd56d7ac913f tempest-CreateVolumesFromSnapshotTest-1937876261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-fa0fbae9-8218-499a-9938-9f838f11ee8d" returned: 0 in 0.701s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:11:48 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-13ff03d4-bbb4-4b50-bcf9-bd56d7ac913f tempest-CreateVolumesFromSnapshotTest-1937876261 None] <== create_volume: return (1747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 16:11:48 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-13ff03d4-bbb4-4b50-bcf9-bd56d7ac913f tempest-CreateVolumesFromSnapshotTest-1937876261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.750s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:11:48 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-c625a0f9-8638-4081-943c-afb14a407295 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.137s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:11:48 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-c625a0f9-8638-4081-943c-afb14a407295 tempest-CreateVolumesFromSnapshotTest-1937876261 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:11:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-358144113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d07f338-490c-431c-9402-521660f9c023,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='678e21887f8741fb9422fce1a779fd85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:11:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:11:34Z,use_quota=True,user_id='b738bea705274c419027b9dd4a126358',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 16:11:48 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-c625a0f9-8638-4081-943c-afb14a407295 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Creating volume 5d07f338-490c-431c-9402-521660f9c023 {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 16:11:48 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-c625a0f9-8638-4081-943c-afb14a407295 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:11:48 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-c625a0f9-8638-4081-943c-afb14a407295 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:11:48 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-c625a0f9-8638-4081-943c-afb14a407295 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:11:48 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-c625a0f9-8638-4081-943c-afb14a407295 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:11:48 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-c625a0f9-8638-4081-943c-afb14a407295 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:11:48 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-c625a0f9-8638-4081-943c-afb14a407295 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 16:11:48 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-c625a0f9-8638-4081-943c-afb14a407295 tempest-CreateVolumesFromSnapshotTest-1937876261 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 16:11:48 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c625a0f9-8638-4081-943c-afb14a407295 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-5d07f338-490c-431c-9402-521660f9c023 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:11:48 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-13ff03d4-bbb4-4b50-bcf9-bd56d7ac913f tempest-CreateVolumesFromSnapshotTest-1937876261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc5f948b-d03f-445d-a8ba-2d36f717da90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa0fbae9-8218-499a-9938-9f838f11ee8d', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:48 devstack sudo[105868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-5d07f338-490c-431c-9402-521660f9c023 1073741824 Jul 10 16:11:48 devstack sudo[105868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:11:48 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-13ff03d4-bbb4-4b50-bcf9-bd56d7ac913f tempest-CreateVolumesFromSnapshotTest-1937876261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cb7e870-2779-4bf4-bcf3-9de15cab4c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:48 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-13ff03d4-bbb4-4b50-bcf9-bd56d7ac913f tempest-CreateVolumesFromSnapshotTest-1937876261 None] Volume volume-fa0fbae9-8218-499a-9938-9f838f11ee8d (fa0fbae9-8218-499a-9938-9f838f11ee8d): created successfully Jul 10 16:11:48 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-13ff03d4-bbb4-4b50-bcf9-bd56d7ac913f tempest-CreateVolumesFromSnapshotTest-1937876261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cb7e870-2779-4bf4-bcf3-9de15cab4c57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:48 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-13ff03d4-bbb4-4b50-bcf9-bd56d7ac913f tempest-CreateVolumesFromSnapshotTest-1937876261 None] Flow 'volume_create_manager' (349ba1f9-7b5d-429e-a591-1ca662b60388) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:11:48 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-13ff03d4-bbb4-4b50-bcf9-bd56d7ac913f tempest-CreateVolumesFromSnapshotTest-1937876261 None] Created volume successfully. Jul 10 16:11:49 devstack sudo[105865]: pam_unix(sudo:session): session closed for user root Jul 10 16:11:49 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-2b836f84-7b85-44c3-a389-e6fc7c5e9244 tempest-VolumeDependencyTests-487079426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7c4f93b5-3bba-4673-9d5e-4c0958a48a35" returned: 0 in 0.906s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:11:49 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-2b836f84-7b85-44c3-a389-e6fc7c5e9244 tempest-VolumeDependencyTests-487079426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7c4f93b5-3bba-4673-9d5e-4c0958a48a35 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:11:49 devstack sudo[105877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7c4f93b5-3bba-4673-9d5e-4c0958a48a35 Jul 10 16:11:49 devstack sudo[105877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:11:49 devstack sudo[105868]: pam_unix(sudo:session): session closed for user root Jul 10 16:11:49 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c625a0f9-8638-4081-943c-afb14a407295 tempest-CreateVolumesFromSnapshotTest-1937876261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-5d07f338-490c-431c-9402-521660f9c023 1073741824" returned: 0 in 0.959s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:11:49 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c625a0f9-8638-4081-943c-afb14a407295 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-5d07f338-490c-431c-9402-521660f9c023 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:11:49 devstack sudo[105880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-5d07f338-490c-431c-9402-521660f9c023 Jul 10 16:11:49 devstack sudo[105880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:11:50 devstack sudo[105877]: pam_unix(sudo:session): session closed for user root Jul 10 16:11:50 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-2b836f84-7b85-44c3-a389-e6fc7c5e9244 tempest-VolumeDependencyTests-487079426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-7c4f93b5-3bba-4673-9d5e-4c0958a48a35" returned: 0 in 0.717s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:11:50 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-2b836f84-7b85-44c3-a389-e6fc7c5e9244 tempest-VolumeDependencyTests-487079426 None] Lock "cinder-quobyte-7c4f93b5-3bba-4673-9d5e-4c0958a48a35" released by "delete_volume" :: held 1.699s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:11:50 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-2b836f84-7b85-44c3-a389-e6fc7c5e9244 tempest-VolumeDependencyTests-487079426 None] Created reservations ['ddd9edf1-ce94-4ad5-b64b-3a81b6f9e334', '296d8243-a016-4bdf-a344-cf926d7baa02', '6ad8c7b9-36bf-424d-a444-62f47254a31e', 'e71e305f-1788-4781-a226-bfea49cb19a7'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:11:50 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-2b836f84-7b85-44c3-a389-e6fc7c5e9244 tempest-VolumeDependencyTests-487079426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:11:50 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-2b836f84-7b85-44c3-a389-e6fc7c5e9244 tempest-VolumeDependencyTests-487079426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:11:50 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-2b836f84-7b85-44c3-a389-e6fc7c5e9244 tempest-VolumeDependencyTests-487079426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:11:50 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-2b836f84-7b85-44c3-a389-e6fc7c5e9244 tempest-VolumeDependencyTests-487079426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:11:50 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-2b836f84-7b85-44c3-a389-e6fc7c5e9244 tempest-VolumeDependencyTests-487079426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:11:50 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-2b836f84-7b85-44c3-a389-e6fc7c5e9244 tempest-VolumeDependencyTests-487079426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:11:50 devstack sudo[105884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:11:50 devstack sudo[105884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:11:50 devstack sudo[105880]: pam_unix(sudo:session): session closed for user root Jul 10 16:11:50 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c625a0f9-8638-4081-943c-afb14a407295 tempest-CreateVolumesFromSnapshotTest-1937876261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-5d07f338-490c-431c-9402-521660f9c023" returned: 0 in 0.706s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:11:50 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-c625a0f9-8638-4081-943c-afb14a407295 tempest-CreateVolumesFromSnapshotTest-1937876261 None] <== create_volume: return (1727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 16:11:50 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-c625a0f9-8638-4081-943c-afb14a407295 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.731s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:11:50 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-5506ad59-6206-4654-a1be-8f7ae4f3ea95 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.266s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:11:50 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-5506ad59-6206-4654-a1be-8f7ae4f3ea95 tempest-CreateVolumesFromSnapshotTest-1937876261 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:11:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1505186460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bc50b6d-445a-4c3b-91be-5bc4dfd09734,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='678e21887f8741fb9422fce1a779fd85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:11:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:11:35Z,use_quota=True,user_id='b738bea705274c419027b9dd4a126358',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 16:11:50 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-5506ad59-6206-4654-a1be-8f7ae4f3ea95 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Creating volume 5bc50b6d-445a-4c3b-91be-5bc4dfd09734 {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 16:11:50 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-5506ad59-6206-4654-a1be-8f7ae4f3ea95 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:11:50 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-5506ad59-6206-4654-a1be-8f7ae4f3ea95 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:11:50 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-5506ad59-6206-4654-a1be-8f7ae4f3ea95 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:11:50 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-5506ad59-6206-4654-a1be-8f7ae4f3ea95 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:11:50 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-5506ad59-6206-4654-a1be-8f7ae4f3ea95 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:11:50 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-5506ad59-6206-4654-a1be-8f7ae4f3ea95 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 16:11:50 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-5506ad59-6206-4654-a1be-8f7ae4f3ea95 tempest-CreateVolumesFromSnapshotTest-1937876261 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 16:11:50 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-5506ad59-6206-4654-a1be-8f7ae4f3ea95 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-5bc50b6d-445a-4c3b-91be-5bc4dfd09734 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:11:50 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c625a0f9-8638-4081-943c-afb14a407295 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8fd4f16-dd7a-4d71-92a5-c7f0035f70da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d07f338-490c-431c-9402-521660f9c023', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:50 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c625a0f9-8638-4081-943c-afb14a407295 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a491b123-b40a-4315-bc59-1dacde54551c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:50 devstack sudo[105886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-5bc50b6d-445a-4c3b-91be-5bc4dfd09734 1073741824 Jul 10 16:11:50 devstack sudo[105886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:11:50 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-c625a0f9-8638-4081-943c-afb14a407295 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Volume volume-5d07f338-490c-431c-9402-521660f9c023 (5d07f338-490c-431c-9402-521660f9c023): created successfully Jul 10 16:11:50 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c625a0f9-8638-4081-943c-afb14a407295 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a491b123-b40a-4315-bc59-1dacde54551c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:50 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c625a0f9-8638-4081-943c-afb14a407295 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Flow 'volume_create_manager' (95898dc1-99d3-4f4d-9124-8ae9563fd60e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:11:50 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-c625a0f9-8638-4081-943c-afb14a407295 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Created volume successfully. Jul 10 16:11:50 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-74351d68-cbc3-4184-b73c-9bd6a4e19d4b tempest-VolumeDependencyTests-487079426 None] Acquiring lock "cinder-2892ae94-b522-4de4-92b3-9b6a5a90e540-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:11:50 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-74351d68-cbc3-4184-b73c-9bd6a4e19d4b tempest-VolumeDependencyTests-487079426 None] Lock "cinder-2892ae94-b522-4de4-92b3-9b6a5a90e540-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:11:50 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-74351d68-cbc3-4184-b73c-9bd6a4e19d4b tempest-VolumeDependencyTests-487079426 None] Acquiring lock "cinder-quobyte-2892ae94-b522-4de4-92b3-9b6a5a90e540" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:11:50 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-74351d68-cbc3-4184-b73c-9bd6a4e19d4b tempest-VolumeDependencyTests-487079426 None] Lock "cinder-quobyte-2892ae94-b522-4de4-92b3-9b6a5a90e540" acquired by "delete_volume" :: waited 0.026s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:11:50 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[a380efc6-46dd-4af4-99f4-ffb24147c939]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:11:50 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-74351d68-cbc3-4184-b73c-9bd6a4e19d4b tempest-VolumeDependencyTests-487079426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-2892ae94-b522-4de4-92b3-9b6a5a90e540 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:11:50 devstack sudo[105884]: pam_unix(sudo:session): session closed for user root Jul 10 16:11:50 devstack sudo[105888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-2892ae94-b522-4de4-92b3-9b6a5a90e540 Jul 10 16:11:50 devstack sudo[105888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:11:50 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-2b836f84-7b85-44c3-a389-e6fc7c5e9244 tempest-VolumeDependencyTests-487079426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.688s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:11:50 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-2b836f84-7b85-44c3-a389-e6fc7c5e9244 tempest-VolumeDependencyTests-487079426 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:11:50 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-2b836f84-7b85-44c3-a389-e6fc7c5e9244 tempest-VolumeDependencyTests-487079426 None] Deleted volume successfully. Jul 10 16:11:50 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-2b836f84-7b85-44c3-a389-e6fc7c5e9244 tempest-VolumeDependencyTests-487079426 None] Lock "cinder-7c4f93b5-3bba-4673-9d5e-4c0958a48a35-delete_volume" released by "delete_volume" :: held 2.673s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:11:51 devstack sudo[105886]: pam_unix(sudo:session): session closed for user root Jul 10 16:11:51 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-5506ad59-6206-4654-a1be-8f7ae4f3ea95 tempest-CreateVolumesFromSnapshotTest-1937876261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-5bc50b6d-445a-4c3b-91be-5bc4dfd09734 1073741824" returned: 0 in 1.075s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:11:51 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-5506ad59-6206-4654-a1be-8f7ae4f3ea95 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-5bc50b6d-445a-4c3b-91be-5bc4dfd09734 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:11:51 devstack sudo[105896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-5bc50b6d-445a-4c3b-91be-5bc4dfd09734 Jul 10 16:11:51 devstack sudo[105896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:11:51 devstack sudo[105888]: pam_unix(sudo:session): session closed for user root Jul 10 16:11:51 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-74351d68-cbc3-4184-b73c-9bd6a4e19d4b tempest-VolumeDependencyTests-487079426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-2892ae94-b522-4de4-92b3-9b6a5a90e540" returned: 0 in 0.907s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:11:51 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-74351d68-cbc3-4184-b73c-9bd6a4e19d4b tempest-VolumeDependencyTests-487079426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-2892ae94-b522-4de4-92b3-9b6a5a90e540 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:11:51 devstack sudo[105900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-2892ae94-b522-4de4-92b3-9b6a5a90e540 Jul 10 16:11:51 devstack sudo[105900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:11:52 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d642e84-77f6-4711-8ee3-c87fb9a86c17 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 16:11:52 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-0d642e84-77f6-4711-8ee3-c87fb9a86c17 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Flow 'volume_create_manager' (7935d782-1d8b-45ba-bae4-3f1171d09652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:11:52 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-0d642e84-77f6-4711-8ee3-c87fb9a86c17 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95b69a6a-4620-470e-9367-a17e0d2644c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:52 devstack sudo[105896]: pam_unix(sudo:session): session closed for user root Jul 10 16:11:52 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-0d642e84-77f6-4711-8ee3-c87fb9a86c17 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95b69a6a-4620-470e-9367-a17e0d2644c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:11:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1397336086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a207383-7c1f-48da-84fa-3b3e9a6f1c91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='074f03cbbea341be879ed151e2c8f1a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:11:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:11:52Z,use_quota=True,user_id='8a9df13920f54d33a593c6dcaa74ab8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:52 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-0d642e84-77f6-4711-8ee3-c87fb9a86c17 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eebf33e4-d49d-448c-ad67-0b0abf2b96a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:52 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-0d642e84-77f6-4711-8ee3-c87fb9a86c17 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eebf33e4-d49d-448c-ad67-0b0abf2b96a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:52 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-0d642e84-77f6-4711-8ee3-c87fb9a86c17 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (322f77f4-68c0-411e-b997-d30699c6dfd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:52 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-0d642e84-77f6-4711-8ee3-c87fb9a86c17 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (322f77f4-68c0-411e-b997-d30699c6dfd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a207383-7c1f-48da-84fa-3b3e9a6f1c91', 'volume_name': 'volume-5a207383-7c1f-48da-84fa-3b3e9a6f1c91', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:52 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-0d642e84-77f6-4711-8ee3-c87fb9a86c17 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76f4d349-8727-43c0-aa9b-79b851509608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:52 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-0d642e84-77f6-4711-8ee3-c87fb9a86c17 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76f4d349-8727-43c0-aa9b-79b851509608) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:52 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-0d642e84-77f6-4711-8ee3-c87fb9a86c17 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a16f03a-521d-4251-9d01-fc9effb1198a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:52 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-0d642e84-77f6-4711-8ee3-c87fb9a86c17 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Volume 5a207383-7c1f-48da-84fa-3b3e9a6f1c91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a207383-7c1f-48da-84fa-3b3e9a6f1c91', 'volume_size': 1} Jul 10 16:11:52 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-0d642e84-77f6-4711-8ee3-c87fb9a86c17 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:11:52 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-5506ad59-6206-4654-a1be-8f7ae4f3ea95 tempest-CreateVolumesFromSnapshotTest-1937876261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-5bc50b6d-445a-4c3b-91be-5bc4dfd09734" returned: 0 in 0.786s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:11:52 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-5506ad59-6206-4654-a1be-8f7ae4f3ea95 tempest-CreateVolumesFromSnapshotTest-1937876261 None] <== create_volume: return (1909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 16:11:52 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-5506ad59-6206-4654-a1be-8f7ae4f3ea95 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.913s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:11:52 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-57383045-45a0-4a5e-aad1-1637c3dc3305 tempest-CinderUnicodeTest-510159742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.120s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:11:52 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-57383045-45a0-4a5e-aad1-1637c3dc3305 tempest-CinderUnicodeTest-510159742 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:11:38Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1ac23fc-9417-4458-810a-9bc959af620c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0062d2dd0c1f41bc900d72dd8e968d3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:11:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:11:39Z,use_quota=True,user_id='0bd69d1aa640430383f4a5f311da8700',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 16:11:52 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-57383045-45a0-4a5e-aad1-1637c3dc3305 tempest-CinderUnicodeTest-510159742 None] Creating volume e1ac23fc-9417-4458-810a-9bc959af620c {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 16:11:52 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-57383045-45a0-4a5e-aad1-1637c3dc3305 tempest-CinderUnicodeTest-510159742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:11:52 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-57383045-45a0-4a5e-aad1-1637c3dc3305 tempest-CinderUnicodeTest-510159742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:11:52 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-57383045-45a0-4a5e-aad1-1637c3dc3305 tempest-CinderUnicodeTest-510159742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:11:52 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-57383045-45a0-4a5e-aad1-1637c3dc3305 tempest-CinderUnicodeTest-510159742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:11:52 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-57383045-45a0-4a5e-aad1-1637c3dc3305 tempest-CinderUnicodeTest-510159742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:11:52 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-57383045-45a0-4a5e-aad1-1637c3dc3305 tempest-CinderUnicodeTest-510159742 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 16:11:52 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-57383045-45a0-4a5e-aad1-1637c3dc3305 tempest-CinderUnicodeTest-510159742 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 16:11:52 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-57383045-45a0-4a5e-aad1-1637c3dc3305 tempest-CinderUnicodeTest-510159742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-e1ac23fc-9417-4458-810a-9bc959af620c 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:11:52 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-5506ad59-6206-4654-a1be-8f7ae4f3ea95 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94ed3af7-a764-4921-9123-aa2ecbb65863) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bc50b6d-445a-4c3b-91be-5bc4dfd09734', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:52 devstack sudo[105904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-e1ac23fc-9417-4458-810a-9bc959af620c 1073741824 Jul 10 16:11:52 devstack sudo[105904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:11:52 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-5506ad59-6206-4654-a1be-8f7ae4f3ea95 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53da452b-a303-4398-a5d3-112f2e40e7f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:52 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-5506ad59-6206-4654-a1be-8f7ae4f3ea95 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Volume volume-5bc50b6d-445a-4c3b-91be-5bc4dfd09734 (5bc50b6d-445a-4c3b-91be-5bc4dfd09734): created successfully Jul 10 16:11:52 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-5506ad59-6206-4654-a1be-8f7ae4f3ea95 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53da452b-a303-4398-a5d3-112f2e40e7f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:52 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-5506ad59-6206-4654-a1be-8f7ae4f3ea95 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Flow 'volume_create_manager' (58bd2b94-2e3f-4986-8918-c2ded612a634) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:11:52 devstack sudo[105900]: pam_unix(sudo:session): session closed for user root Jul 10 16:11:52 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-74351d68-cbc3-4184-b73c-9bd6a4e19d4b tempest-VolumeDependencyTests-487079426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-2892ae94-b522-4de4-92b3-9b6a5a90e540" returned: 0 in 0.702s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:11:52 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-5506ad59-6206-4654-a1be-8f7ae4f3ea95 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Created volume successfully. Jul 10 16:11:52 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-74351d68-cbc3-4184-b73c-9bd6a4e19d4b tempest-VolumeDependencyTests-487079426 None] Lock "cinder-quobyte-2892ae94-b522-4de4-92b3-9b6a5a90e540" released by "delete_volume" :: held 1.683s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:11:52 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-74351d68-cbc3-4184-b73c-9bd6a4e19d4b tempest-VolumeDependencyTests-487079426 None] Created reservations ['5e92c3d1-7d59-4a5e-a864-b6b6e319bd96', 'df138a4a-f9a4-4d36-95d9-3a17e36d9e64', '90d6c5ee-ff83-41e6-b677-3ec2eee04528', '3a0bc5d0-074b-4d77-a8f8-5febd042aa00'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:11:52 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-74351d68-cbc3-4184-b73c-9bd6a4e19d4b tempest-VolumeDependencyTests-487079426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:11:52 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-74351d68-cbc3-4184-b73c-9bd6a4e19d4b tempest-VolumeDependencyTests-487079426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:11:52 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-74351d68-cbc3-4184-b73c-9bd6a4e19d4b tempest-VolumeDependencyTests-487079426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:11:52 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-74351d68-cbc3-4184-b73c-9bd6a4e19d4b tempest-VolumeDependencyTests-487079426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:11:52 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-74351d68-cbc3-4184-b73c-9bd6a4e19d4b tempest-VolumeDependencyTests-487079426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:11:52 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-74351d68-cbc3-4184-b73c-9bd6a4e19d4b tempest-VolumeDependencyTests-487079426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:11:52 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-23b5659e-de47-42c9-a037-07b6d079f484 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Acquiring lock "cinder-5bc50b6d-445a-4c3b-91be-5bc4dfd09734-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:11:52 devstack sudo[105906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:11:52 devstack sudo[105906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:11:52 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-23b5659e-de47-42c9-a037-07b6d079f484 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Lock "cinder-5bc50b6d-445a-4c3b-91be-5bc4dfd09734-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:11:52 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-23b5659e-de47-42c9-a037-07b6d079f484 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Acquiring lock "cinder-quobyte-5bc50b6d-445a-4c3b-91be-5bc4dfd09734" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:11:52 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-23b5659e-de47-42c9-a037-07b6d079f484 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Lock "cinder-quobyte-5bc50b6d-445a-4c3b-91be-5bc4dfd09734" acquired by "delete_volume" :: waited 0.016s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:11:52 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba2e2fcf-dfc1-42f3-a6b9-f6d8db75fe4b]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:11:52 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-23b5659e-de47-42c9-a037-07b6d079f484 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-5bc50b6d-445a-4c3b-91be-5bc4dfd09734 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:11:52 devstack sudo[105908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-5bc50b6d-445a-4c3b-91be-5bc4dfd09734 Jul 10 16:11:52 devstack sudo[105908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:11:53 devstack sudo[105904]: pam_unix(sudo:session): session closed for user root Jul 10 16:11:53 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-57383045-45a0-4a5e-aad1-1637c3dc3305 tempest-CinderUnicodeTest-510159742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-e1ac23fc-9417-4458-810a-9bc959af620c 1073741824" returned: 0 in 0.949s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:11:53 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-57383045-45a0-4a5e-aad1-1637c3dc3305 tempest-CinderUnicodeTest-510159742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-e1ac23fc-9417-4458-810a-9bc959af620c {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:11:53 devstack sudo[105915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-e1ac23fc-9417-4458-810a-9bc959af620c Jul 10 16:11:53 devstack sudo[105915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:11:53 devstack sudo[105906]: pam_unix(sudo:session): session closed for user root Jul 10 16:11:53 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-74351d68-cbc3-4184-b73c-9bd6a4e19d4b tempest-VolumeDependencyTests-487079426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.814s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:11:53 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-74351d68-cbc3-4184-b73c-9bd6a4e19d4b tempest-VolumeDependencyTests-487079426 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:11:53 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-74351d68-cbc3-4184-b73c-9bd6a4e19d4b tempest-VolumeDependencyTests-487079426 None] Deleted volume successfully. Jul 10 16:11:53 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-74351d68-cbc3-4184-b73c-9bd6a4e19d4b tempest-VolumeDependencyTests-487079426 None] Lock "cinder-2892ae94-b522-4de4-92b3-9b6a5a90e540-delete_volume" released by "delete_volume" :: held 2.740s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:11:53 devstack sudo[105908]: pam_unix(sudo:session): session closed for user root Jul 10 16:11:53 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-23b5659e-de47-42c9-a037-07b6d079f484 tempest-CreateVolumesFromSnapshotTest-1937876261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-5bc50b6d-445a-4c3b-91be-5bc4dfd09734" returned: 0 in 0.880s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:11:53 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-23b5659e-de47-42c9-a037-07b6d079f484 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-5bc50b6d-445a-4c3b-91be-5bc4dfd09734 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:11:53 devstack sudo[105920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-5bc50b6d-445a-4c3b-91be-5bc4dfd09734 Jul 10 16:11:53 devstack sudo[105920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:11:53 devstack sudo[105915]: pam_unix(sudo:session): session closed for user root Jul 10 16:11:53 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-57383045-45a0-4a5e-aad1-1637c3dc3305 tempest-CinderUnicodeTest-510159742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-e1ac23fc-9417-4458-810a-9bc959af620c" returned: 0 in 0.697s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:11:53 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-57383045-45a0-4a5e-aad1-1637c3dc3305 tempest-CinderUnicodeTest-510159742 None] <== create_volume: return (1690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 16:11:53 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-57383045-45a0-4a5e-aad1-1637c3dc3305 tempest-CinderUnicodeTest-510159742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.693s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:11:53 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-0d642e84-77f6-4711-8ee3-c87fb9a86c17 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.702s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:11:53 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-0d642e84-77f6-4711-8ee3-c87fb9a86c17 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:11:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1397336086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a207383-7c1f-48da-84fa-3b3e9a6f1c91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='074f03cbbea341be879ed151e2c8f1a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:11:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:11:52Z,use_quota=True,user_id='8a9df13920f54d33a593c6dcaa74ab8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 16:11:53 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-0d642e84-77f6-4711-8ee3-c87fb9a86c17 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Creating volume 5a207383-7c1f-48da-84fa-3b3e9a6f1c91 {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 16:11:53 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-0d642e84-77f6-4711-8ee3-c87fb9a86c17 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:11:53 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-0d642e84-77f6-4711-8ee3-c87fb9a86c17 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:11:53 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-0d642e84-77f6-4711-8ee3-c87fb9a86c17 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:11:53 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-0d642e84-77f6-4711-8ee3-c87fb9a86c17 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:11:53 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-0d642e84-77f6-4711-8ee3-c87fb9a86c17 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:11:53 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-0d642e84-77f6-4711-8ee3-c87fb9a86c17 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 16:11:53 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-0d642e84-77f6-4711-8ee3-c87fb9a86c17 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 16:11:53 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-0d642e84-77f6-4711-8ee3-c87fb9a86c17 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-5a207383-7c1f-48da-84fa-3b3e9a6f1c91 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:11:54 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-57383045-45a0-4a5e-aad1-1637c3dc3305 tempest-CinderUnicodeTest-510159742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76769f80-346b-4e6f-8e56-e0be75240a9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1ac23fc-9417-4458-810a-9bc959af620c', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:54 devstack sudo[105924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-5a207383-7c1f-48da-84fa-3b3e9a6f1c91 1073741824 Jul 10 16:11:54 devstack sudo[105924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:11:54 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-57383045-45a0-4a5e-aad1-1637c3dc3305 tempest-CinderUnicodeTest-510159742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c712c49-8f8e-4cfe-aa1c-a6a978da2434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:54 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-57383045-45a0-4a5e-aad1-1637c3dc3305 tempest-CinderUnicodeTest-510159742 None] Volume volume-e1ac23fc-9417-4458-810a-9bc959af620c (e1ac23fc-9417-4458-810a-9bc959af620c): created successfully Jul 10 16:11:54 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-57383045-45a0-4a5e-aad1-1637c3dc3305 tempest-CinderUnicodeTest-510159742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c712c49-8f8e-4cfe-aa1c-a6a978da2434) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:54 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-57383045-45a0-4a5e-aad1-1637c3dc3305 tempest-CinderUnicodeTest-510159742 None] Flow 'volume_create_manager' (51f68ea7-0ecf-477d-9fe9-3446f2b64019) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:11:54 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-57383045-45a0-4a5e-aad1-1637c3dc3305 tempest-CinderUnicodeTest-510159742 None] Created volume successfully. Jul 10 16:11:54 devstack sudo[105920]: pam_unix(sudo:session): session closed for user root Jul 10 16:11:54 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-23b5659e-de47-42c9-a037-07b6d079f484 tempest-CreateVolumesFromSnapshotTest-1937876261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-5bc50b6d-445a-4c3b-91be-5bc4dfd09734" returned: 0 in 0.810s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:11:54 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-23b5659e-de47-42c9-a037-07b6d079f484 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Lock "cinder-quobyte-5bc50b6d-445a-4c3b-91be-5bc4dfd09734" released by "delete_volume" :: held 1.739s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:11:54 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-23b5659e-de47-42c9-a037-07b6d079f484 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Created reservations ['de572bdb-621d-4384-837e-79428d4bebc2', 'b29056af-6f0b-4390-a879-e4e4da3e1516', '7cf259db-50d3-419a-9aeb-cb0a941eedaa', 'f7c0900b-0097-4f0c-a6f4-868e45943875'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:11:54 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-23b5659e-de47-42c9-a037-07b6d079f484 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:11:54 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-23b5659e-de47-42c9-a037-07b6d079f484 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:11:54 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-23b5659e-de47-42c9-a037-07b6d079f484 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:11:54 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-23b5659e-de47-42c9-a037-07b6d079f484 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:11:54 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-23b5659e-de47-42c9-a037-07b6d079f484 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:11:54 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-23b5659e-de47-42c9-a037-07b6d079f484 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:11:54 devstack sudo[105928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:11:54 devstack sudo[105928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:11:54 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-84ab8528-2362-4127-84ad-5bc48f3951ed tempest-CreateVolumesFromSnapshotTest-1937876261 None] Acquiring lock "cinder-5d07f338-490c-431c-9402-521660f9c023-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:11:54 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-84ab8528-2362-4127-84ad-5bc48f3951ed tempest-CreateVolumesFromSnapshotTest-1937876261 None] Lock "cinder-5d07f338-490c-431c-9402-521660f9c023-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:11:54 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-84ab8528-2362-4127-84ad-5bc48f3951ed tempest-CreateVolumesFromSnapshotTest-1937876261 None] Acquiring lock "cinder-quobyte-5d07f338-490c-431c-9402-521660f9c023" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:11:54 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-84ab8528-2362-4127-84ad-5bc48f3951ed tempest-CreateVolumesFromSnapshotTest-1937876261 None] Lock "cinder-quobyte-5d07f338-490c-431c-9402-521660f9c023" acquired by "delete_volume" :: waited 0.021s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:11:54 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[0438525c-c9ed-4211-a800-f1069947b4e6]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:11:54 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-84ab8528-2362-4127-84ad-5bc48f3951ed tempest-CreateVolumesFromSnapshotTest-1937876261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-5d07f338-490c-431c-9402-521660f9c023 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:11:55 devstack sudo[105924]: pam_unix(sudo:session): session closed for user root Jul 10 16:11:55 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-0d642e84-77f6-4711-8ee3-c87fb9a86c17 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-5a207383-7c1f-48da-84fa-3b3e9a6f1c91 1073741824" returned: 0 in 1.024s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:11:55 devstack sudo[105934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-5d07f338-490c-431c-9402-521660f9c023 Jul 10 16:11:55 devstack sudo[105934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:11:55 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-0d642e84-77f6-4711-8ee3-c87fb9a86c17 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-5a207383-7c1f-48da-84fa-3b3e9a6f1c91 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:11:55 devstack sudo[105936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-5a207383-7c1f-48da-84fa-3b3e9a6f1c91 Jul 10 16:11:55 devstack sudo[105936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:11:55 devstack sudo[105928]: pam_unix(sudo:session): session closed for user root Jul 10 16:11:55 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-23b5659e-de47-42c9-a037-07b6d079f484 tempest-CreateVolumesFromSnapshotTest-1937876261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.908s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:11:55 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-23b5659e-de47-42c9-a037-07b6d079f484 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:11:55 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-23b5659e-de47-42c9-a037-07b6d079f484 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Deleted volume successfully. Jul 10 16:11:55 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-23b5659e-de47-42c9-a037-07b6d079f484 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Lock "cinder-5bc50b6d-445a-4c3b-91be-5bc4dfd09734-delete_volume" released by "delete_volume" :: held 2.928s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:11:55 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-12bd8821-e966-4ec8-80c4-fd03d89ecce5 tempest-CinderUnicodeTest-510159742 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 16:11:55 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-12bd8821-e966-4ec8-80c4-fd03d89ecce5 tempest-CinderUnicodeTest-510159742 None] Flow 'volume_create_manager' (81ee2658-460f-42d5-b967-9fa5bb6e6e0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:11:55 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-12bd8821-e966-4ec8-80c4-fd03d89ecce5 tempest-CinderUnicodeTest-510159742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0027ecff-89ef-4ad7-880c-39de230980f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:55 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-12bd8821-e966-4ec8-80c4-fd03d89ecce5 tempest-CinderUnicodeTest-510159742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0027ecff-89ef-4ad7-880c-39de230980f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:11:55Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2025922391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e69f4f1-d76e-4766-98c8-1461a43ce95c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0062d2dd0c1f41bc900d72dd8e968d3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:11:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:11:56Z,use_quota=True,user_id='0bd69d1aa640430383f4a5f311da8700',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:55 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-12bd8821-e966-4ec8-80c4-fd03d89ecce5 tempest-CinderUnicodeTest-510159742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7db4cbba-32c9-4f31-8a46-e0cbced39e90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:55 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-12bd8821-e966-4ec8-80c4-fd03d89ecce5 tempest-CinderUnicodeTest-510159742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7db4cbba-32c9-4f31-8a46-e0cbced39e90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:55 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-12bd8821-e966-4ec8-80c4-fd03d89ecce5 tempest-CinderUnicodeTest-510159742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e3948c9-15f0-4162-a867-0464beae9d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:55 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-12bd8821-e966-4ec8-80c4-fd03d89ecce5 tempest-CinderUnicodeTest-510159742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e3948c9-15f0-4162-a867-0464beae9d97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e69f4f1-d76e-4766-98c8-1461a43ce95c', 'volume_name': 'volume-4e69f4f1-d76e-4766-98c8-1461a43ce95c', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:55 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-12bd8821-e966-4ec8-80c4-fd03d89ecce5 tempest-CinderUnicodeTest-510159742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (693ac167-1e71-408e-8d08-a5d6e6bf0a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:55 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-12bd8821-e966-4ec8-80c4-fd03d89ecce5 tempest-CinderUnicodeTest-510159742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (693ac167-1e71-408e-8d08-a5d6e6bf0a42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:55 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-12bd8821-e966-4ec8-80c4-fd03d89ecce5 tempest-CinderUnicodeTest-510159742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b07b0cd5-341f-4bc2-b3e9-a42bed4d1514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:55 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-12bd8821-e966-4ec8-80c4-fd03d89ecce5 tempest-CinderUnicodeTest-510159742 None] Volume 4e69f4f1-d76e-4766-98c8-1461a43ce95c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e69f4f1-d76e-4766-98c8-1461a43ce95c', 'volume_size': 1} Jul 10 16:11:55 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-12bd8821-e966-4ec8-80c4-fd03d89ecce5 tempest-CinderUnicodeTest-510159742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:11:55 devstack sudo[105934]: pam_unix(sudo:session): session closed for user root Jul 10 16:11:55 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-84ab8528-2362-4127-84ad-5bc48f3951ed tempest-CreateVolumesFromSnapshotTest-1937876261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-5d07f338-490c-431c-9402-521660f9c023" returned: 0 in 1.016s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:11:55 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-84ab8528-2362-4127-84ad-5bc48f3951ed tempest-CreateVolumesFromSnapshotTest-1937876261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-5d07f338-490c-431c-9402-521660f9c023 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:11:55 devstack sudo[105936]: pam_unix(sudo:session): session closed for user root Jul 10 16:11:55 devstack sudo[105943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-5d07f338-490c-431c-9402-521660f9c023 Jul 10 16:11:55 devstack sudo[105943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:11:55 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-0d642e84-77f6-4711-8ee3-c87fb9a86c17 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-5a207383-7c1f-48da-84fa-3b3e9a6f1c91" returned: 0 in 0.876s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:11:55 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-0d642e84-77f6-4711-8ee3-c87fb9a86c17 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] <== create_volume: return (1997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 16:11:55 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-0d642e84-77f6-4711-8ee3-c87fb9a86c17 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:11:55 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-12bd8821-e966-4ec8-80c4-fd03d89ecce5 tempest-CinderUnicodeTest-510159742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.110s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:11:55 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-12bd8821-e966-4ec8-80c4-fd03d89ecce5 tempest-CinderUnicodeTest-510159742 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:11:55Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2025922391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e69f4f1-d76e-4766-98c8-1461a43ce95c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0062d2dd0c1f41bc900d72dd8e968d3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:11:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:11:56Z,use_quota=True,user_id='0bd69d1aa640430383f4a5f311da8700',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 16:11:55 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-12bd8821-e966-4ec8-80c4-fd03d89ecce5 tempest-CinderUnicodeTest-510159742 None] Creating volume 4e69f4f1-d76e-4766-98c8-1461a43ce95c {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 16:11:55 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-12bd8821-e966-4ec8-80c4-fd03d89ecce5 tempest-CinderUnicodeTest-510159742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:11:55 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-12bd8821-e966-4ec8-80c4-fd03d89ecce5 tempest-CinderUnicodeTest-510159742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:11:55 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-12bd8821-e966-4ec8-80c4-fd03d89ecce5 tempest-CinderUnicodeTest-510159742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:11:55 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-12bd8821-e966-4ec8-80c4-fd03d89ecce5 tempest-CinderUnicodeTest-510159742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:11:55 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-12bd8821-e966-4ec8-80c4-fd03d89ecce5 tempest-CinderUnicodeTest-510159742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:11:55 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-12bd8821-e966-4ec8-80c4-fd03d89ecce5 tempest-CinderUnicodeTest-510159742 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 16:11:55 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-12bd8821-e966-4ec8-80c4-fd03d89ecce5 tempest-CinderUnicodeTest-510159742 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 16:11:55 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-12bd8821-e966-4ec8-80c4-fd03d89ecce5 tempest-CinderUnicodeTest-510159742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4e69f4f1-d76e-4766-98c8-1461a43ce95c 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:11:56 devstack sudo[105945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4e69f4f1-d76e-4766-98c8-1461a43ce95c 1073741824 Jul 10 16:11:56 devstack sudo[105945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:11:56 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-0d642e84-77f6-4711-8ee3-c87fb9a86c17 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a16f03a-521d-4251-9d01-fc9effb1198a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a207383-7c1f-48da-84fa-3b3e9a6f1c91', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:56 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-0d642e84-77f6-4711-8ee3-c87fb9a86c17 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (432db6c7-431e-4a10-bdf0-c2ec1a545df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:56 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-0d642e84-77f6-4711-8ee3-c87fb9a86c17 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Volume volume-5a207383-7c1f-48da-84fa-3b3e9a6f1c91 (5a207383-7c1f-48da-84fa-3b3e9a6f1c91): created successfully Jul 10 16:11:56 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-0d642e84-77f6-4711-8ee3-c87fb9a86c17 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (432db6c7-431e-4a10-bdf0-c2ec1a545df6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:56 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-0d642e84-77f6-4711-8ee3-c87fb9a86c17 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Flow 'volume_create_manager' (7935d782-1d8b-45ba-bae4-3f1171d09652) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:11:56 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-0d642e84-77f6-4711-8ee3-c87fb9a86c17 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Created volume successfully. Jul 10 16:11:56 devstack sudo[105943]: pam_unix(sudo:session): session closed for user root Jul 10 16:11:56 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-84ab8528-2362-4127-84ad-5bc48f3951ed tempest-CreateVolumesFromSnapshotTest-1937876261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-5d07f338-490c-431c-9402-521660f9c023" returned: 0 in 0.757s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:11:56 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-84ab8528-2362-4127-84ad-5bc48f3951ed tempest-CreateVolumesFromSnapshotTest-1937876261 None] Lock "cinder-quobyte-5d07f338-490c-431c-9402-521660f9c023" released by "delete_volume" :: held 1.819s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:11:56 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-84ab8528-2362-4127-84ad-5bc48f3951ed tempest-CreateVolumesFromSnapshotTest-1937876261 None] Created reservations ['37fc2011-4865-48cd-ab20-2e48e64314e0', '652b0926-dfef-40f7-a404-b10114751853', '2b13986d-6853-413d-8aad-e08618434d29', '92aa7818-361e-46ac-a2c1-4bc9250ce068'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:11:56 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-84ab8528-2362-4127-84ad-5bc48f3951ed tempest-CreateVolumesFromSnapshotTest-1937876261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:11:56 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-84ab8528-2362-4127-84ad-5bc48f3951ed tempest-CreateVolumesFromSnapshotTest-1937876261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:11:56 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-84ab8528-2362-4127-84ad-5bc48f3951ed tempest-CreateVolumesFromSnapshotTest-1937876261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:11:56 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-84ab8528-2362-4127-84ad-5bc48f3951ed tempest-CreateVolumesFromSnapshotTest-1937876261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:11:56 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-84ab8528-2362-4127-84ad-5bc48f3951ed tempest-CreateVolumesFromSnapshotTest-1937876261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:11:56 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-84ab8528-2362-4127-84ad-5bc48f3951ed tempest-CreateVolumesFromSnapshotTest-1937876261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:11:56 devstack sudo[105952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:11:56 devstack sudo[105952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:11:57 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-b94b47ca-7758-4458-907c-7835e83f687e tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 16:11:57 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b94b47ca-7758-4458-907c-7835e83f687e tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Flow 'volume_create_manager' (ac882b81-c4df-4f10-84b9-58c487b32480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:11:57 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b94b47ca-7758-4458-907c-7835e83f687e tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5569f52a-3c02-4742-ac8a-69a41809a629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:57 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b94b47ca-7758-4458-907c-7835e83f687e tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5569f52a-3c02-4742-ac8a-69a41809a629) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:11:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1014215785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a8ead46-5842-4383-86ea-5aea89503f62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='074f03cbbea341be879ed151e2c8f1a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:11:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:11:57Z,use_quota=True,user_id='8a9df13920f54d33a593c6dcaa74ab8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:57 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b94b47ca-7758-4458-907c-7835e83f687e tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6236dda2-d5d7-4b5c-b93a-68c4913f4d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:57 devstack sudo[105945]: pam_unix(sudo:session): session closed for user root Jul 10 16:11:57 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b94b47ca-7758-4458-907c-7835e83f687e tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6236dda2-d5d7-4b5c-b93a-68c4913f4d91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:57 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b94b47ca-7758-4458-907c-7835e83f687e tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2be25d6b-b662-442c-b511-ca9b1f81d3a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:57 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b94b47ca-7758-4458-907c-7835e83f687e tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2be25d6b-b662-442c-b511-ca9b1f81d3a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a8ead46-5842-4383-86ea-5aea89503f62', 'volume_name': 'volume-4a8ead46-5842-4383-86ea-5aea89503f62', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:57 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b94b47ca-7758-4458-907c-7835e83f687e tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9db7badd-c892-48d0-9026-d79c6843ba5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:57 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b94b47ca-7758-4458-907c-7835e83f687e tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9db7badd-c892-48d0-9026-d79c6843ba5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:57 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b94b47ca-7758-4458-907c-7835e83f687e tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a16cd68-a2a6-41bb-b50a-786901db95d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:57 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-b94b47ca-7758-4458-907c-7835e83f687e tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Volume 4a8ead46-5842-4383-86ea-5aea89503f62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a8ead46-5842-4383-86ea-5aea89503f62', 'volume_size': 1} Jul 10 16:11:57 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-b94b47ca-7758-4458-907c-7835e83f687e tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:11:57 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-12bd8821-e966-4ec8-80c4-fd03d89ecce5 tempest-CinderUnicodeTest-510159742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4e69f4f1-d76e-4766-98c8-1461a43ce95c 1073741824" returned: 0 in 1.140s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:11:57 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-12bd8821-e966-4ec8-80c4-fd03d89ecce5 tempest-CinderUnicodeTest-510159742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4e69f4f1-d76e-4766-98c8-1461a43ce95c {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:11:57 devstack sudo[105954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4e69f4f1-d76e-4766-98c8-1461a43ce95c Jul 10 16:11:57 devstack sudo[105954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:11:57 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-8d0eed39-c3a8-4c92-976a-16389ac55e0d tempest-CreateVolumesFromSnapshotTest-1937876261 None] Acquiring lock "cinder-fa0fbae9-8218-499a-9938-9f838f11ee8d-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:11:57 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-8d0eed39-c3a8-4c92-976a-16389ac55e0d tempest-CreateVolumesFromSnapshotTest-1937876261 None] Lock "cinder-fa0fbae9-8218-499a-9938-9f838f11ee8d-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:11:57 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-8d0eed39-c3a8-4c92-976a-16389ac55e0d tempest-CreateVolumesFromSnapshotTest-1937876261 None] Acquiring lock "cinder-quobyte-fa0fbae9-8218-499a-9938-9f838f11ee8d" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:11:57 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee99fa89-cff7-47b4-b57a-87103802bccd tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 16:11:57 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ee99fa89-cff7-47b4-b57a-87103802bccd tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Flow 'volume_create_manager' (8e192f0c-80d9-47a8-b33e-ccac1cc18791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:11:57 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ee99fa89-cff7-47b4-b57a-87103802bccd tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5db7c379-2cb3-4dc8-a19e-e0e9f9442d02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:57 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-8d0eed39-c3a8-4c92-976a-16389ac55e0d tempest-CreateVolumesFromSnapshotTest-1937876261 None] Lock "cinder-quobyte-fa0fbae9-8218-499a-9938-9f838f11ee8d" acquired by "delete_volume" :: waited 0.099s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:11:57 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ee99fa89-cff7-47b4-b57a-87103802bccd tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5db7c379-2cb3-4dc8-a19e-e0e9f9442d02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:11:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1710528259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=834fd1c1-6b79-4484-b996-7f1f8487471b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='074f03cbbea341be879ed151e2c8f1a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:11:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:11:58Z,use_quota=True,user_id='8a9df13920f54d33a593c6dcaa74ab8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:57 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ee99fa89-cff7-47b4-b57a-87103802bccd tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b092320-6c41-47eb-b321-a5aa83a5f881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:57 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ee99fa89-cff7-47b4-b57a-87103802bccd tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b092320-6c41-47eb-b321-a5aa83a5f881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:57 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ee99fa89-cff7-47b4-b57a-87103802bccd tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b655b1e5-f257-4e1b-829f-cd04e86499ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:57 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ee99fa89-cff7-47b4-b57a-87103802bccd tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b655b1e5-f257-4e1b-829f-cd04e86499ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '834fd1c1-6b79-4484-b996-7f1f8487471b', 'volume_name': 'volume-834fd1c1-6b79-4484-b996-7f1f8487471b', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:57 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ee99fa89-cff7-47b4-b57a-87103802bccd tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58e92e40-5e39-48d6-b1cf-55eb095ed9ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:57 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ee99fa89-cff7-47b4-b57a-87103802bccd tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58e92e40-5e39-48d6-b1cf-55eb095ed9ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:57 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ee99fa89-cff7-47b4-b57a-87103802bccd tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16896fd4-085b-4991-986f-f29c05d0e2f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:57 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-ee99fa89-cff7-47b4-b57a-87103802bccd tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Volume 834fd1c1-6b79-4484-b996-7f1f8487471b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-834fd1c1-6b79-4484-b996-7f1f8487471b', 'volume_size': 1} Jul 10 16:11:57 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-ee99fa89-cff7-47b4-b57a-87103802bccd tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:11:57 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[7511b3b4-94a3-436d-91f4-fec081af9216]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:11:57 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8d0eed39-c3a8-4c92-976a-16389ac55e0d tempest-CreateVolumesFromSnapshotTest-1937876261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-fa0fbae9-8218-499a-9938-9f838f11ee8d {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:11:57 devstack sudo[105952]: pam_unix(sudo:session): session closed for user root Jul 10 16:11:57 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-84ab8528-2362-4127-84ad-5bc48f3951ed tempest-CreateVolumesFromSnapshotTest-1937876261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 1.102s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:11:57 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-84ab8528-2362-4127-84ad-5bc48f3951ed tempest-CreateVolumesFromSnapshotTest-1937876261 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:11:58 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-84ab8528-2362-4127-84ad-5bc48f3951ed tempest-CreateVolumesFromSnapshotTest-1937876261 None] Deleted volume successfully. Jul 10 16:11:58 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-84ab8528-2362-4127-84ad-5bc48f3951ed tempest-CreateVolumesFromSnapshotTest-1937876261 None] Lock "cinder-5d07f338-490c-431c-9402-521660f9c023-delete_volume" released by "delete_volume" :: held 3.245s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:11:58 devstack sudo[105958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-fa0fbae9-8218-499a-9938-9f838f11ee8d Jul 10 16:11:58 devstack sudo[105958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:11:58 devstack sudo[105954]: pam_unix(sudo:session): session closed for user root Jul 10 16:11:58 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d3d4c0c-9e10-44c3-8ba2-0e7af57e72c2 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 16:11:58 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-9d3d4c0c-9e10-44c3-8ba2-0e7af57e72c2 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Flow 'volume_create_manager' (7e65f6ce-75b9-44cf-a1e3-e2cfa5f8fc96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:11:58 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-9d3d4c0c-9e10-44c3-8ba2-0e7af57e72c2 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45b5b847-3343-43cf-b0fd-b84e62795e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:58 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-12bd8821-e966-4ec8-80c4-fd03d89ecce5 tempest-CinderUnicodeTest-510159742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4e69f4f1-d76e-4766-98c8-1461a43ce95c" returned: 0 in 1.108s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:11:58 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-12bd8821-e966-4ec8-80c4-fd03d89ecce5 tempest-CinderUnicodeTest-510159742 None] <== create_volume: return (2299ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 16:11:58 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-12bd8821-e966-4ec8-80c4-fd03d89ecce5 tempest-CinderUnicodeTest-510159742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.302s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:11:58 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-b94b47ca-7758-4458-907c-7835e83f687e tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.159s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:11:58 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-b94b47ca-7758-4458-907c-7835e83f687e tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:11:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1014215785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a8ead46-5842-4383-86ea-5aea89503f62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='074f03cbbea341be879ed151e2c8f1a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:11:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:11:57Z,use_quota=True,user_id='8a9df13920f54d33a593c6dcaa74ab8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 16:11:58 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-b94b47ca-7758-4458-907c-7835e83f687e tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Creating volume 4a8ead46-5842-4383-86ea-5aea89503f62 {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 16:11:58 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-b94b47ca-7758-4458-907c-7835e83f687e tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:11:58 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-b94b47ca-7758-4458-907c-7835e83f687e tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:11:58 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-b94b47ca-7758-4458-907c-7835e83f687e tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:11:58 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-b94b47ca-7758-4458-907c-7835e83f687e tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:11:58 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-b94b47ca-7758-4458-907c-7835e83f687e tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:11:58 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-b94b47ca-7758-4458-907c-7835e83f687e tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 16:11:58 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-b94b47ca-7758-4458-907c-7835e83f687e tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 16:11:58 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-b94b47ca-7758-4458-907c-7835e83f687e tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4a8ead46-5842-4383-86ea-5aea89503f62 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:11:58 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-9d3d4c0c-9e10-44c3-8ba2-0e7af57e72c2 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45b5b847-3343-43cf-b0fd-b84e62795e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:11:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1529824536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49d4e4b3-ab2c-4f1f-95a7-eba79843f659,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='074f03cbbea341be879ed151e2c8f1a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:11:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:11:58Z,use_quota=True,user_id='8a9df13920f54d33a593c6dcaa74ab8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:58 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-9d3d4c0c-9e10-44c3-8ba2-0e7af57e72c2 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab697678-773e-4068-a378-5a2724d14c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:58 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-9d3d4c0c-9e10-44c3-8ba2-0e7af57e72c2 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab697678-773e-4068-a378-5a2724d14c9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:58 devstack sudo[105962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4a8ead46-5842-4383-86ea-5aea89503f62 1073741824 Jul 10 16:11:58 devstack sudo[105962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:11:58 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-9d3d4c0c-9e10-44c3-8ba2-0e7af57e72c2 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f55285cd-5c08-4d30-b17d-3bb3320a3d30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:58 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-9d3d4c0c-9e10-44c3-8ba2-0e7af57e72c2 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f55285cd-5c08-4d30-b17d-3bb3320a3d30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49d4e4b3-ab2c-4f1f-95a7-eba79843f659', 'volume_name': 'volume-49d4e4b3-ab2c-4f1f-95a7-eba79843f659', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:58 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-9d3d4c0c-9e10-44c3-8ba2-0e7af57e72c2 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a205837b-336a-49f6-b460-d2239b9e837c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:58 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-9d3d4c0c-9e10-44c3-8ba2-0e7af57e72c2 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a205837b-336a-49f6-b460-d2239b9e837c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:58 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-9d3d4c0c-9e10-44c3-8ba2-0e7af57e72c2 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c775ee1-33a9-494b-96e2-11a74e16e664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:58 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-9d3d4c0c-9e10-44c3-8ba2-0e7af57e72c2 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Volume 49d4e4b3-ab2c-4f1f-95a7-eba79843f659: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49d4e4b3-ab2c-4f1f-95a7-eba79843f659', 'volume_size': 1} Jul 10 16:11:58 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-9d3d4c0c-9e10-44c3-8ba2-0e7af57e72c2 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:11:58 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-12bd8821-e966-4ec8-80c4-fd03d89ecce5 tempest-CinderUnicodeTest-510159742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b07b0cd5-341f-4bc2-b3e9-a42bed4d1514) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e69f4f1-d76e-4766-98c8-1461a43ce95c', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:58 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-12bd8821-e966-4ec8-80c4-fd03d89ecce5 tempest-CinderUnicodeTest-510159742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b266cfb1-ce44-4b59-8bfe-339f4933f9d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:58 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-12bd8821-e966-4ec8-80c4-fd03d89ecce5 tempest-CinderUnicodeTest-510159742 None] Volume volume-4e69f4f1-d76e-4766-98c8-1461a43ce95c (4e69f4f1-d76e-4766-98c8-1461a43ce95c): created successfully Jul 10 16:11:58 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-12bd8821-e966-4ec8-80c4-fd03d89ecce5 tempest-CinderUnicodeTest-510159742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b266cfb1-ce44-4b59-8bfe-339f4933f9d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:58 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-12bd8821-e966-4ec8-80c4-fd03d89ecce5 tempest-CinderUnicodeTest-510159742 None] Flow 'volume_create_manager' (81ee2658-460f-42d5-b967-9fa5bb6e6e0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:11:58 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-12bd8821-e966-4ec8-80c4-fd03d89ecce5 tempest-CinderUnicodeTest-510159742 None] Created volume successfully. Jul 10 16:11:58 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd0b6e4d-8e18-476e-a33b-120752d22a2e tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 16:11:58 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-bd0b6e4d-8e18-476e-a33b-120752d22a2e tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Flow 'volume_create_manager' (d5f6b3ad-5b74-41ae-9714-bc6fe31e5656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:11:58 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-bd0b6e4d-8e18-476e-a33b-120752d22a2e tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (620a6890-d963-4204-a310-776038b16958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:58 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-bd0b6e4d-8e18-476e-a33b-120752d22a2e tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (620a6890-d963-4204-a310-776038b16958) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:11:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-717328590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34c0e44c-0c51-45a7-80c6-bfe8a43d8d14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='074f03cbbea341be879ed151e2c8f1a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:11:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:11:59Z,use_quota=True,user_id='8a9df13920f54d33a593c6dcaa74ab8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:58 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-bd0b6e4d-8e18-476e-a33b-120752d22a2e tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7aea97b-e361-4b56-b1d7-8ef1ed8290a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:58 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-bd0b6e4d-8e18-476e-a33b-120752d22a2e tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7aea97b-e361-4b56-b1d7-8ef1ed8290a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:58 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-bd0b6e4d-8e18-476e-a33b-120752d22a2e tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65b9d2e4-52e8-444c-add3-e1f641b7c446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:58 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-bd0b6e4d-8e18-476e-a33b-120752d22a2e tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65b9d2e4-52e8-444c-add3-e1f641b7c446) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34c0e44c-0c51-45a7-80c6-bfe8a43d8d14', 'volume_name': 'volume-34c0e44c-0c51-45a7-80c6-bfe8a43d8d14', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:58 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-bd0b6e4d-8e18-476e-a33b-120752d22a2e tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c57aa0b3-fefb-43ff-85b7-a8eebb4a4d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:58 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-bd0b6e4d-8e18-476e-a33b-120752d22a2e tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c57aa0b3-fefb-43ff-85b7-a8eebb4a4d6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:58 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-bd0b6e4d-8e18-476e-a33b-120752d22a2e tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (226b1e5f-ad56-4ad4-b589-1f9b06b2774e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:58 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-bd0b6e4d-8e18-476e-a33b-120752d22a2e tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Volume 34c0e44c-0c51-45a7-80c6-bfe8a43d8d14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34c0e44c-0c51-45a7-80c6-bfe8a43d8d14', 'volume_size': 1} Jul 10 16:11:58 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-bd0b6e4d-8e18-476e-a33b-120752d22a2e tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:11:58 devstack sudo[105958]: pam_unix(sudo:session): session closed for user root Jul 10 16:11:58 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8d0eed39-c3a8-4c92-976a-16389ac55e0d tempest-CreateVolumesFromSnapshotTest-1937876261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-fa0fbae9-8218-499a-9938-9f838f11ee8d" returned: 0 in 1.024s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:11:58 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8d0eed39-c3a8-4c92-976a-16389ac55e0d tempest-CreateVolumesFromSnapshotTest-1937876261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-fa0fbae9-8218-499a-9938-9f838f11ee8d {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:11:59 devstack sudo[105967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-fa0fbae9-8218-499a-9938-9f838f11ee8d Jul 10 16:11:59 devstack sudo[105967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:11:59 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-32de99a6-9598-482a-bbe2-ab006180c4f5 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 16:11:59 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-32de99a6-9598-482a-bbe2-ab006180c4f5 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Flow 'volume_create_manager' (624e2fd7-3ded-4488-9453-80ad4e35343f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:11:59 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-32de99a6-9598-482a-bbe2-ab006180c4f5 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88c62075-dcd2-4676-8d25-e52161e8ca70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:59 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-32de99a6-9598-482a-bbe2-ab006180c4f5 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88c62075-dcd2-4676-8d25-e52161e8ca70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:11:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1766848292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b02e5ac-8f0c-420c-8315-52d400efb76f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='074f03cbbea341be879ed151e2c8f1a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:11:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:11:59Z,use_quota=True,user_id='8a9df13920f54d33a593c6dcaa74ab8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:59 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-32de99a6-9598-482a-bbe2-ab006180c4f5 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad511489-1bf5-47c1-8874-7be7fc0baec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:59 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-32de99a6-9598-482a-bbe2-ab006180c4f5 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad511489-1bf5-47c1-8874-7be7fc0baec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:59 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-32de99a6-9598-482a-bbe2-ab006180c4f5 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52a881e9-4f77-4400-8d44-897b52fd897d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:59 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-32de99a6-9598-482a-bbe2-ab006180c4f5 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52a881e9-4f77-4400-8d44-897b52fd897d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b02e5ac-8f0c-420c-8315-52d400efb76f', 'volume_name': 'volume-8b02e5ac-8f0c-420c-8315-52d400efb76f', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:59 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-32de99a6-9598-482a-bbe2-ab006180c4f5 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db873526-3ecb-4aa0-a822-5c539d386bb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:59 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-32de99a6-9598-482a-bbe2-ab006180c4f5 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db873526-3ecb-4aa0-a822-5c539d386bb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:11:59 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-32de99a6-9598-482a-bbe2-ab006180c4f5 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a21deb7e-2997-448d-89cf-e035f6e2eb1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:11:59 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-32de99a6-9598-482a-bbe2-ab006180c4f5 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Volume 8b02e5ac-8f0c-420c-8315-52d400efb76f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b02e5ac-8f0c-420c-8315-52d400efb76f', 'volume_size': 1} Jul 10 16:11:59 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-32de99a6-9598-482a-bbe2-ab006180c4f5 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:11:59 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-728c2aab-2c4d-483f-937b-3e7be6dadf10 tempest-CinderUnicodeTest-510159742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:11:59 devstack sudo[105962]: pam_unix(sudo:session): session closed for user root Jul 10 16:11:59 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-b94b47ca-7758-4458-907c-7835e83f687e tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4a8ead46-5842-4383-86ea-5aea89503f62 1073741824" returned: 0 in 1.210s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:11:59 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-b94b47ca-7758-4458-907c-7835e83f687e tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4a8ead46-5842-4383-86ea-5aea89503f62 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:11:59 devstack sudo[105973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4a8ead46-5842-4383-86ea-5aea89503f62 Jul 10 16:11:59 devstack sudo[105973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:11:59 devstack sudo[105967]: pam_unix(sudo:session): session closed for user root Jul 10 16:11:59 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8d0eed39-c3a8-4c92-976a-16389ac55e0d tempest-CreateVolumesFromSnapshotTest-1937876261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-fa0fbae9-8218-499a-9938-9f838f11ee8d" returned: 0 in 0.894s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:11:59 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-8d0eed39-c3a8-4c92-976a-16389ac55e0d tempest-CreateVolumesFromSnapshotTest-1937876261 None] Lock "cinder-quobyte-fa0fbae9-8218-499a-9938-9f838f11ee8d" released by "delete_volume" :: held 2.095s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:11:59 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-8d0eed39-c3a8-4c92-976a-16389ac55e0d tempest-CreateVolumesFromSnapshotTest-1937876261 None] Created reservations ['a5c5fcac-67aa-4b42-9c2d-eb67c2903da2', '0c38fe2b-4ef5-4c2f-bf03-e0452cf0f5f7', '21345053-bc2b-431f-bfad-b42010faa755', 'e7620ac9-6f26-4f43-ac43-564608ce5bf0'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:12:00 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-8d0eed39-c3a8-4c92-976a-16389ac55e0d tempest-CreateVolumesFromSnapshotTest-1937876261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:12:00 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-8d0eed39-c3a8-4c92-976a-16389ac55e0d tempest-CreateVolumesFromSnapshotTest-1937876261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:12:00 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-8d0eed39-c3a8-4c92-976a-16389ac55e0d tempest-CreateVolumesFromSnapshotTest-1937876261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:12:00 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-8d0eed39-c3a8-4c92-976a-16389ac55e0d tempest-CreateVolumesFromSnapshotTest-1937876261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:12:00 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-8d0eed39-c3a8-4c92-976a-16389ac55e0d tempest-CreateVolumesFromSnapshotTest-1937876261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:12:00 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8d0eed39-c3a8-4c92-976a-16389ac55e0d tempest-CreateVolumesFromSnapshotTest-1937876261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:00 devstack sudo[105976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:12:00 devstack sudo[105976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:00 devstack sudo[105973]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:00 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-b94b47ca-7758-4458-907c-7835e83f687e tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4a8ead46-5842-4383-86ea-5aea89503f62" returned: 0 in 0.717s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:00 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-b94b47ca-7758-4458-907c-7835e83f687e tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] <== create_volume: return (1966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 16:12:00 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-b94b47ca-7758-4458-907c-7835e83f687e tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.968s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:12:00 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-ee99fa89-cff7-47b4-b57a-87103802bccd tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.304s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:12:00 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-ee99fa89-cff7-47b4-b57a-87103802bccd tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:11:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1710528259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=834fd1c1-6b79-4484-b996-7f1f8487471b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='074f03cbbea341be879ed151e2c8f1a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:11:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:11:58Z,use_quota=True,user_id='8a9df13920f54d33a593c6dcaa74ab8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 16:12:00 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-ee99fa89-cff7-47b4-b57a-87103802bccd tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Creating volume 834fd1c1-6b79-4484-b996-7f1f8487471b {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 16:12:00 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-ee99fa89-cff7-47b4-b57a-87103802bccd tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:12:00 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-ee99fa89-cff7-47b4-b57a-87103802bccd tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:12:00 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-ee99fa89-cff7-47b4-b57a-87103802bccd tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:12:00 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-ee99fa89-cff7-47b4-b57a-87103802bccd tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:12:00 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-ee99fa89-cff7-47b4-b57a-87103802bccd tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:12:00 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-ee99fa89-cff7-47b4-b57a-87103802bccd tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 16:12:00 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-ee99fa89-cff7-47b4-b57a-87103802bccd tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 16:12:00 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ee99fa89-cff7-47b4-b57a-87103802bccd tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-834fd1c1-6b79-4484-b996-7f1f8487471b 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:00 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b94b47ca-7758-4458-907c-7835e83f687e tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a16cd68-a2a6-41bb-b50a-786901db95d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a8ead46-5842-4383-86ea-5aea89503f62', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:12:00 devstack sudo[105979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-834fd1c1-6b79-4484-b996-7f1f8487471b 1073741824 Jul 10 16:12:00 devstack sudo[105979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:00 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b94b47ca-7758-4458-907c-7835e83f687e tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8af6e0f2-0b89-432d-a8e1-c4ae415586b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:12:00 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-b94b47ca-7758-4458-907c-7835e83f687e tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Volume volume-4a8ead46-5842-4383-86ea-5aea89503f62 (4a8ead46-5842-4383-86ea-5aea89503f62): created successfully Jul 10 16:12:00 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b94b47ca-7758-4458-907c-7835e83f687e tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8af6e0f2-0b89-432d-a8e1-c4ae415586b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:12:00 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b94b47ca-7758-4458-907c-7835e83f687e tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Flow 'volume_create_manager' (ac882b81-c4df-4f10-84b9-58c487b32480) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:12:00 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-b94b47ca-7758-4458-907c-7835e83f687e tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Created volume successfully. Jul 10 16:12:00 devstack sudo[105976]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:00 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8d0eed39-c3a8-4c92-976a-16389ac55e0d tempest-CreateVolumesFromSnapshotTest-1937876261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.663s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:00 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-8d0eed39-c3a8-4c92-976a-16389ac55e0d tempest-CreateVolumesFromSnapshotTest-1937876261 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:12:00 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-8d0eed39-c3a8-4c92-976a-16389ac55e0d tempest-CreateVolumesFromSnapshotTest-1937876261 None] Deleted volume successfully. Jul 10 16:12:00 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-8d0eed39-c3a8-4c92-976a-16389ac55e0d tempest-CreateVolumesFromSnapshotTest-1937876261 None] Lock "cinder-fa0fbae9-8218-499a-9938-9f838f11ee8d-delete_volume" released by "delete_volume" :: held 3.284s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:12:00 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-719bb83d-0286-4542-8eb3-98ba85b5e92c tempest-CreateVolumesFromSnapshotTest-1937876261 None] Acquiring lock "cinder-c3912bc6-d421-4f30-8879-5af749e14a7d-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:12:01 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-719bb83d-0286-4542-8eb3-98ba85b5e92c tempest-CreateVolumesFromSnapshotTest-1937876261 None] Lock "cinder-c3912bc6-d421-4f30-8879-5af749e14a7d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:12:01 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-719bb83d-0286-4542-8eb3-98ba85b5e92c tempest-CreateVolumesFromSnapshotTest-1937876261 None] Acquiring lock "cinder-quobyte-c3912bc6-d421-4f30-8879-5af749e14a7d" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:12:01 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-719bb83d-0286-4542-8eb3-98ba85b5e92c tempest-CreateVolumesFromSnapshotTest-1937876261 None] Lock "cinder-quobyte-c3912bc6-d421-4f30-8879-5af749e14a7d" acquired by "delete_volume" :: waited 0.017s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:12:01 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d93176f-7820-4c13-a91c-75a3aed07154]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:12:01 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-719bb83d-0286-4542-8eb3-98ba85b5e92c tempest-CreateVolumesFromSnapshotTest-1937876261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-c3912bc6-d421-4f30-8879-5af749e14a7d {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:01 devstack sudo[105979]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:01 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ee99fa89-cff7-47b4-b57a-87103802bccd tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-834fd1c1-6b79-4484-b996-7f1f8487471b 1073741824" returned: 0 in 0.909s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:01 devstack sudo[105986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-c3912bc6-d421-4f30-8879-5af749e14a7d Jul 10 16:12:01 devstack sudo[105986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:01 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ee99fa89-cff7-47b4-b57a-87103802bccd tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-834fd1c1-6b79-4484-b996-7f1f8487471b {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:01 devstack sudo[105988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-834fd1c1-6b79-4484-b996-7f1f8487471b Jul 10 16:12:01 devstack sudo[105988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:01 devstack sudo[105988]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:01 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ee99fa89-cff7-47b4-b57a-87103802bccd tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-834fd1c1-6b79-4484-b996-7f1f8487471b" returned: 0 in 0.682s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:01 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-ee99fa89-cff7-47b4-b57a-87103802bccd tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] <== create_volume: return (1647ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 16:12:01 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-ee99fa89-cff7-47b4-b57a-87103802bccd tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.650s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:12:01 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-9d3d4c0c-9e10-44c3-8ba2-0e7af57e72c2 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.550s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:12:01 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-9d3d4c0c-9e10-44c3-8ba2-0e7af57e72c2 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:11:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1529824536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49d4e4b3-ab2c-4f1f-95a7-eba79843f659,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='074f03cbbea341be879ed151e2c8f1a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:11:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:11:58Z,use_quota=True,user_id='8a9df13920f54d33a593c6dcaa74ab8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 16:12:01 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-9d3d4c0c-9e10-44c3-8ba2-0e7af57e72c2 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Creating volume 49d4e4b3-ab2c-4f1f-95a7-eba79843f659 {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 16:12:01 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-9d3d4c0c-9e10-44c3-8ba2-0e7af57e72c2 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:12:01 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-9d3d4c0c-9e10-44c3-8ba2-0e7af57e72c2 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:12:01 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-9d3d4c0c-9e10-44c3-8ba2-0e7af57e72c2 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:12:01 devstack sudo[105986]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:01 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-9d3d4c0c-9e10-44c3-8ba2-0e7af57e72c2 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:12:01 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-9d3d4c0c-9e10-44c3-8ba2-0e7af57e72c2 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:12:01 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-9d3d4c0c-9e10-44c3-8ba2-0e7af57e72c2 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 16:12:01 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-9d3d4c0c-9e10-44c3-8ba2-0e7af57e72c2 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 16:12:01 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-9d3d4c0c-9e10-44c3-8ba2-0e7af57e72c2 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-49d4e4b3-ab2c-4f1f-95a7-eba79843f659 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:01 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-719bb83d-0286-4542-8eb3-98ba85b5e92c tempest-CreateVolumesFromSnapshotTest-1937876261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-c3912bc6-d421-4f30-8879-5af749e14a7d" returned: 0 in 0.846s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:01 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-719bb83d-0286-4542-8eb3-98ba85b5e92c tempest-CreateVolumesFromSnapshotTest-1937876261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-c3912bc6-d421-4f30-8879-5af749e14a7d {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:01 devstack sudo[105994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-49d4e4b3-ab2c-4f1f-95a7-eba79843f659 1073741824 Jul 10 16:12:01 devstack sudo[105994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:01 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ee99fa89-cff7-47b4-b57a-87103802bccd tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16896fd4-085b-4991-986f-f29c05d0e2f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-834fd1c1-6b79-4484-b996-7f1f8487471b', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:12:01 devstack sudo[105995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-c3912bc6-d421-4f30-8879-5af749e14a7d Jul 10 16:12:01 devstack sudo[105995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:01 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ee99fa89-cff7-47b4-b57a-87103802bccd tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a281db9-478b-4689-a102-3910b8451ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:12:01 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-ee99fa89-cff7-47b4-b57a-87103802bccd tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Volume volume-834fd1c1-6b79-4484-b996-7f1f8487471b (834fd1c1-6b79-4484-b996-7f1f8487471b): created successfully Jul 10 16:12:02 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ee99fa89-cff7-47b4-b57a-87103802bccd tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a281db9-478b-4689-a102-3910b8451ea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:12:02 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ee99fa89-cff7-47b4-b57a-87103802bccd tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Flow 'volume_create_manager' (8e192f0c-80d9-47a8-b33e-ccac1cc18791) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:12:02 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-ee99fa89-cff7-47b4-b57a-87103802bccd tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Created volume successfully. Jul 10 16:12:02 devstack sudo[105995]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:02 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-719bb83d-0286-4542-8eb3-98ba85b5e92c tempest-CreateVolumesFromSnapshotTest-1937876261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-c3912bc6-d421-4f30-8879-5af749e14a7d" returned: 0 in 0.827s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:02 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-719bb83d-0286-4542-8eb3-98ba85b5e92c tempest-CreateVolumesFromSnapshotTest-1937876261 None] Lock "cinder-quobyte-c3912bc6-d421-4f30-8879-5af749e14a7d" released by "delete_volume" :: held 1.731s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:12:02 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-719bb83d-0286-4542-8eb3-98ba85b5e92c tempest-CreateVolumesFromSnapshotTest-1937876261 None] Created reservations ['892db702-42aa-4e49-8c8a-7e796dfb1b38', '652fc91d-9d50-4709-b5d1-3554c7485e2e', '5b30c827-1303-4ae1-8439-4f751b34b061', '76699fd3-7d86-4bca-819e-7625c0788d8f'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:12:02 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-719bb83d-0286-4542-8eb3-98ba85b5e92c tempest-CreateVolumesFromSnapshotTest-1937876261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:12:02 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-719bb83d-0286-4542-8eb3-98ba85b5e92c tempest-CreateVolumesFromSnapshotTest-1937876261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:12:02 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-719bb83d-0286-4542-8eb3-98ba85b5e92c tempest-CreateVolumesFromSnapshotTest-1937876261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:12:02 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-719bb83d-0286-4542-8eb3-98ba85b5e92c tempest-CreateVolumesFromSnapshotTest-1937876261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:12:02 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-719bb83d-0286-4542-8eb3-98ba85b5e92c tempest-CreateVolumesFromSnapshotTest-1937876261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:12:02 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-719bb83d-0286-4542-8eb3-98ba85b5e92c tempest-CreateVolumesFromSnapshotTest-1937876261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:02 devstack sudo[105994]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:02 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-9d3d4c0c-9e10-44c3-8ba2-0e7af57e72c2 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-49d4e4b3-ab2c-4f1f-95a7-eba79843f659 1073741824" returned: 0 in 1.053s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:02 devstack sudo[106003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:12:02 devstack sudo[106003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:03 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-9d3d4c0c-9e10-44c3-8ba2-0e7af57e72c2 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-49d4e4b3-ab2c-4f1f-95a7-eba79843f659 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:03 devstack sudo[106005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-49d4e4b3-ab2c-4f1f-95a7-eba79843f659 Jul 10 16:12:03 devstack sudo[106005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:03 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-6fb67806-de30-4a55-9ab4-377ec6d2ae4c tempest-CreateVolumesFromSnapshotTest-1937876261 None] Acquiring lock "cinder-00e89551-b7a0-4b20-a11d-1da1c0368d13-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:12:03 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-6fb67806-de30-4a55-9ab4-377ec6d2ae4c tempest-CreateVolumesFromSnapshotTest-1937876261 None] Lock "cinder-00e89551-b7a0-4b20-a11d-1da1c0368d13-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:12:03 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-6fb67806-de30-4a55-9ab4-377ec6d2ae4c tempest-CreateVolumesFromSnapshotTest-1937876261 None] Acquiring lock "cinder-quobyte-00e89551-b7a0-4b20-a11d-1da1c0368d13" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:12:03 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-6fb67806-de30-4a55-9ab4-377ec6d2ae4c tempest-CreateVolumesFromSnapshotTest-1937876261 None] Lock "cinder-quobyte-00e89551-b7a0-4b20-a11d-1da1c0368d13" acquired by "delete_volume" :: waited 0.031s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:12:03 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[3242bba1-49df-4fe0-8920-8afbc00c453a]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:12:03 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6fb67806-de30-4a55-9ab4-377ec6d2ae4c tempest-CreateVolumesFromSnapshotTest-1937876261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-00e89551-b7a0-4b20-a11d-1da1c0368d13 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:03 devstack sudo[106007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-00e89551-b7a0-4b20-a11d-1da1c0368d13 Jul 10 16:12:03 devstack sudo[106007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:03 devstack sudo[106003]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:03 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-719bb83d-0286-4542-8eb3-98ba85b5e92c tempest-CreateVolumesFromSnapshotTest-1937876261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.725s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:03 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-719bb83d-0286-4542-8eb3-98ba85b5e92c tempest-CreateVolumesFromSnapshotTest-1937876261 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:12:03 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-719bb83d-0286-4542-8eb3-98ba85b5e92c tempest-CreateVolumesFromSnapshotTest-1937876261 None] Deleted volume successfully. Jul 10 16:12:03 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-719bb83d-0286-4542-8eb3-98ba85b5e92c tempest-CreateVolumesFromSnapshotTest-1937876261 None] Lock "cinder-c3912bc6-d421-4f30-8879-5af749e14a7d-delete_volume" released by "delete_volume" :: held 2.721s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:12:03 devstack sudo[106005]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:03 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-9d3d4c0c-9e10-44c3-8ba2-0e7af57e72c2 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-49d4e4b3-ab2c-4f1f-95a7-eba79843f659" returned: 0 in 0.821s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:03 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-9d3d4c0c-9e10-44c3-8ba2-0e7af57e72c2 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] <== create_volume: return (1939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 16:12:03 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-9d3d4c0c-9e10-44c3-8ba2-0e7af57e72c2 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.942s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:12:03 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-bd0b6e4d-8e18-476e-a33b-120752d22a2e tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.988s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:12:03 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-bd0b6e4d-8e18-476e-a33b-120752d22a2e tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:11:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-717328590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34c0e44c-0c51-45a7-80c6-bfe8a43d8d14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='074f03cbbea341be879ed151e2c8f1a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:11:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:11:59Z,use_quota=True,user_id='8a9df13920f54d33a593c6dcaa74ab8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 16:12:03 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-bd0b6e4d-8e18-476e-a33b-120752d22a2e tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Creating volume 34c0e44c-0c51-45a7-80c6-bfe8a43d8d14 {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 16:12:03 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-bd0b6e4d-8e18-476e-a33b-120752d22a2e tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:12:03 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-bd0b6e4d-8e18-476e-a33b-120752d22a2e tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:12:03 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-bd0b6e4d-8e18-476e-a33b-120752d22a2e tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:12:03 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-bd0b6e4d-8e18-476e-a33b-120752d22a2e tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:12:03 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-bd0b6e4d-8e18-476e-a33b-120752d22a2e tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:12:03 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-bd0b6e4d-8e18-476e-a33b-120752d22a2e tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 16:12:03 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-bd0b6e4d-8e18-476e-a33b-120752d22a2e tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 16:12:03 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-bd0b6e4d-8e18-476e-a33b-120752d22a2e tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-34c0e44c-0c51-45a7-80c6-bfe8a43d8d14 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:03 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-9d3d4c0c-9e10-44c3-8ba2-0e7af57e72c2 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c775ee1-33a9-494b-96e2-11a74e16e664) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49d4e4b3-ab2c-4f1f-95a7-eba79843f659', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:12:03 devstack sudo[106012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-34c0e44c-0c51-45a7-80c6-bfe8a43d8d14 1073741824 Jul 10 16:12:03 devstack sudo[106012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:03 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-9d3d4c0c-9e10-44c3-8ba2-0e7af57e72c2 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23ca2f89-95e8-4d17-b370-bafac3a135d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:12:03 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-9d3d4c0c-9e10-44c3-8ba2-0e7af57e72c2 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Volume volume-49d4e4b3-ab2c-4f1f-95a7-eba79843f659 (49d4e4b3-ab2c-4f1f-95a7-eba79843f659): created successfully Jul 10 16:12:03 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-9d3d4c0c-9e10-44c3-8ba2-0e7af57e72c2 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23ca2f89-95e8-4d17-b370-bafac3a135d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:12:03 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-9d3d4c0c-9e10-44c3-8ba2-0e7af57e72c2 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Flow 'volume_create_manager' (7e65f6ce-75b9-44cf-a1e3-e2cfa5f8fc96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:12:03 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-9d3d4c0c-9e10-44c3-8ba2-0e7af57e72c2 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Created volume successfully. Jul 10 16:12:04 devstack sudo[106007]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:04 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6fb67806-de30-4a55-9ab4-377ec6d2ae4c tempest-CreateVolumesFromSnapshotTest-1937876261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-00e89551-b7a0-4b20-a11d-1da1c0368d13" returned: 0 in 0.816s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:04 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6fb67806-de30-4a55-9ab4-377ec6d2ae4c tempest-CreateVolumesFromSnapshotTest-1937876261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-00e89551-b7a0-4b20-a11d-1da1c0368d13 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:04 devstack sudo[106017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-00e89551-b7a0-4b20-a11d-1da1c0368d13 Jul 10 16:12:04 devstack sudo[106017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:04 devstack sudo[106012]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:04 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-bd0b6e4d-8e18-476e-a33b-120752d22a2e tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-34c0e44c-0c51-45a7-80c6-bfe8a43d8d14 1073741824" returned: 0 in 0.888s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:04 devstack cinder-volume[87420]: DEBUG dbcounter [-] [87420] Writing DB stats cinder:UPDATE=156,cinder:SELECT=129,cinder:INSERT=43,cinder:DELETE=17 {{(pid=87420) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 16:12:04 devstack cinder-volume[87420]: DEBUG dbcounter [-] [87420] Writing DB stats cinder:SELECT=117,cinder:UPDATE=179,cinder:DELETE=17,cinder:INSERT=40 {{(pid=87420) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 16:12:04 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-bd0b6e4d-8e18-476e-a33b-120752d22a2e tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-34c0e44c-0c51-45a7-80c6-bfe8a43d8d14 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:04 devstack sudo[106022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-34c0e44c-0c51-45a7-80c6-bfe8a43d8d14 Jul 10 16:12:04 devstack sudo[106022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:04 devstack sudo[106017]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:04 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6fb67806-de30-4a55-9ab4-377ec6d2ae4c tempest-CreateVolumesFromSnapshotTest-1937876261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-00e89551-b7a0-4b20-a11d-1da1c0368d13" returned: 0 in 0.681s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:04 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-6fb67806-de30-4a55-9ab4-377ec6d2ae4c tempest-CreateVolumesFromSnapshotTest-1937876261 None] Lock "cinder-quobyte-00e89551-b7a0-4b20-a11d-1da1c0368d13" released by "delete_volume" :: held 1.560s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:12:05 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-6fb67806-de30-4a55-9ab4-377ec6d2ae4c tempest-CreateVolumesFromSnapshotTest-1937876261 None] Created reservations ['03bce144-7ba4-4454-807c-68145edcb5eb', '90a1dbcc-cf03-4f13-8767-afbcb5099513', 'dd4eaebb-c849-4df4-9d96-06d0b03e8a0f', '95cfb5c6-f58a-4034-b1cf-036b334cac84'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:12:05 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-6fb67806-de30-4a55-9ab4-377ec6d2ae4c tempest-CreateVolumesFromSnapshotTest-1937876261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:12:05 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-6fb67806-de30-4a55-9ab4-377ec6d2ae4c tempest-CreateVolumesFromSnapshotTest-1937876261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:12:05 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-6fb67806-de30-4a55-9ab4-377ec6d2ae4c tempest-CreateVolumesFromSnapshotTest-1937876261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:12:05 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-6fb67806-de30-4a55-9ab4-377ec6d2ae4c tempest-CreateVolumesFromSnapshotTest-1937876261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:12:05 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-6fb67806-de30-4a55-9ab4-377ec6d2ae4c tempest-CreateVolumesFromSnapshotTest-1937876261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:12:05 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6fb67806-de30-4a55-9ab4-377ec6d2ae4c tempest-CreateVolumesFromSnapshotTest-1937876261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:05 devstack sudo[106025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:12:05 devstack sudo[106025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:05 devstack sudo[106022]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:05 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-bd0b6e4d-8e18-476e-a33b-120752d22a2e tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-34c0e44c-0c51-45a7-80c6-bfe8a43d8d14" returned: 0 in 0.644s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:05 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-bd0b6e4d-8e18-476e-a33b-120752d22a2e tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] <== create_volume: return (1592ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 16:12:05 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-bd0b6e4d-8e18-476e-a33b-120752d22a2e tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.595s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:12:05 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-32de99a6-9598-482a-bbe2-ab006180c4f5 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.238s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:12:05 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-32de99a6-9598-482a-bbe2-ab006180c4f5 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:11:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1766848292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b02e5ac-8f0c-420c-8315-52d400efb76f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='074f03cbbea341be879ed151e2c8f1a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:11:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:11:59Z,use_quota=True,user_id='8a9df13920f54d33a593c6dcaa74ab8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 16:12:05 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-32de99a6-9598-482a-bbe2-ab006180c4f5 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Creating volume 8b02e5ac-8f0c-420c-8315-52d400efb76f {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 16:12:05 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-32de99a6-9598-482a-bbe2-ab006180c4f5 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:12:05 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-32de99a6-9598-482a-bbe2-ab006180c4f5 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:12:05 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-32de99a6-9598-482a-bbe2-ab006180c4f5 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:12:05 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-32de99a6-9598-482a-bbe2-ab006180c4f5 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:12:05 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-32de99a6-9598-482a-bbe2-ab006180c4f5 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:12:05 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-32de99a6-9598-482a-bbe2-ab006180c4f5 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 16:12:05 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-32de99a6-9598-482a-bbe2-ab006180c4f5 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 16:12:05 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-32de99a6-9598-482a-bbe2-ab006180c4f5 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-8b02e5ac-8f0c-420c-8315-52d400efb76f 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:05 devstack sudo[106028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-8b02e5ac-8f0c-420c-8315-52d400efb76f 1073741824 Jul 10 16:12:05 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-bd0b6e4d-8e18-476e-a33b-120752d22a2e tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (226b1e5f-ad56-4ad4-b589-1f9b06b2774e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34c0e44c-0c51-45a7-80c6-bfe8a43d8d14', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:12:05 devstack sudo[106028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:05 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-bd0b6e4d-8e18-476e-a33b-120752d22a2e tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75508393-a0ba-418a-bfd9-f7138b513d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:12:05 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-bd0b6e4d-8e18-476e-a33b-120752d22a2e tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Volume volume-34c0e44c-0c51-45a7-80c6-bfe8a43d8d14 (34c0e44c-0c51-45a7-80c6-bfe8a43d8d14): created successfully Jul 10 16:12:05 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-bd0b6e4d-8e18-476e-a33b-120752d22a2e tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75508393-a0ba-418a-bfd9-f7138b513d2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:12:05 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-bd0b6e4d-8e18-476e-a33b-120752d22a2e tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Flow 'volume_create_manager' (d5f6b3ad-5b74-41ae-9714-bc6fe31e5656) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:12:05 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-e00aa105-5f74-4530-b24c-e6456d8dc4f3 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Acquiring lock "cinder-f7d6a443-ccfa-4e36-a091-4ef7dc684d94-delete_snapshot" by "delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:12:05 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-bd0b6e4d-8e18-476e-a33b-120752d22a2e tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Created volume successfully. Jul 10 16:12:05 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-e00aa105-5f74-4530-b24c-e6456d8dc4f3 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Lock "cinder-f7d6a443-ccfa-4e36-a091-4ef7dc684d94-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:12:05 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-e00aa105-5f74-4530-b24c-e6456d8dc4f3 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Acquiring lock "cinder-quobyte-aa0bcde3-519e-47f8-9f83-baa1d1d7eac3" by "delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:12:05 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-e00aa105-5f74-4530-b24c-e6456d8dc4f3 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Lock "cinder-quobyte-aa0bcde3-519e-47f8-9f83-baa1d1d7eac3" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:12:05 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-e00aa105-5f74-4530-b24c-e6456d8dc4f3 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Acquiring lock "cinder-quobyte-f7d6a443-ccfa-4e36-a091-4ef7dc684d94" by "_delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:12:05 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-e00aa105-5f74-4530-b24c-e6456d8dc4f3 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Lock "cinder-quobyte-f7d6a443-ccfa-4e36-a091-4ef7dc684d94" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:12:05 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-e00aa105-5f74-4530-b24c-e6456d8dc4f3 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Deleting offline snapshot f7d6a443-ccfa-4e36-a091-4ef7dc684d94 of volume aa0bcde3-519e-47f8-9f83-baa1d1d7eac3 {{(pid=87420) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 16:12:05 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-e00aa105-5f74-4530-b24c-e6456d8dc4f3 tempest-CreateVolumesFromSnapshotTest-1937876261 None] snapshot_file for this snap is: volume-aa0bcde3-519e-47f8-9f83-baa1d1d7eac3.f7d6a443-ccfa-4e36-a091-4ef7dc684d94 {{(pid=87420) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 16:12:05 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[daf64d42-5ee3-4a28-9a4f-3fd268935977]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:12:05 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-e00aa105-5f74-4530-b24c-e6456d8dc4f3 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-aa0bcde3-519e-47f8-9f83-baa1d1d7eac3.f7d6a443-ccfa-4e36-a091-4ef7dc684d94 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:05 devstack sudo[106025]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:05 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6fb67806-de30-4a55-9ab4-377ec6d2ae4c tempest-CreateVolumesFromSnapshotTest-1937876261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.696s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:05 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-6fb67806-de30-4a55-9ab4-377ec6d2ae4c tempest-CreateVolumesFromSnapshotTest-1937876261 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:12:05 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-6fb67806-de30-4a55-9ab4-377ec6d2ae4c tempest-CreateVolumesFromSnapshotTest-1937876261 None] Deleted volume successfully. Jul 10 16:12:05 devstack sudo[106031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-aa0bcde3-519e-47f8-9f83-baa1d1d7eac3.f7d6a443-ccfa-4e36-a091-4ef7dc684d94 Jul 10 16:12:05 devstack sudo[106031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:05 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-6fb67806-de30-4a55-9ab4-377ec6d2ae4c tempest-CreateVolumesFromSnapshotTest-1937876261 None] Lock "cinder-00e89551-b7a0-4b20-a11d-1da1c0368d13-delete_volume" released by "delete_volume" :: held 2.519s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:12:06 devstack sudo[106028]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:06 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-32de99a6-9598-482a-bbe2-ab006180c4f5 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-8b02e5ac-8f0c-420c-8315-52d400efb76f 1073741824" returned: 0 in 0.907s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:06 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-32de99a6-9598-482a-bbe2-ab006180c4f5 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-8b02e5ac-8f0c-420c-8315-52d400efb76f {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:06 devstack sudo[106039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-8b02e5ac-8f0c-420c-8315-52d400efb76f Jul 10 16:12:06 devstack sudo[106039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:06 devstack sudo[106031]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:06 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-e00aa105-5f74-4530-b24c-e6456d8dc4f3 tempest-CreateVolumesFromSnapshotTest-1937876261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-aa0bcde3-519e-47f8-9f83-baa1d1d7eac3.f7d6a443-ccfa-4e36-a091-4ef7dc684d94" returned: 0 in 0.808s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:06 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-e00aa105-5f74-4530-b24c-e6456d8dc4f3 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aa0bcde3-519e-47f8-9f83-baa1d1d7eac3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87420) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 16:12:06 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e7fd44-25b0-4a79-b15d-fe6bc92d2dd0]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:12:06 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-e00aa105-5f74-4530-b24c-e6456d8dc4f3 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-aa0bcde3-519e-47f8-9f83-baa1d1d7eac3 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:06 devstack sudo[106041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-aa0bcde3-519e-47f8-9f83-baa1d1d7eac3 Jul 10 16:12:06 devstack sudo[106041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:07 devstack sudo[106039]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:07 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-32de99a6-9598-482a-bbe2-ab006180c4f5 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-8b02e5ac-8f0c-420c-8315-52d400efb76f" returned: 0 in 0.652s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:07 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-32de99a6-9598-482a-bbe2-ab006180c4f5 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] <== create_volume: return (1607ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 16:12:07 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-32de99a6-9598-482a-bbe2-ab006180c4f5 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.610s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:12:07 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-728c2aab-2c4d-483f-937b-3e7be6dadf10 tempest-CinderUnicodeTest-510159742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.701s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:12:07 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-728c2aab-2c4d-483f-937b-3e7be6dadf10 tempest-CinderUnicodeTest-510159742 None] Creating offline snapshot fd619523-8a5b-46df-b96b-4ab55e803c9b of volume 4e69f4f1-d76e-4766-98c8-1461a43ce95c {{(pid=87420) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 16:12:07 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-32de99a6-9598-482a-bbe2-ab006180c4f5 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a21deb7e-2997-448d-89cf-e035f6e2eb1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b02e5ac-8f0c-420c-8315-52d400efb76f', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:12:07 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-32de99a6-9598-482a-bbe2-ab006180c4f5 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3a40293-d32c-4332-85da-65f348ac98ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:12:07 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[452b30d5-48e7-4144-902d-76cbd333e99c]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:12:07 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-728c2aab-2c4d-483f-937b-3e7be6dadf10 tempest-CinderUnicodeTest-510159742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4e69f4f1-d76e-4766-98c8-1461a43ce95c {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:07 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-32de99a6-9598-482a-bbe2-ab006180c4f5 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Volume volume-8b02e5ac-8f0c-420c-8315-52d400efb76f (8b02e5ac-8f0c-420c-8315-52d400efb76f): created successfully Jul 10 16:12:07 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-32de99a6-9598-482a-bbe2-ab006180c4f5 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3a40293-d32c-4332-85da-65f348ac98ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:12:07 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-32de99a6-9598-482a-bbe2-ab006180c4f5 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Flow 'volume_create_manager' (624e2fd7-3ded-4488-9453-80ad4e35343f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:12:07 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-32de99a6-9598-482a-bbe2-ab006180c4f5 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Created volume successfully. Jul 10 16:12:07 devstack sudo[106044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4e69f4f1-d76e-4766-98c8-1461a43ce95c Jul 10 16:12:07 devstack sudo[106044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:07 devstack sudo[106041]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:07 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-e00aa105-5f74-4530-b24c-e6456d8dc4f3 tempest-CreateVolumesFromSnapshotTest-1937876261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-aa0bcde3-519e-47f8-9f83-baa1d1d7eac3" returned: 0 in 0.793s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:07 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-e00aa105-5f74-4530-b24c-e6456d8dc4f3 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-aa0bcde3-519e-47f8-9f83-baa1d1d7eac3.f7d6a443-ccfa-4e36-a091-4ef7dc684d94 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:07 devstack sudo[106049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-aa0bcde3-519e-47f8-9f83-baa1d1d7eac3.f7d6a443-ccfa-4e36-a091-4ef7dc684d94 Jul 10 16:12:07 devstack sudo[106049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:07 devstack sudo[106044]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:07 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-728c2aab-2c4d-483f-937b-3e7be6dadf10 tempest-CinderUnicodeTest-510159742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4e69f4f1-d76e-4766-98c8-1461a43ce95c" returned: 0 in 0.797s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:07 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-728c2aab-2c4d-483f-937b-3e7be6dadf10 tempest-CinderUnicodeTest-510159742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4e69f4f1-d76e-4766-98c8-1461a43ce95c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4e69f4f1-d76e-4766-98c8-1461a43ce95c.fd619523-8a5b-46df-b96b-4ab55e803c9b 1G {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:07 devstack sudo[106058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4e69f4f1-d76e-4766-98c8-1461a43ce95c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4e69f4f1-d76e-4766-98c8-1461a43ce95c.fd619523-8a5b-46df-b96b-4ab55e803c9b 1G Jul 10 16:12:07 devstack sudo[106058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:07 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-87e48448-81fb-4ec3-a969-bb0616dd7aba tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Acquiring lock "cinder-8b02e5ac-8f0c-420c-8315-52d400efb76f-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:12:07 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-87e48448-81fb-4ec3-a969-bb0616dd7aba tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Lock "cinder-8b02e5ac-8f0c-420c-8315-52d400efb76f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:12:08 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-87e48448-81fb-4ec3-a969-bb0616dd7aba tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Acquiring lock "cinder-quobyte-8b02e5ac-8f0c-420c-8315-52d400efb76f" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:12:08 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-87e48448-81fb-4ec3-a969-bb0616dd7aba tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Lock "cinder-quobyte-8b02e5ac-8f0c-420c-8315-52d400efb76f" acquired by "delete_volume" :: waited 0.017s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:12:08 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[7788b241-5e08-4444-b584-15465a439ac9]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:12:08 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-87e48448-81fb-4ec3-a969-bb0616dd7aba tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-8b02e5ac-8f0c-420c-8315-52d400efb76f {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:08 devstack sudo[106049]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:08 devstack sudo[106061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-8b02e5ac-8f0c-420c-8315-52d400efb76f Jul 10 16:12:08 devstack sudo[106061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:08 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-e00aa105-5f74-4530-b24c-e6456d8dc4f3 tempest-CreateVolumesFromSnapshotTest-1937876261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-aa0bcde3-519e-47f8-9f83-baa1d1d7eac3.f7d6a443-ccfa-4e36-a091-4ef7dc684d94" returned: 0 in 0.876s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:08 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-e00aa105-5f74-4530-b24c-e6456d8dc4f3 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-aa0bcde3-519e-47f8-9f83-baa1d1d7eac3.f7d6a443-ccfa-4e36-a091-4ef7dc684d94 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:08 devstack sudo[106063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-aa0bcde3-519e-47f8-9f83-baa1d1d7eac3.f7d6a443-ccfa-4e36-a091-4ef7dc684d94 Jul 10 16:12:08 devstack sudo[106063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:08 devstack sudo[106058]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:08 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-728c2aab-2c4d-483f-937b-3e7be6dadf10 tempest-CinderUnicodeTest-510159742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4e69f4f1-d76e-4766-98c8-1461a43ce95c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4e69f4f1-d76e-4766-98c8-1461a43ce95c.fd619523-8a5b-46df-b96b-4ab55e803c9b 1G" returned: 0 in 0.911s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:08 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-728c2aab-2c4d-483f-937b-3e7be6dadf10 tempest-CinderUnicodeTest-510159742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e69f4f1-d76e-4766-98c8-1461a43ce95c -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4e69f4f1-d76e-4766-98c8-1461a43ce95c.fd619523-8a5b-46df-b96b-4ab55e803c9b {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:08 devstack sudo[106072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e69f4f1-d76e-4766-98c8-1461a43ce95c -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4e69f4f1-d76e-4766-98c8-1461a43ce95c.fd619523-8a5b-46df-b96b-4ab55e803c9b Jul 10 16:12:08 devstack sudo[106072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:08 devstack sudo[106063]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:08 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-e00aa105-5f74-4530-b24c-e6456d8dc4f3 tempest-CreateVolumesFromSnapshotTest-1937876261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-aa0bcde3-519e-47f8-9f83-baa1d1d7eac3.f7d6a443-ccfa-4e36-a091-4ef7dc684d94" returned: 0 in 0.698s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:08 devstack sudo[106061]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:08 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-87e48448-81fb-4ec3-a969-bb0616dd7aba tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-8b02e5ac-8f0c-420c-8315-52d400efb76f" returned: 0 in 0.849s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:08 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-87e48448-81fb-4ec3-a969-bb0616dd7aba tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-8b02e5ac-8f0c-420c-8315-52d400efb76f {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:08 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-e00aa105-5f74-4530-b24c-e6456d8dc4f3 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Lock "cinder-quobyte-f7d6a443-ccfa-4e36-a091-4ef7dc684d94" released by "_delete_snapshot" :: held 3.293s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:12:08 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-e00aa105-5f74-4530-b24c-e6456d8dc4f3 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Lock "cinder-quobyte-aa0bcde3-519e-47f8-9f83-baa1d1d7eac3" released by "delete_snapshot" :: held 3.330s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:12:08 devstack sudo[106074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-8b02e5ac-8f0c-420c-8315-52d400efb76f Jul 10 16:12:08 devstack sudo[106074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:09 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-e00aa105-5f74-4530-b24c-e6456d8dc4f3 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Created reservations ['e2c957b9-d756-4666-9f47-767990eace38', '5dca1be6-8090-43fb-b96b-25a8e0b1105f', 'c7f7996f-d4e3-43e4-8265-df513b0d257e', '11d0ac05-72cd-4742-afca-c472b7beeabe'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:12:09 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-e00aa105-5f74-4530-b24c-e6456d8dc4f3 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Delete snapshot completed successfully. Jul 10 16:12:09 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-e00aa105-5f74-4530-b24c-e6456d8dc4f3 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Lock "cinder-f7d6a443-ccfa-4e36-a091-4ef7dc684d94-delete_snapshot" released by "delete_snapshot" :: held 3.494s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:12:09 devstack sudo[106072]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:09 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-728c2aab-2c4d-483f-937b-3e7be6dadf10 tempest-CinderUnicodeTest-510159742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e69f4f1-d76e-4766-98c8-1461a43ce95c -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4e69f4f1-d76e-4766-98c8-1461a43ce95c.fd619523-8a5b-46df-b96b-4ab55e803c9b" returned: 0 in 0.753s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:09 devstack sudo[106074]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:09 devstack cinder-volume[87420]: WARNING cinder.volume.drivers.remotefs [None req-728c2aab-2c4d-483f-937b-3e7be6dadf10 tempest-CinderUnicodeTest-510159742 None] /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4e69f4f1-d76e-4766-98c8-1461a43ce95c.fd619523-8a5b-46df-b96b-4ab55e803c9b is being set with open permissions: ugo+rw Jul 10 16:12:09 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-728c2aab-2c4d-483f-937b-3e7be6dadf10 tempest-CinderUnicodeTest-510159742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4e69f4f1-d76e-4766-98c8-1461a43ce95c.fd619523-8a5b-46df-b96b-4ab55e803c9b {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:09 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-87e48448-81fb-4ec3-a969-bb0616dd7aba tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-8b02e5ac-8f0c-420c-8315-52d400efb76f" returned: 0 in 0.669s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:09 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-87e48448-81fb-4ec3-a969-bb0616dd7aba tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Lock "cinder-quobyte-8b02e5ac-8f0c-420c-8315-52d400efb76f" released by "delete_volume" :: held 1.563s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:12:09 devstack sudo[106080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4e69f4f1-d76e-4766-98c8-1461a43ce95c.fd619523-8a5b-46df-b96b-4ab55e803c9b Jul 10 16:12:09 devstack sudo[106080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:09 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-87e48448-81fb-4ec3-a969-bb0616dd7aba tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Created reservations ['4edb6f7d-d630-48fe-9877-2b7020f2a28d', 'a6b9fb08-1101-4d1a-8803-f09dfe721f76', 'f83d8733-a217-483f-ae38-f08e68f45994', '4787da54-ea7e-488c-b4a6-a23dd3fd47ea'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:12:09 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-87e48448-81fb-4ec3-a969-bb0616dd7aba tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:12:09 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-87e48448-81fb-4ec3-a969-bb0616dd7aba tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:12:09 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-87e48448-81fb-4ec3-a969-bb0616dd7aba tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:12:09 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-87e48448-81fb-4ec3-a969-bb0616dd7aba tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:12:09 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-87e48448-81fb-4ec3-a969-bb0616dd7aba tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:12:09 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-87e48448-81fb-4ec3-a969-bb0616dd7aba tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:09 devstack sudo[106082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:12:09 devstack sudo[106082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:09 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-8b4aeab4-ace6-4732-919a-dbb1d504bd97 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Acquiring lock "cinder-aa0bcde3-519e-47f8-9f83-baa1d1d7eac3-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:12:09 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-8b4aeab4-ace6-4732-919a-dbb1d504bd97 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Lock "cinder-aa0bcde3-519e-47f8-9f83-baa1d1d7eac3-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:12:09 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-8b4aeab4-ace6-4732-919a-dbb1d504bd97 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Acquiring lock "cinder-quobyte-aa0bcde3-519e-47f8-9f83-baa1d1d7eac3" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:12:09 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-8b4aeab4-ace6-4732-919a-dbb1d504bd97 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Lock "cinder-quobyte-aa0bcde3-519e-47f8-9f83-baa1d1d7eac3" acquired by "delete_volume" :: waited 0.018s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:12:09 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[019513cd-3e89-437d-995c-cc7b127c2a26]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:12:10 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8b4aeab4-ace6-4732-919a-dbb1d504bd97 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-aa0bcde3-519e-47f8-9f83-baa1d1d7eac3 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:10 devstack sudo[106084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-aa0bcde3-519e-47f8-9f83-baa1d1d7eac3 Jul 10 16:12:10 devstack sudo[106084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:10 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-ff9502ca-6ebf-49b1-9e6b-664df68d83b8 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Acquiring lock "cinder-34c0e44c-0c51-45a7-80c6-bfe8a43d8d14-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:12:10 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-ff9502ca-6ebf-49b1-9e6b-664df68d83b8 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Lock "cinder-34c0e44c-0c51-45a7-80c6-bfe8a43d8d14-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:12:10 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-ff9502ca-6ebf-49b1-9e6b-664df68d83b8 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Acquiring lock "cinder-quobyte-34c0e44c-0c51-45a7-80c6-bfe8a43d8d14" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:12:10 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-ff9502ca-6ebf-49b1-9e6b-664df68d83b8 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Lock "cinder-quobyte-34c0e44c-0c51-45a7-80c6-bfe8a43d8d14" acquired by "delete_volume" :: waited 0.033s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:12:10 devstack sudo[106080]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:10 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-728c2aab-2c4d-483f-937b-3e7be6dadf10 tempest-CinderUnicodeTest-510159742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4e69f4f1-d76e-4766-98c8-1461a43ce95c.fd619523-8a5b-46df-b96b-4ab55e803c9b" returned: 0 in 0.806s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:10 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[562b38e1-0114-4ead-80f0-f9ae1fd7ce0c]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:12:10 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ff9502ca-6ebf-49b1-9e6b-664df68d83b8 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-34c0e44c-0c51-45a7-80c6-bfe8a43d8d14 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:10 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-728c2aab-2c4d-483f-937b-3e7be6dadf10 tempest-CinderUnicodeTest-510159742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4e69f4f1-d76e-4766-98c8-1461a43ce95c.info {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:10 devstack sudo[106089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4e69f4f1-d76e-4766-98c8-1461a43ce95c.info Jul 10 16:12:10 devstack sudo[106089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:10 devstack sudo[106082]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:10 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-87e48448-81fb-4ec3-a969-bb0616dd7aba tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.757s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:10 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-87e48448-81fb-4ec3-a969-bb0616dd7aba tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:12:10 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-87e48448-81fb-4ec3-a969-bb0616dd7aba tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Deleted volume successfully. Jul 10 16:12:10 devstack sudo[106088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-34c0e44c-0c51-45a7-80c6-bfe8a43d8d14 Jul 10 16:12:10 devstack sudo[106088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:10 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-87e48448-81fb-4ec3-a969-bb0616dd7aba tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Lock "cinder-8b02e5ac-8f0c-420c-8315-52d400efb76f-delete_volume" released by "delete_volume" :: held 2.573s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:12:10 devstack sudo[106084]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:10 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8b4aeab4-ace6-4732-919a-dbb1d504bd97 tempest-CreateVolumesFromSnapshotTest-1937876261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-aa0bcde3-519e-47f8-9f83-baa1d1d7eac3" returned: 0 in 0.906s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:10 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8b4aeab4-ace6-4732-919a-dbb1d504bd97 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-aa0bcde3-519e-47f8-9f83-baa1d1d7eac3 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:10 devstack sudo[106095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-aa0bcde3-519e-47f8-9f83-baa1d1d7eac3 Jul 10 16:12:10 devstack sudo[106095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:11 devstack sudo[106089]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:11 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-728c2aab-2c4d-483f-937b-3e7be6dadf10 tempest-CinderUnicodeTest-510159742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4e69f4f1-d76e-4766-98c8-1461a43ce95c.info" returned: 0 in 0.735s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:11 devstack cinder-volume[87420]: WARNING cinder.volume.drivers.remotefs [None req-728c2aab-2c4d-483f-937b-3e7be6dadf10 tempest-CinderUnicodeTest-510159742 None] /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4e69f4f1-d76e-4766-98c8-1461a43ce95c.info is being set with open permissions: ugo+rw Jul 10 16:12:11 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-728c2aab-2c4d-483f-937b-3e7be6dadf10 tempest-CinderUnicodeTest-510159742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4e69f4f1-d76e-4766-98c8-1461a43ce95c.info {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:11 devstack sudo[106101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4e69f4f1-d76e-4766-98c8-1461a43ce95c.info Jul 10 16:12:11 devstack sudo[106101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:11 devstack sudo[106088]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:11 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ff9502ca-6ebf-49b1-9e6b-664df68d83b8 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-34c0e44c-0c51-45a7-80c6-bfe8a43d8d14" returned: 0 in 0.861s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:11 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ff9502ca-6ebf-49b1-9e6b-664df68d83b8 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-34c0e44c-0c51-45a7-80c6-bfe8a43d8d14 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:11 devstack sudo[106103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-34c0e44c-0c51-45a7-80c6-bfe8a43d8d14 Jul 10 16:12:11 devstack sudo[106103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:11 devstack sudo[106095]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:11 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8b4aeab4-ace6-4732-919a-dbb1d504bd97 tempest-CreateVolumesFromSnapshotTest-1937876261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-aa0bcde3-519e-47f8-9f83-baa1d1d7eac3" returned: 0 in 0.654s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:11 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-8b4aeab4-ace6-4732-919a-dbb1d504bd97 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Lock "cinder-quobyte-aa0bcde3-519e-47f8-9f83-baa1d1d7eac3" released by "delete_volume" :: held 1.632s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:12:11 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-8b4aeab4-ace6-4732-919a-dbb1d504bd97 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Created reservations ['9de1f989-8867-413c-98d0-8f09a8986628', '3fd95b47-2649-498c-beb2-4e46d63aed79', 'ce660600-f35e-4f48-9c5a-28f20a880b9f', '4a7371ba-fa5c-466f-b782-baea10db839b'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:12:11 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-8b4aeab4-ace6-4732-919a-dbb1d504bd97 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:12:11 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-8b4aeab4-ace6-4732-919a-dbb1d504bd97 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:12:11 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-8b4aeab4-ace6-4732-919a-dbb1d504bd97 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:12:11 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-8b4aeab4-ace6-4732-919a-dbb1d504bd97 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:12:11 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-8b4aeab4-ace6-4732-919a-dbb1d504bd97 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:12:11 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8b4aeab4-ace6-4732-919a-dbb1d504bd97 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:11 devstack sudo[106106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:12:11 devstack sudo[106106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:11 devstack sudo[106101]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:11 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-728c2aab-2c4d-483f-937b-3e7be6dadf10 tempest-CinderUnicodeTest-510159742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4e69f4f1-d76e-4766-98c8-1461a43ce95c.info" returned: 0 in 0.653s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:11 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-728c2aab-2c4d-483f-937b-3e7be6dadf10 tempest-CinderUnicodeTest-510159742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.803s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:12:11 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-728c2aab-2c4d-483f-937b-3e7be6dadf10 tempest-CinderUnicodeTest-510159742 None] Create snapshot completed successfully Jul 10 16:12:12 devstack sudo[106103]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:12 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ff9502ca-6ebf-49b1-9e6b-664df68d83b8 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-34c0e44c-0c51-45a7-80c6-bfe8a43d8d14" returned: 0 in 0.739s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:12 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-ff9502ca-6ebf-49b1-9e6b-664df68d83b8 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Lock "cinder-quobyte-34c0e44c-0c51-45a7-80c6-bfe8a43d8d14" released by "delete_volume" :: held 1.660s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:12:12 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-ff9502ca-6ebf-49b1-9e6b-664df68d83b8 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Created reservations ['98e06c42-432a-4a9b-b4e7-b53f8d662eae', 'ab560fe6-1880-4674-b4b6-d9671a93cc0c', 'fb970203-c9f1-4b0e-a3c9-960c1928d4d7', '0bdf0b92-e047-4755-a939-0e94f58fa758'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:12:12 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-ff9502ca-6ebf-49b1-9e6b-664df68d83b8 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:12:12 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-ff9502ca-6ebf-49b1-9e6b-664df68d83b8 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:12:12 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-ff9502ca-6ebf-49b1-9e6b-664df68d83b8 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:12:12 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-ff9502ca-6ebf-49b1-9e6b-664df68d83b8 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:12:12 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-ff9502ca-6ebf-49b1-9e6b-664df68d83b8 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:12:12 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ff9502ca-6ebf-49b1-9e6b-664df68d83b8 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:12 devstack sudo[106110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:12:12 devstack sudo[106110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:12 devstack sudo[106106]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:12 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8b4aeab4-ace6-4732-919a-dbb1d504bd97 tempest-CreateVolumesFromSnapshotTest-1937876261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.698s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:12 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-8b4aeab4-ace6-4732-919a-dbb1d504bd97 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:12:12 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-8b4aeab4-ace6-4732-919a-dbb1d504bd97 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Deleted volume successfully. Jul 10 16:12:12 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-8b4aeab4-ace6-4732-919a-dbb1d504bd97 tempest-CreateVolumesFromSnapshotTest-1937876261 None] Lock "cinder-aa0bcde3-519e-47f8-9f83-baa1d1d7eac3-delete_volume" released by "delete_volume" :: held 2.562s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:12:12 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-4eb2b047-5873-47b1-8128-559cd41cbce5 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Acquiring lock "cinder-49d4e4b3-ab2c-4f1f-95a7-eba79843f659-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:12:12 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-4eb2b047-5873-47b1-8128-559cd41cbce5 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Lock "cinder-49d4e4b3-ab2c-4f1f-95a7-eba79843f659-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:12:12 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-4eb2b047-5873-47b1-8128-559cd41cbce5 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Acquiring lock "cinder-quobyte-49d4e4b3-ab2c-4f1f-95a7-eba79843f659" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:12:12 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-4eb2b047-5873-47b1-8128-559cd41cbce5 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Lock "cinder-quobyte-49d4e4b3-ab2c-4f1f-95a7-eba79843f659" acquired by "delete_volume" :: waited 0.019s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:12:12 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c48dabb-bae3-4997-ba84-a5431a6409f2]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:12:12 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4eb2b047-5873-47b1-8128-559cd41cbce5 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-49d4e4b3-ab2c-4f1f-95a7-eba79843f659 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:12 devstack sudo[106113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-49d4e4b3-ab2c-4f1f-95a7-eba79843f659 Jul 10 16:12:12 devstack sudo[106113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:12 devstack sudo[106110]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:12 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ff9502ca-6ebf-49b1-9e6b-664df68d83b8 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.740s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:12 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-ff9502ca-6ebf-49b1-9e6b-664df68d83b8 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:12:12 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-ff9502ca-6ebf-49b1-9e6b-664df68d83b8 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Deleted volume successfully. Jul 10 16:12:12 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-ff9502ca-6ebf-49b1-9e6b-664df68d83b8 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Lock "cinder-34c0e44c-0c51-45a7-80c6-bfe8a43d8d14-delete_volume" released by "delete_volume" :: held 2.654s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:12:12 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-8dcc1ec3-9b77-44a5-bdab-19cd082fb7fe tempest-CinderUnicodeTest-510159742 None] Acquiring lock "cinder-fd619523-8a5b-46df-b96b-4ab55e803c9b-delete_snapshot" by "delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:12:13 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-8dcc1ec3-9b77-44a5-bdab-19cd082fb7fe tempest-CinderUnicodeTest-510159742 None] Lock "cinder-fd619523-8a5b-46df-b96b-4ab55e803c9b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:12:13 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-8dcc1ec3-9b77-44a5-bdab-19cd082fb7fe tempest-CinderUnicodeTest-510159742 None] Acquiring lock "cinder-quobyte-4e69f4f1-d76e-4766-98c8-1461a43ce95c" by "delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:12:13 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-8dcc1ec3-9b77-44a5-bdab-19cd082fb7fe tempest-CinderUnicodeTest-510159742 None] Lock "cinder-quobyte-4e69f4f1-d76e-4766-98c8-1461a43ce95c" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:12:13 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-8dcc1ec3-9b77-44a5-bdab-19cd082fb7fe tempest-CinderUnicodeTest-510159742 None] Acquiring lock "cinder-quobyte-fd619523-8a5b-46df-b96b-4ab55e803c9b" by "_delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:12:13 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-8dcc1ec3-9b77-44a5-bdab-19cd082fb7fe tempest-CinderUnicodeTest-510159742 None] Lock "cinder-quobyte-fd619523-8a5b-46df-b96b-4ab55e803c9b" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:12:13 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-8dcc1ec3-9b77-44a5-bdab-19cd082fb7fe tempest-CinderUnicodeTest-510159742 None] Deleting offline snapshot fd619523-8a5b-46df-b96b-4ab55e803c9b of volume 4e69f4f1-d76e-4766-98c8-1461a43ce95c {{(pid=87420) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 16:12:13 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-8dcc1ec3-9b77-44a5-bdab-19cd082fb7fe tempest-CinderUnicodeTest-510159742 None] snapshot_file for this snap is: volume-4e69f4f1-d76e-4766-98c8-1461a43ce95c.fd619523-8a5b-46df-b96b-4ab55e803c9b {{(pid=87420) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 16:12:13 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[4370f119-9a34-433a-895c-b09d0bbe1e69]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:12:13 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8dcc1ec3-9b77-44a5-bdab-19cd082fb7fe tempest-CinderUnicodeTest-510159742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4e69f4f1-d76e-4766-98c8-1461a43ce95c.fd619523-8a5b-46df-b96b-4ab55e803c9b {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:13 devstack sudo[106116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4e69f4f1-d76e-4766-98c8-1461a43ce95c.fd619523-8a5b-46df-b96b-4ab55e803c9b Jul 10 16:12:13 devstack sudo[106116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:13 devstack sudo[106113]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:13 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4eb2b047-5873-47b1-8128-559cd41cbce5 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-49d4e4b3-ab2c-4f1f-95a7-eba79843f659" returned: 0 in 0.891s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:13 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4eb2b047-5873-47b1-8128-559cd41cbce5 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-49d4e4b3-ab2c-4f1f-95a7-eba79843f659 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:13 devstack sudo[106121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-49d4e4b3-ab2c-4f1f-95a7-eba79843f659 Jul 10 16:12:13 devstack sudo[106121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:13 devstack sudo[106116]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:13 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8dcc1ec3-9b77-44a5-bdab-19cd082fb7fe tempest-CinderUnicodeTest-510159742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4e69f4f1-d76e-4766-98c8-1461a43ce95c.fd619523-8a5b-46df-b96b-4ab55e803c9b" returned: 0 in 0.832s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:13 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-8dcc1ec3-9b77-44a5-bdab-19cd082fb7fe tempest-CinderUnicodeTest-510159742 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e69f4f1-d76e-4766-98c8-1461a43ce95c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87420) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 16:12:13 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[d995af8d-09f6-4c49-8864-9fd2217f2622]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:12:13 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8dcc1ec3-9b77-44a5-bdab-19cd082fb7fe tempest-CinderUnicodeTest-510159742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4e69f4f1-d76e-4766-98c8-1461a43ce95c {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:14 devstack sudo[106128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4e69f4f1-d76e-4766-98c8-1461a43ce95c Jul 10 16:12:14 devstack sudo[106128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:14 devstack sudo[106121]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:14 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4eb2b047-5873-47b1-8128-559cd41cbce5 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-49d4e4b3-ab2c-4f1f-95a7-eba79843f659" returned: 0 in 0.695s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:14 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-4eb2b047-5873-47b1-8128-559cd41cbce5 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Lock "cinder-quobyte-49d4e4b3-ab2c-4f1f-95a7-eba79843f659" released by "delete_volume" :: held 1.644s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:12:14 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-4eb2b047-5873-47b1-8128-559cd41cbce5 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Created reservations ['20b7e279-f7c4-47ea-93c7-936494b939b8', '416b3481-c3f4-4dde-9eb5-fb760ccfe8a4', '3186f57a-224e-4dc2-ac59-d3bbb4215c1a', '2141c1a9-b008-415e-a1a2-ae45425881bc'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:12:14 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-4eb2b047-5873-47b1-8128-559cd41cbce5 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:12:14 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-4eb2b047-5873-47b1-8128-559cd41cbce5 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:12:14 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-4eb2b047-5873-47b1-8128-559cd41cbce5 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:12:14 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-4eb2b047-5873-47b1-8128-559cd41cbce5 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:12:14 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-4eb2b047-5873-47b1-8128-559cd41cbce5 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:12:14 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4eb2b047-5873-47b1-8128-559cd41cbce5 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:14 devstack sudo[106131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:12:14 devstack sudo[106131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:14 devstack sudo[106128]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:14 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8dcc1ec3-9b77-44a5-bdab-19cd082fb7fe tempest-CinderUnicodeTest-510159742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4e69f4f1-d76e-4766-98c8-1461a43ce95c" returned: 0 in 0.835s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:14 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8dcc1ec3-9b77-44a5-bdab-19cd082fb7fe tempest-CinderUnicodeTest-510159742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4e69f4f1-d76e-4766-98c8-1461a43ce95c.fd619523-8a5b-46df-b96b-4ab55e803c9b {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:14 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-8e7bab46-95fe-4ebf-99e1-690d32913c64 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Acquiring lock "cinder-834fd1c1-6b79-4484-b996-7f1f8487471b-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:12:14 devstack sudo[106136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4e69f4f1-d76e-4766-98c8-1461a43ce95c.fd619523-8a5b-46df-b96b-4ab55e803c9b Jul 10 16:12:14 devstack sudo[106136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:14 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-8e7bab46-95fe-4ebf-99e1-690d32913c64 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Lock "cinder-834fd1c1-6b79-4484-b996-7f1f8487471b-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:12:14 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-8e7bab46-95fe-4ebf-99e1-690d32913c64 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Acquiring lock "cinder-quobyte-834fd1c1-6b79-4484-b996-7f1f8487471b" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:12:14 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-8e7bab46-95fe-4ebf-99e1-690d32913c64 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Lock "cinder-quobyte-834fd1c1-6b79-4484-b996-7f1f8487471b" acquired by "delete_volume" :: waited 0.018s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:12:14 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[a050ba11-b872-4535-851b-f7c066124251]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:12:14 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8e7bab46-95fe-4ebf-99e1-690d32913c64 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-834fd1c1-6b79-4484-b996-7f1f8487471b {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:15 devstack sudo[106138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-834fd1c1-6b79-4484-b996-7f1f8487471b Jul 10 16:12:15 devstack sudo[106138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:15 devstack sudo[106131]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:15 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4eb2b047-5873-47b1-8128-559cd41cbce5 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.766s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:15 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-4eb2b047-5873-47b1-8128-559cd41cbce5 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:12:15 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-4eb2b047-5873-47b1-8128-559cd41cbce5 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Deleted volume successfully. Jul 10 16:12:15 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-4eb2b047-5873-47b1-8128-559cd41cbce5 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Lock "cinder-49d4e4b3-ab2c-4f1f-95a7-eba79843f659-delete_volume" released by "delete_volume" :: held 2.630s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:12:15 devstack sudo[106136]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:15 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8dcc1ec3-9b77-44a5-bdab-19cd082fb7fe tempest-CinderUnicodeTest-510159742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4e69f4f1-d76e-4766-98c8-1461a43ce95c.fd619523-8a5b-46df-b96b-4ab55e803c9b" returned: 0 in 0.879s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:15 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8dcc1ec3-9b77-44a5-bdab-19cd082fb7fe tempest-CinderUnicodeTest-510159742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4e69f4f1-d76e-4766-98c8-1461a43ce95c.fd619523-8a5b-46df-b96b-4ab55e803c9b {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:15 devstack sudo[106146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4e69f4f1-d76e-4766-98c8-1461a43ce95c.fd619523-8a5b-46df-b96b-4ab55e803c9b Jul 10 16:12:15 devstack sudo[106146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:15 devstack sudo[106138]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:15 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8e7bab46-95fe-4ebf-99e1-690d32913c64 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-834fd1c1-6b79-4484-b996-7f1f8487471b" returned: 0 in 0.855s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:15 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8e7bab46-95fe-4ebf-99e1-690d32913c64 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-834fd1c1-6b79-4484-b996-7f1f8487471b {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:15 devstack sudo[106149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-834fd1c1-6b79-4484-b996-7f1f8487471b Jul 10 16:12:15 devstack sudo[106149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:16 devstack sudo[106146]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:16 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8dcc1ec3-9b77-44a5-bdab-19cd082fb7fe tempest-CinderUnicodeTest-510159742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4e69f4f1-d76e-4766-98c8-1461a43ce95c.fd619523-8a5b-46df-b96b-4ab55e803c9b" returned: 0 in 0.673s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:16 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-8dcc1ec3-9b77-44a5-bdab-19cd082fb7fe tempest-CinderUnicodeTest-510159742 None] Lock "cinder-quobyte-fd619523-8a5b-46df-b96b-4ab55e803c9b" released by "_delete_snapshot" :: held 3.365s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:12:16 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-8dcc1ec3-9b77-44a5-bdab-19cd082fb7fe tempest-CinderUnicodeTest-510159742 None] Lock "cinder-quobyte-4e69f4f1-d76e-4766-98c8-1461a43ce95c" released by "delete_snapshot" :: held 3.393s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:12:16 devstack sudo[106149]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:16 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8e7bab46-95fe-4ebf-99e1-690d32913c64 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-834fd1c1-6b79-4484-b996-7f1f8487471b" returned: 0 in 0.668s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:16 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-8dcc1ec3-9b77-44a5-bdab-19cd082fb7fe tempest-CinderUnicodeTest-510159742 None] Created reservations ['aa96de39-c3bd-4815-b2f2-4a035091481b', '7b394818-afd2-4cb1-8ce4-756a710d24e8', '2f5882f8-a6e3-4670-adce-e531371bf7ae', '9b9bbc8e-3f4f-4b74-b068-1bffe9fa7589'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:12:16 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-8e7bab46-95fe-4ebf-99e1-690d32913c64 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Lock "cinder-quobyte-834fd1c1-6b79-4484-b996-7f1f8487471b" released by "delete_volume" :: held 1.578s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:12:16 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-8dcc1ec3-9b77-44a5-bdab-19cd082fb7fe tempest-CinderUnicodeTest-510159742 None] Delete snapshot completed successfully. Jul 10 16:12:16 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-8dcc1ec3-9b77-44a5-bdab-19cd082fb7fe tempest-CinderUnicodeTest-510159742 None] Lock "cinder-fd619523-8a5b-46df-b96b-4ab55e803c9b-delete_snapshot" released by "delete_snapshot" :: held 3.569s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:12:16 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-8e7bab46-95fe-4ebf-99e1-690d32913c64 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Created reservations ['94fcad1c-6e61-4dba-a91d-e5736119f2ab', '15467cec-5c69-476d-808e-9ac8f824ace8', '3a218739-b8d1-4880-8d2d-fe9a95b9a415', 'fcde95ce-e9cb-4707-95ba-37abdb0f7a1e'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:12:16 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-8e7bab46-95fe-4ebf-99e1-690d32913c64 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:12:16 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-8e7bab46-95fe-4ebf-99e1-690d32913c64 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:12:16 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-8e7bab46-95fe-4ebf-99e1-690d32913c64 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:12:16 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-8e7bab46-95fe-4ebf-99e1-690d32913c64 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:12:16 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-8e7bab46-95fe-4ebf-99e1-690d32913c64 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:12:16 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8e7bab46-95fe-4ebf-99e1-690d32913c64 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:16 devstack sudo[106153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:12:16 devstack sudo[106153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:17 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-dabbd04e-4e24-4074-806d-ffc8ceb58fb7 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Acquiring lock "cinder-4a8ead46-5842-4383-86ea-5aea89503f62-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:12:17 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-dabbd04e-4e24-4074-806d-ffc8ceb58fb7 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Lock "cinder-4a8ead46-5842-4383-86ea-5aea89503f62-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:12:17 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-dabbd04e-4e24-4074-806d-ffc8ceb58fb7 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Acquiring lock "cinder-quobyte-4a8ead46-5842-4383-86ea-5aea89503f62" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:12:17 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-dabbd04e-4e24-4074-806d-ffc8ceb58fb7 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Lock "cinder-quobyte-4a8ead46-5842-4383-86ea-5aea89503f62" acquired by "delete_volume" :: waited 0.027s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:12:17 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b8f10f-671e-4393-bf02-e3dcc91d75af]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:12:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-dabbd04e-4e24-4074-806d-ffc8ceb58fb7 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4a8ead46-5842-4383-86ea-5aea89503f62 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:17 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-bd0e7cc4-a9f2-4699-a584-160cb8545226 tempest-CinderUnicodeTest-510159742 None] Acquiring lock "cinder-4e69f4f1-d76e-4766-98c8-1461a43ce95c-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:12:17 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-bd0e7cc4-a9f2-4699-a584-160cb8545226 tempest-CinderUnicodeTest-510159742 None] Lock "cinder-4e69f4f1-d76e-4766-98c8-1461a43ce95c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:12:17 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-bd0e7cc4-a9f2-4699-a584-160cb8545226 tempest-CinderUnicodeTest-510159742 None] Acquiring lock "cinder-quobyte-4e69f4f1-d76e-4766-98c8-1461a43ce95c" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:12:17 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-bd0e7cc4-a9f2-4699-a584-160cb8545226 tempest-CinderUnicodeTest-510159742 None] Lock "cinder-quobyte-4e69f4f1-d76e-4766-98c8-1461a43ce95c" acquired by "delete_volume" :: waited 0.020s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:12:17 devstack sudo[106155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4a8ead46-5842-4383-86ea-5aea89503f62 Jul 10 16:12:17 devstack sudo[106155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:17 devstack sudo[106153]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:17 devstack cinder-volume[87420]: DEBUG oslo_service.periodic_task [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87420) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 16:12:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:12:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:12:17 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:12:17 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:12:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:12:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:17 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[c79f36c3-ede4-46e0-9b7e-8ab601681c53]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:12:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-bd0e7cc4-a9f2-4699-a584-160cb8545226 tempest-CinderUnicodeTest-510159742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4e69f4f1-d76e-4766-98c8-1461a43ce95c {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8e7bab46-95fe-4ebf-99e1-690d32913c64 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.830s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:17 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-8e7bab46-95fe-4ebf-99e1-690d32913c64 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:12:17 devstack sudo[106158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:12:17 devstack sudo[106158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:17 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-8e7bab46-95fe-4ebf-99e1-690d32913c64 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Deleted volume successfully. Jul 10 16:12:17 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-8e7bab46-95fe-4ebf-99e1-690d32913c64 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Lock "cinder-834fd1c1-6b79-4484-b996-7f1f8487471b-delete_volume" released by "delete_volume" :: held 2.646s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:12:17 devstack sudo[106159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4e69f4f1-d76e-4766-98c8-1461a43ce95c Jul 10 16:12:17 devstack sudo[106159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:18 devstack sudo[106158]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.788s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:18 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:12:18 devstack sudo[106155]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:18 devstack cinder-volume[87420]: DEBUG oslo_service.periodic_task [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Running periodic task VolumeManager._thread_info {{(pid=87420) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 16:12:18 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] thread count: 29 {{(pid=87420) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 16:12:18 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] thread info: [<_MainThread(MainThread, started 133639250378880)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87420) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 16:12:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-dabbd04e-4e24-4074-806d-ffc8ceb58fb7 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4a8ead46-5842-4383-86ea-5aea89503f62" returned: 0 in 1.015s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-dabbd04e-4e24-4074-806d-ffc8ceb58fb7 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4a8ead46-5842-4383-86ea-5aea89503f62 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:18 devstack sudo[106169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4a8ead46-5842-4383-86ea-5aea89503f62 Jul 10 16:12:18 devstack sudo[106169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:18 devstack sudo[106159]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-bd0e7cc4-a9f2-4699-a584-160cb8545226 tempest-CinderUnicodeTest-510159742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4e69f4f1-d76e-4766-98c8-1461a43ce95c" returned: 0 in 0.931s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-bd0e7cc4-a9f2-4699-a584-160cb8545226 tempest-CinderUnicodeTest-510159742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4e69f4f1-d76e-4766-98c8-1461a43ce95c {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:18 devstack sudo[106172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4e69f4f1-d76e-4766-98c8-1461a43ce95c Jul 10 16:12:18 devstack sudo[106172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:19 devstack sudo[106169]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:19 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-dabbd04e-4e24-4074-806d-ffc8ceb58fb7 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4a8ead46-5842-4383-86ea-5aea89503f62" returned: 0 in 0.748s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:19 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-dabbd04e-4e24-4074-806d-ffc8ceb58fb7 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Lock "cinder-quobyte-4a8ead46-5842-4383-86ea-5aea89503f62" released by "delete_volume" :: held 1.837s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:12:19 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-dabbd04e-4e24-4074-806d-ffc8ceb58fb7 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Created reservations ['480be67f-3411-441a-abfd-bf83e4931564', '6e0adf37-873f-461d-af31-20d564aa316c', '379f9188-39c1-4a21-bd7e-2e59f03a1e59', '786742ff-1a4f-40dd-be98-ab9bffaa1351'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:12:19 devstack sudo[106172]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:19 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-bd0e7cc4-a9f2-4699-a584-160cb8545226 tempest-CinderUnicodeTest-510159742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-4e69f4f1-d76e-4766-98c8-1461a43ce95c" returned: 0 in 0.712s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:19 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-bd0e7cc4-a9f2-4699-a584-160cb8545226 tempest-CinderUnicodeTest-510159742 None] Lock "cinder-quobyte-4e69f4f1-d76e-4766-98c8-1461a43ce95c" released by "delete_volume" :: held 1.724s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:12:19 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-dabbd04e-4e24-4074-806d-ffc8ceb58fb7 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:12:19 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-dabbd04e-4e24-4074-806d-ffc8ceb58fb7 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:12:19 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-dabbd04e-4e24-4074-806d-ffc8ceb58fb7 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:12:19 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-dabbd04e-4e24-4074-806d-ffc8ceb58fb7 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:12:19 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-dabbd04e-4e24-4074-806d-ffc8ceb58fb7 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:12:19 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-dabbd04e-4e24-4074-806d-ffc8ceb58fb7 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:19 devstack sudo[106176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:12:19 devstack sudo[106176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:19 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-bd0e7cc4-a9f2-4699-a584-160cb8545226 tempest-CinderUnicodeTest-510159742 None] Created reservations ['7e7c5ebc-4695-44a5-a394-c67e6fec34b8', '0d4b09a2-4e12-4eb6-adb7-f39cc0faa832', '1ecb1bc9-5498-4c02-b534-642e95d36c0a', 'd37711f6-8d8a-40f2-ba45-d258cb1ce5de'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:12:19 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-bd0e7cc4-a9f2-4699-a584-160cb8545226 tempest-CinderUnicodeTest-510159742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:12:19 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-bd0e7cc4-a9f2-4699-a584-160cb8545226 tempest-CinderUnicodeTest-510159742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:12:19 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-bd0e7cc4-a9f2-4699-a584-160cb8545226 tempest-CinderUnicodeTest-510159742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:12:19 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-bd0e7cc4-a9f2-4699-a584-160cb8545226 tempest-CinderUnicodeTest-510159742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:12:19 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-bd0e7cc4-a9f2-4699-a584-160cb8545226 tempest-CinderUnicodeTest-510159742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:12:19 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-bd0e7cc4-a9f2-4699-a584-160cb8545226 tempest-CinderUnicodeTest-510159742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:19 devstack sudo[106178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:12:19 devstack sudo[106178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:19 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-20099fde-5429-4460-9dfb-fefe032e0462 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Acquiring lock "cinder-5a207383-7c1f-48da-84fa-3b3e9a6f1c91-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:12:19 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-20099fde-5429-4460-9dfb-fefe032e0462 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Lock "cinder-5a207383-7c1f-48da-84fa-3b3e9a6f1c91-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:12:19 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-20099fde-5429-4460-9dfb-fefe032e0462 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Acquiring lock "cinder-quobyte-5a207383-7c1f-48da-84fa-3b3e9a6f1c91" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:12:19 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-20099fde-5429-4460-9dfb-fefe032e0462 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Lock "cinder-quobyte-5a207383-7c1f-48da-84fa-3b3e9a6f1c91" acquired by "delete_volume" :: waited 0.020s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:12:19 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[07d6f205-cfde-491c-ba2b-053724b8ed26]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:12:19 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-20099fde-5429-4460-9dfb-fefe032e0462 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-5a207383-7c1f-48da-84fa-3b3e9a6f1c91 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:19 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-2a37efc7-4d60-4ed1-b20e-c91828d9383a tempest-CinderUnicodeTest-510159742 None] Acquiring lock "cinder-e1ac23fc-9417-4458-810a-9bc959af620c-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:12:19 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-2a37efc7-4d60-4ed1-b20e-c91828d9383a tempest-CinderUnicodeTest-510159742 None] Lock "cinder-e1ac23fc-9417-4458-810a-9bc959af620c-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:12:19 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-2a37efc7-4d60-4ed1-b20e-c91828d9383a tempest-CinderUnicodeTest-510159742 None] Acquiring lock "cinder-quobyte-e1ac23fc-9417-4458-810a-9bc959af620c" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:12:19 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-2a37efc7-4d60-4ed1-b20e-c91828d9383a tempest-CinderUnicodeTest-510159742 None] Lock "cinder-quobyte-e1ac23fc-9417-4458-810a-9bc959af620c" acquired by "delete_volume" :: waited 0.020s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:12:19 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[e101d520-dbdb-4bc4-ae8b-955e3ac2b8ed]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:12:19 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-2a37efc7-4d60-4ed1-b20e-c91828d9383a tempest-CinderUnicodeTest-510159742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-e1ac23fc-9417-4458-810a-9bc959af620c {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:19 devstack sudo[106180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-5a207383-7c1f-48da-84fa-3b3e9a6f1c91 Jul 10 16:12:19 devstack sudo[106180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:19 devstack sudo[106181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-e1ac23fc-9417-4458-810a-9bc959af620c Jul 10 16:12:19 devstack sudo[106181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:20 devstack sudo[106176]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:20 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-dabbd04e-4e24-4074-806d-ffc8ceb58fb7 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.906s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:20 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-dabbd04e-4e24-4074-806d-ffc8ceb58fb7 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:12:20 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-dabbd04e-4e24-4074-806d-ffc8ceb58fb7 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Deleted volume successfully. Jul 10 16:12:20 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-dabbd04e-4e24-4074-806d-ffc8ceb58fb7 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Lock "cinder-4a8ead46-5842-4383-86ea-5aea89503f62-delete_volume" released by "delete_volume" :: held 3.036s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:12:20 devstack sudo[106178]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:20 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-bd0e7cc4-a9f2-4699-a584-160cb8545226 tempest-CinderUnicodeTest-510159742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.879s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:20 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-bd0e7cc4-a9f2-4699-a584-160cb8545226 tempest-CinderUnicodeTest-510159742 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:12:20 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-bd0e7cc4-a9f2-4699-a584-160cb8545226 tempest-CinderUnicodeTest-510159742 None] Deleted volume successfully. Jul 10 16:12:20 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-bd0e7cc4-a9f2-4699-a584-160cb8545226 tempest-CinderUnicodeTest-510159742 None] Lock "cinder-4e69f4f1-d76e-4766-98c8-1461a43ce95c-delete_volume" released by "delete_volume" :: held 2.915s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:12:20 devstack sudo[106180]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:20 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-20099fde-5429-4460-9dfb-fefe032e0462 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-5a207383-7c1f-48da-84fa-3b3e9a6f1c91" returned: 0 in 1.013s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:20 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-20099fde-5429-4460-9dfb-fefe032e0462 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-5a207383-7c1f-48da-84fa-3b3e9a6f1c91 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:20 devstack sudo[106192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-5a207383-7c1f-48da-84fa-3b3e9a6f1c91 Jul 10 16:12:20 devstack sudo[106192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:20 devstack sudo[106181]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:20 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-2a37efc7-4d60-4ed1-b20e-c91828d9383a tempest-CinderUnicodeTest-510159742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-e1ac23fc-9417-4458-810a-9bc959af620c" returned: 0 in 0.913s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:20 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-2a37efc7-4d60-4ed1-b20e-c91828d9383a tempest-CinderUnicodeTest-510159742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-e1ac23fc-9417-4458-810a-9bc959af620c {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:20 devstack sudo[106194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-e1ac23fc-9417-4458-810a-9bc959af620c Jul 10 16:12:20 devstack sudo[106194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:21 devstack sudo[106192]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:21 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-20099fde-5429-4460-9dfb-fefe032e0462 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-5a207383-7c1f-48da-84fa-3b3e9a6f1c91" returned: 0 in 0.715s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:21 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-20099fde-5429-4460-9dfb-fefe032e0462 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Lock "cinder-quobyte-5a207383-7c1f-48da-84fa-3b3e9a6f1c91" released by "delete_volume" :: held 1.779s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:12:21 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-20099fde-5429-4460-9dfb-fefe032e0462 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Created reservations ['19b948e5-c265-446e-8397-ecf6b464a9d8', 'fea1baf7-275d-42ed-98b0-0744ac6ff778', '3a26781f-64ed-4ac4-ad76-cb54421dd91e', 'c7c4d76f-5d82-4178-b40a-ad161aae374b'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:12:21 devstack sudo[106194]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:21 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-2a37efc7-4d60-4ed1-b20e-c91828d9383a tempest-CinderUnicodeTest-510159742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-e1ac23fc-9417-4458-810a-9bc959af620c" returned: 0 in 0.732s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:21 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-2a37efc7-4d60-4ed1-b20e-c91828d9383a tempest-CinderUnicodeTest-510159742 None] Lock "cinder-quobyte-e1ac23fc-9417-4458-810a-9bc959af620c" released by "delete_volume" :: held 1.694s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:12:21 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce54ecc0-4452-4d4c-acec-5c3ae1ce3033 tempest-ProjectMemberTests-968602289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 16:12:21 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ce54ecc0-4452-4d4c-acec-5c3ae1ce3033 tempest-ProjectMemberTests-968602289 None] Flow 'volume_create_manager' (4f51cb52-4a43-4c79-8136-5f3605df9e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:12:21 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ce54ecc0-4452-4d4c-acec-5c3ae1ce3033 tempest-ProjectMemberTests-968602289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d30d358-160a-4a7a-aacf-9c69eb21104a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:12:21 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ce54ecc0-4452-4d4c-acec-5c3ae1ce3033 tempest-ProjectMemberTests-968602289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d30d358-160a-4a7a-aacf-9c69eb21104a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:12:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-484798159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a60fdf14-c826-4e66-bed9-893e00a8f249,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a62b0a8c6e6a4e9a9b6772e9c7ee6af3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:12:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:12:21Z,use_quota=True,user_id='1a439b56b94841c39eb4e94d953ccde8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:12:21 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ce54ecc0-4452-4d4c-acec-5c3ae1ce3033 tempest-ProjectMemberTests-968602289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c603442-5c92-4828-aee5-fddd37bf770a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:12:21 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ce54ecc0-4452-4d4c-acec-5c3ae1ce3033 tempest-ProjectMemberTests-968602289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c603442-5c92-4828-aee5-fddd37bf770a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:12:21 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ce54ecc0-4452-4d4c-acec-5c3ae1ce3033 tempest-ProjectMemberTests-968602289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bfed26b-75c5-4439-94ed-4feecfe04d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:12:21 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ce54ecc0-4452-4d4c-acec-5c3ae1ce3033 tempest-ProjectMemberTests-968602289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bfed26b-75c5-4439-94ed-4feecfe04d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a60fdf14-c826-4e66-bed9-893e00a8f249', 'volume_name': 'volume-a60fdf14-c826-4e66-bed9-893e00a8f249', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:12:21 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ce54ecc0-4452-4d4c-acec-5c3ae1ce3033 tempest-ProjectMemberTests-968602289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5c04842-7446-45c9-babe-7d3bd79453c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:12:21 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ce54ecc0-4452-4d4c-acec-5c3ae1ce3033 tempest-ProjectMemberTests-968602289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5c04842-7446-45c9-babe-7d3bd79453c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:12:21 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ce54ecc0-4452-4d4c-acec-5c3ae1ce3033 tempest-ProjectMemberTests-968602289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (896d0e58-4dd1-46c2-a19a-e3b1e1206f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:12:21 devstack sudo[106200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a60fdf14-c826-4e66-bed9-893e00a8f249 1073741824 Jul 10 16:12:21 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-ce54ecc0-4452-4d4c-acec-5c3ae1ce3033 tempest-ProjectMemberTests-968602289 None] Volume a60fdf14-c826-4e66-bed9-893e00a8f249: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a60fdf14-c826-4e66-bed9-893e00a8f249', 'volume_size': 1} Jul 10 16:12:21 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-ce54ecc0-4452-4d4c-acec-5c3ae1ce3033 tempest-ProjectMemberTests-968602289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:12:21 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-ce54ecc0-4452-4d4c-acec-5c3ae1ce3033 tempest-ProjectMemberTests-968602289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:12:21 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-ce54ecc0-4452-4d4c-acec-5c3ae1ce3033 tempest-ProjectMemberTests-968602289 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:12:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-484798159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a60fdf14-c826-4e66-bed9-893e00a8f249,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a62b0a8c6e6a4e9a9b6772e9c7ee6af3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:12:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:12:21Z,use_quota=True,user_id='1a439b56b94841c39eb4e94d953ccde8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 16:12:21 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-ce54ecc0-4452-4d4c-acec-5c3ae1ce3033 tempest-ProjectMemberTests-968602289 None] Creating volume a60fdf14-c826-4e66-bed9-893e00a8f249 {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 16:12:21 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-ce54ecc0-4452-4d4c-acec-5c3ae1ce3033 tempest-ProjectMemberTests-968602289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:12:21 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-ce54ecc0-4452-4d4c-acec-5c3ae1ce3033 tempest-ProjectMemberTests-968602289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:12:21 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-ce54ecc0-4452-4d4c-acec-5c3ae1ce3033 tempest-ProjectMemberTests-968602289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:12:21 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-ce54ecc0-4452-4d4c-acec-5c3ae1ce3033 tempest-ProjectMemberTests-968602289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:12:21 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-ce54ecc0-4452-4d4c-acec-5c3ae1ce3033 tempest-ProjectMemberTests-968602289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:12:21 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-ce54ecc0-4452-4d4c-acec-5c3ae1ce3033 tempest-ProjectMemberTests-968602289 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 16:12:21 devstack sudo[106200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:21 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-ce54ecc0-4452-4d4c-acec-5c3ae1ce3033 tempest-ProjectMemberTests-968602289 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 16:12:21 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ce54ecc0-4452-4d4c-acec-5c3ae1ce3033 tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a60fdf14-c826-4e66-bed9-893e00a8f249 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:21 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-20099fde-5429-4460-9dfb-fefe032e0462 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:12:21 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-20099fde-5429-4460-9dfb-fefe032e0462 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:12:21 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-20099fde-5429-4460-9dfb-fefe032e0462 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:12:21 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-20099fde-5429-4460-9dfb-fefe032e0462 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:12:21 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-20099fde-5429-4460-9dfb-fefe032e0462 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:12:21 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-20099fde-5429-4460-9dfb-fefe032e0462 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:21 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-2a37efc7-4d60-4ed1-b20e-c91828d9383a tempest-CinderUnicodeTest-510159742 None] Created reservations ['127aad31-f0af-4491-bc60-70ac94a163ab', '7448b7fd-ec70-4ee9-afc6-44c6dff9b994', 'f788bfba-4671-4f19-b45a-f4d574726cb4', '4055eaa8-f0a0-435f-a14d-1dc66944cc92'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:12:21 devstack sudo[106202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:12:21 devstack sudo[106202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:21 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-2a37efc7-4d60-4ed1-b20e-c91828d9383a tempest-CinderUnicodeTest-510159742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:12:21 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-2a37efc7-4d60-4ed1-b20e-c91828d9383a tempest-CinderUnicodeTest-510159742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:12:21 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-2a37efc7-4d60-4ed1-b20e-c91828d9383a tempest-CinderUnicodeTest-510159742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:12:21 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-2a37efc7-4d60-4ed1-b20e-c91828d9383a tempest-CinderUnicodeTest-510159742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:12:21 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-2a37efc7-4d60-4ed1-b20e-c91828d9383a tempest-CinderUnicodeTest-510159742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:12:21 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-2a37efc7-4d60-4ed1-b20e-c91828d9383a tempest-CinderUnicodeTest-510159742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:21 devstack sudo[106205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:12:21 devstack sudo[106205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:22 devstack sudo[106202]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:22 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-20099fde-5429-4460-9dfb-fefe032e0462 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 1.064s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:22 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-20099fde-5429-4460-9dfb-fefe032e0462 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:12:22 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-20099fde-5429-4460-9dfb-fefe032e0462 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Deleted volume successfully. Jul 10 16:12:22 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-20099fde-5429-4460-9dfb-fefe032e0462 tempest-CreateVolumesFromSourceVolumeTest-1851496206 None] Lock "cinder-5a207383-7c1f-48da-84fa-3b3e9a6f1c91-delete_volume" released by "delete_volume" :: held 3.259s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:12:22 devstack sudo[106205]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:22 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-2a37efc7-4d60-4ed1-b20e-c91828d9383a tempest-CinderUnicodeTest-510159742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.945s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:22 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-2a37efc7-4d60-4ed1-b20e-c91828d9383a tempest-CinderUnicodeTest-510159742 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:12:22 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-2a37efc7-4d60-4ed1-b20e-c91828d9383a tempest-CinderUnicodeTest-510159742 None] Deleted volume successfully. Jul 10 16:12:22 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-2a37efc7-4d60-4ed1-b20e-c91828d9383a tempest-CinderUnicodeTest-510159742 None] Lock "cinder-e1ac23fc-9417-4458-810a-9bc959af620c-delete_volume" released by "delete_volume" :: held 3.133s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:12:22 devstack sudo[106200]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:22 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ce54ecc0-4452-4d4c-acec-5c3ae1ce3033 tempest-ProjectMemberTests-968602289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a60fdf14-c826-4e66-bed9-893e00a8f249 1073741824" returned: 0 in 1.325s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:22 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ce54ecc0-4452-4d4c-acec-5c3ae1ce3033 tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a60fdf14-c826-4e66-bed9-893e00a8f249 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:22 devstack sudo[106214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a60fdf14-c826-4e66-bed9-893e00a8f249 Jul 10 16:12:22 devstack sudo[106214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:23 devstack sudo[106214]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:23 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ce54ecc0-4452-4d4c-acec-5c3ae1ce3033 tempest-ProjectMemberTests-968602289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a60fdf14-c826-4e66-bed9-893e00a8f249" returned: 0 in 0.875s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:23 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-ce54ecc0-4452-4d4c-acec-5c3ae1ce3033 tempest-ProjectMemberTests-968602289 None] <== create_volume: return (2264ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 16:12:23 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-ce54ecc0-4452-4d4c-acec-5c3ae1ce3033 tempest-ProjectMemberTests-968602289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.266s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:12:23 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ce54ecc0-4452-4d4c-acec-5c3ae1ce3033 tempest-ProjectMemberTests-968602289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (896d0e58-4dd1-46c2-a19a-e3b1e1206f9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a60fdf14-c826-4e66-bed9-893e00a8f249', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:12:23 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ce54ecc0-4452-4d4c-acec-5c3ae1ce3033 tempest-ProjectMemberTests-968602289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cf095c4-e282-4fe1-8ab6-6ad73e0adec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:12:23 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-ce54ecc0-4452-4d4c-acec-5c3ae1ce3033 tempest-ProjectMemberTests-968602289 None] Volume volume-a60fdf14-c826-4e66-bed9-893e00a8f249 (a60fdf14-c826-4e66-bed9-893e00a8f249): created successfully Jul 10 16:12:23 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ce54ecc0-4452-4d4c-acec-5c3ae1ce3033 tempest-ProjectMemberTests-968602289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cf095c4-e282-4fe1-8ab6-6ad73e0adec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:12:23 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ce54ecc0-4452-4d4c-acec-5c3ae1ce3033 tempest-ProjectMemberTests-968602289 None] Flow 'volume_create_manager' (4f51cb52-4a43-4c79-8136-5f3605df9e2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:12:23 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-ce54ecc0-4452-4d4c-acec-5c3ae1ce3033 tempest-ProjectMemberTests-968602289 None] Created volume successfully. Jul 10 16:12:25 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-8d62a11e-0c69-4e26-81ca-a915c4cd1a23 tempest-ProjectMemberTests-968602289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:12:25 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-8d62a11e-0c69-4e26-81ca-a915c4cd1a23 tempest-ProjectMemberTests-968602289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:12:25 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-8d62a11e-0c69-4e26-81ca-a915c4cd1a23 tempest-ProjectMemberTests-968602289 None] Creating offline snapshot 8d19f975-2ae5-43b5-aa1f-1bf19c94397a of volume a60fdf14-c826-4e66-bed9-893e00a8f249 {{(pid=87420) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 16:12:25 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[7944c738-0244-4dbe-9866-599e11cebc9c]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:12:25 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8d62a11e-0c69-4e26-81ca-a915c4cd1a23 tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a60fdf14-c826-4e66-bed9-893e00a8f249 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:25 devstack sudo[106220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a60fdf14-c826-4e66-bed9-893e00a8f249 Jul 10 16:12:25 devstack sudo[106220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:26 devstack sudo[106220]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:26 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8d62a11e-0c69-4e26-81ca-a915c4cd1a23 tempest-ProjectMemberTests-968602289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a60fdf14-c826-4e66-bed9-893e00a8f249" returned: 0 in 0.798s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:26 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8d62a11e-0c69-4e26-81ca-a915c4cd1a23 tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a60fdf14-c826-4e66-bed9-893e00a8f249,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a60fdf14-c826-4e66-bed9-893e00a8f249.8d19f975-2ae5-43b5-aa1f-1bf19c94397a 1G {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:26 devstack sudo[106226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a60fdf14-c826-4e66-bed9-893e00a8f249,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a60fdf14-c826-4e66-bed9-893e00a8f249.8d19f975-2ae5-43b5-aa1f-1bf19c94397a 1G Jul 10 16:12:26 devstack sudo[106226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:26 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-84bdc126-6adb-443c-b4c6-f4448274a91c tempest-ProjectAdminTests-1640986520 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577095031738, 'free_capacity_gb': 1775.7577095031738, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87420) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 10 16:12:26 devstack sudo[106226]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:26 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8d62a11e-0c69-4e26-81ca-a915c4cd1a23 tempest-ProjectMemberTests-968602289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a60fdf14-c826-4e66-bed9-893e00a8f249,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a60fdf14-c826-4e66-bed9-893e00a8f249.8d19f975-2ae5-43b5-aa1f-1bf19c94397a 1G" returned: 0 in 0.851s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:26 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8d62a11e-0c69-4e26-81ca-a915c4cd1a23 tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a60fdf14-c826-4e66-bed9-893e00a8f249 -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a60fdf14-c826-4e66-bed9-893e00a8f249.8d19f975-2ae5-43b5-aa1f-1bf19c94397a {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:26 devstack sudo[106232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a60fdf14-c826-4e66-bed9-893e00a8f249 -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a60fdf14-c826-4e66-bed9-893e00a8f249.8d19f975-2ae5-43b5-aa1f-1bf19c94397a Jul 10 16:12:26 devstack sudo[106232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:27 devstack sudo[106232]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:27 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8d62a11e-0c69-4e26-81ca-a915c4cd1a23 tempest-ProjectMemberTests-968602289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a60fdf14-c826-4e66-bed9-893e00a8f249 -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a60fdf14-c826-4e66-bed9-893e00a8f249.8d19f975-2ae5-43b5-aa1f-1bf19c94397a" returned: 0 in 0.754s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:27 devstack cinder-volume[87420]: WARNING cinder.volume.drivers.remotefs [None req-8d62a11e-0c69-4e26-81ca-a915c4cd1a23 tempest-ProjectMemberTests-968602289 None] /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a60fdf14-c826-4e66-bed9-893e00a8f249.8d19f975-2ae5-43b5-aa1f-1bf19c94397a is being set with open permissions: ugo+rw Jul 10 16:12:27 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8d62a11e-0c69-4e26-81ca-a915c4cd1a23 tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a60fdf14-c826-4e66-bed9-893e00a8f249.8d19f975-2ae5-43b5-aa1f-1bf19c94397a {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:27 devstack sudo[106237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a60fdf14-c826-4e66-bed9-893e00a8f249.8d19f975-2ae5-43b5-aa1f-1bf19c94397a Jul 10 16:12:27 devstack sudo[106237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:27 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-586d5338-2b37-4166-8d73-0d8cb34f1be0 tempest-VolumeImageDependencyTests-764993224 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 16:12:27 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-586d5338-2b37-4166-8d73-0d8cb34f1be0 tempest-VolumeImageDependencyTests-764993224 None] Flow 'volume_create_manager' (cc36ad5f-f404-46bb-bda1-7f5557249b87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:12:27 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-586d5338-2b37-4166-8d73-0d8cb34f1be0 tempest-VolumeImageDependencyTests-764993224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f710561-bb3f-476f-a506-bd73c47ae083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:12:27 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-586d5338-2b37-4166-8d73-0d8cb34f1be0 tempest-VolumeImageDependencyTests-764993224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f710561-bb3f-476f-a506-bd73c47ae083) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:12:27Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71a2c01d-3d36-4cfd-884c-b6a76ae8e620,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2d510b424e342aa94f0fdeb1476de40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:12:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:12:28Z,use_quota=True,user_id='af771fb8d474429aa467015c6ecea376',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:12:27 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-586d5338-2b37-4166-8d73-0d8cb34f1be0 tempest-VolumeImageDependencyTests-764993224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a513a5e-3d6b-4a1d-a1e4-ff2d71a1df9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:12:27 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-586d5338-2b37-4166-8d73-0d8cb34f1be0 tempest-VolumeImageDependencyTests-764993224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a513a5e-3d6b-4a1d-a1e4-ff2d71a1df9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:12:27 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-586d5338-2b37-4166-8d73-0d8cb34f1be0 tempest-VolumeImageDependencyTests-764993224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c69b91c-8344-43ff-b36e-81cc070a3271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:12:27 devstack cinder-volume[87420]: DEBUG cinder.image.glance [None req-586d5338-2b37-4166-8d73-0d8cb34f1be0 tempest-VolumeImageDependencyTests-764993224 None] Creating Keystone auth plugin from conf {{(pid=87420) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 10 16:12:28 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-586d5338-2b37-4166-8d73-0d8cb34f1be0 tempest-VolumeImageDependencyTests-764993224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c69b91c-8344-43ff-b36e-81cc070a3271) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '71a2c01d-3d36-4cfd-884c-b6a76ae8e620', 'volume_name': 'volume-71a2c01d-3d36-4cfd-884c-b6a76ae8e620', 'volume_size': 1, 'image_id': '61f98a8d-a904-44b3-b073-46765439cae2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/61f98a8d-a904-44b3-b073-46765439cae2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'bef5d0f1c666fcd59e1c6f22e6bdc9c3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f2d510b424e342aa94f0fdeb1476de40', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '718366038995c9bcff7f5b77dbffbed4682e7f10b7faa1168263da20427556bc9c674a0ad86fb2d915c5991c5b71d70357aa0334c582382c4e38b2f774cc1ca8', 'id': '61f98a8d-a904-44b3-b073-46765439cae2', 'created_at': datetime.datetime(2026, 7, 10, 14, 12, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 14, 12, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/61f98a8d-a904-44b3-b073-46765439cae2/file', 'properties': {}}, 'image_service': }' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:12:28 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-586d5338-2b37-4166-8d73-0d8cb34f1be0 tempest-VolumeImageDependencyTests-764993224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e9e969e-cc1c-431f-99be-053829763a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:12:28 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-586d5338-2b37-4166-8d73-0d8cb34f1be0 tempest-VolumeImageDependencyTests-764993224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e9e969e-cc1c-431f-99be-053829763a46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:12:28 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-586d5338-2b37-4166-8d73-0d8cb34f1be0 tempest-VolumeImageDependencyTests-764993224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e27b38d7-70b2-4639-8f09-0ce5aee59833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:12:28 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-586d5338-2b37-4166-8d73-0d8cb34f1be0 tempest-VolumeImageDependencyTests-764993224 None] Volume 71a2c01d-3d36-4cfd-884c-b6a76ae8e620: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-71a2c01d-3d36-4cfd-884c-b6a76ae8e620', 'volume_size': 1, 'image_id': '61f98a8d-a904-44b3-b073-46765439cae2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/61f98a8d-a904-44b3-b073-46765439cae2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'bef5d0f1c666fcd59e1c6f22e6bdc9c3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f2d510b424e342aa94f0fdeb1476de40', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '718366038995c9bcff7f5b77dbffbed4682e7f10b7faa1168263da20427556bc9c674a0ad86fb2d915c5991c5b71d70357aa0334c582382c4e38b2f774cc1ca8', 'id': '61f98a8d-a904-44b3-b073-46765439cae2', 'created_at': datetime.datetime(2026, 7, 10, 14, 12, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 14, 12, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/61f98a8d-a904-44b3-b073-46765439cae2/file', 'properties': {}}, 'image_service': } Jul 10 16:12:28 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-586d5338-2b37-4166-8d73-0d8cb34f1be0 tempest-VolumeImageDependencyTests-764993224 None] Trying to clone 71a2c01d-3d36-4cfd-884c-b6a76ae8e620 from image 61f98a8d-a904-44b3-b073-46765439cae2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/61f98a8d-a904-44b3-b073-46765439cae2', 'metadata': {}}]). {{(pid=87420) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 10 16:12:28 devstack cinder-volume[87420]: DEBUG cinder.image.image_utils [None req-586d5338-2b37-4166-8d73-0d8cb34f1be0 tempest-VolumeImageDependencyTests-764993224 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_61f98a8d-a904-44b3-b073-46765439cae2_ds38huvpdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87420) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 10 16:12:28 devstack cinder-volume[87420]: INFO cinder.image.image_utils [None req-586d5338-2b37-4166-8d73-0d8cb34f1be0 tempest-VolumeImageDependencyTests-764993224 None] Image download 0.00 MB at 0.00 MB/s Jul 10 16:12:28 devstack sudo[106237]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:28 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8d62a11e-0c69-4e26-81ca-a915c4cd1a23 tempest-ProjectMemberTests-968602289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a60fdf14-c826-4e66-bed9-893e00a8f249.8d19f975-2ae5-43b5-aa1f-1bf19c94397a" returned: 0 in 0.715s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:28 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8d62a11e-0c69-4e26-81ca-a915c4cd1a23 tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a60fdf14-c826-4e66-bed9-893e00a8f249.info {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:28 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b8d89ca-7d15-4fb9-8917-4e16a0489cfa]: (4, 'raw') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:12:28 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-586d5338-2b37-4166-8d73-0d8cb34f1be0 tempest-VolumeImageDependencyTests-764993224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_61f98a8d-a904-44b3-b073-46765439cae2_ds38huvpdevstack@QuobyteHD {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:28 devstack sudo[106240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a60fdf14-c826-4e66-bed9-893e00a8f249.info Jul 10 16:12:28 devstack sudo[106240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:28 devstack sudo[106241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_61f98a8d-a904-44b3-b073-46765439cae2_ds38huvpdevstack@QuobyteHD Jul 10 16:12:28 devstack sudo[106241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:29 devstack sudo[106240]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:29 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8d62a11e-0c69-4e26-81ca-a915c4cd1a23 tempest-ProjectMemberTests-968602289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a60fdf14-c826-4e66-bed9-893e00a8f249.info" returned: 0 in 0.713s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:29 devstack cinder-volume[87420]: WARNING cinder.volume.drivers.remotefs [None req-8d62a11e-0c69-4e26-81ca-a915c4cd1a23 tempest-ProjectMemberTests-968602289 None] /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a60fdf14-c826-4e66-bed9-893e00a8f249.info is being set with open permissions: ugo+rw Jul 10 16:12:29 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8d62a11e-0c69-4e26-81ca-a915c4cd1a23 tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a60fdf14-c826-4e66-bed9-893e00a8f249.info {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:29 devstack sudo[106247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a60fdf14-c826-4e66-bed9-893e00a8f249.info Jul 10 16:12:29 devstack sudo[106247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:29 devstack sudo[106241]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:29 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-586d5338-2b37-4166-8d73-0d8cb34f1be0 tempest-VolumeImageDependencyTests-764993224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_61f98a8d-a904-44b3-b073-46765439cae2_ds38huvpdevstack@QuobyteHD" returned: 0 in 0.773s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:29 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-586d5338-2b37-4166-8d73-0d8cb34f1be0 tempest-VolumeImageDependencyTests-764993224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_61f98a8d-a904-44b3-b073-46765439cae2_ds38huvpdevstack@QuobyteHD {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:29 devstack sudo[106249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_61f98a8d-a904-44b3-b073-46765439cae2_ds38huvpdevstack@QuobyteHD Jul 10 16:12:29 devstack sudo[106249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:29 devstack sudo[106247]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:29 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8d62a11e-0c69-4e26-81ca-a915c4cd1a23 tempest-ProjectMemberTests-968602289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a60fdf14-c826-4e66-bed9-893e00a8f249.info" returned: 0 in 0.673s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:29 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-8d62a11e-0c69-4e26-81ca-a915c4cd1a23 tempest-ProjectMemberTests-968602289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.621s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:12:29 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-8d62a11e-0c69-4e26-81ca-a915c4cd1a23 tempest-ProjectMemberTests-968602289 None] Create snapshot completed successfully Jul 10 16:12:29 devstack sudo[106249]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:29 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-586d5338-2b37-4166-8d73-0d8cb34f1be0 tempest-VolumeImageDependencyTests-764993224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_61f98a8d-a904-44b3-b073-46765439cae2_ds38huvpdevstack@QuobyteHD" returned: 1 in 0.751s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:29 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-586d5338-2b37-4166-8d73-0d8cb34f1be0 tempest-VolumeImageDependencyTests-764993224 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_61f98a8d-a904-44b3-b073-46765439cae2_ds38huvpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 16:12:29 devstack cinder-volume[87420]: DEBUG cinder.image.image_utils [None req-586d5338-2b37-4166-8d73-0d8cb34f1be0 tempest-VolumeImageDependencyTests-764993224 None] Temporary image 61f98a8d-a904-44b3-b073-46765439cae2 is fetched for user af771fb8d474429aa467015c6ecea376. {{(pid=87420) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 10 16:12:30 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[da4846d9-f2db-4198-969f-cfaa3a05c9b1]: (4, 'raw') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:12:30 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-586d5338-2b37-4166-8d73-0d8cb34f1be0 tempest-VolumeImageDependencyTests-764993224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_61f98a8d-a904-44b3-b073-46765439cae2_ds38huvpdevstack@QuobyteHD {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:30 devstack sudo[106255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_61f98a8d-a904-44b3-b073-46765439cae2_ds38huvpdevstack@QuobyteHD Jul 10 16:12:30 devstack sudo[106255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:30 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-28f32f0d-5eaa-4a07-8fc9-52ba872e63d1 tempest-ProjectMemberTests-968602289 None] Acquiring lock "cinder-8d19f975-2ae5-43b5-aa1f-1bf19c94397a-delete_snapshot" by "delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:12:30 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-28f32f0d-5eaa-4a07-8fc9-52ba872e63d1 tempest-ProjectMemberTests-968602289 None] Lock "cinder-8d19f975-2ae5-43b5-aa1f-1bf19c94397a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:12:30 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-28f32f0d-5eaa-4a07-8fc9-52ba872e63d1 tempest-ProjectMemberTests-968602289 None] Acquiring lock "cinder-quobyte-a60fdf14-c826-4e66-bed9-893e00a8f249" by "delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:12:30 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-28f32f0d-5eaa-4a07-8fc9-52ba872e63d1 tempest-ProjectMemberTests-968602289 None] Lock "cinder-quobyte-a60fdf14-c826-4e66-bed9-893e00a8f249" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:12:30 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-28f32f0d-5eaa-4a07-8fc9-52ba872e63d1 tempest-ProjectMemberTests-968602289 None] Acquiring lock "cinder-quobyte-8d19f975-2ae5-43b5-aa1f-1bf19c94397a" by "_delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:12:30 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-28f32f0d-5eaa-4a07-8fc9-52ba872e63d1 tempest-ProjectMemberTests-968602289 None] Lock "cinder-quobyte-8d19f975-2ae5-43b5-aa1f-1bf19c94397a" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:12:30 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-28f32f0d-5eaa-4a07-8fc9-52ba872e63d1 tempest-ProjectMemberTests-968602289 None] Deleting offline snapshot 8d19f975-2ae5-43b5-aa1f-1bf19c94397a of volume a60fdf14-c826-4e66-bed9-893e00a8f249 {{(pid=87420) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 16:12:30 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-28f32f0d-5eaa-4a07-8fc9-52ba872e63d1 tempest-ProjectMemberTests-968602289 None] snapshot_file for this snap is: volume-a60fdf14-c826-4e66-bed9-893e00a8f249.8d19f975-2ae5-43b5-aa1f-1bf19c94397a {{(pid=87420) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 16:12:30 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[635462aa-1fdd-4ae1-b9b8-198aa4f72a45]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:12:30 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-28f32f0d-5eaa-4a07-8fc9-52ba872e63d1 tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a60fdf14-c826-4e66-bed9-893e00a8f249.8d19f975-2ae5-43b5-aa1f-1bf19c94397a {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:30 devstack sudo[106257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a60fdf14-c826-4e66-bed9-893e00a8f249.8d19f975-2ae5-43b5-aa1f-1bf19c94397a Jul 10 16:12:30 devstack sudo[106257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:30 devstack sudo[106255]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:30 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-586d5338-2b37-4166-8d73-0d8cb34f1be0 tempest-VolumeImageDependencyTests-764993224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_61f98a8d-a904-44b3-b073-46765439cae2_ds38huvpdevstack@QuobyteHD" returned: 0 in 0.814s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:30 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-586d5338-2b37-4166-8d73-0d8cb34f1be0 tempest-VolumeImageDependencyTests-764993224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_61f98a8d-a904-44b3-b073-46765439cae2_ds38huvpdevstack@QuobyteHD {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:30 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc6c4a5d-d532-4d9a-bbc9-9773fbb8f304 tempest-ProjectReaderTests-19712737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 16:12:30 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-dc6c4a5d-d532-4d9a-bbc9-9773fbb8f304 tempest-ProjectReaderTests-19712737 None] Flow 'volume_create_manager' (c4fc8a8a-ce5d-4b9c-8324-e628b3260885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:12:30 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-dc6c4a5d-d532-4d9a-bbc9-9773fbb8f304 tempest-ProjectReaderTests-19712737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef8f45e6-e380-4741-82a1-5f115e11e07f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:12:30 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-dc6c4a5d-d532-4d9a-bbc9-9773fbb8f304 tempest-ProjectReaderTests-19712737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef8f45e6-e380-4741-82a1-5f115e11e07f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:12:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-737724855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1786e0be-5f73-4e0f-b8b2-ad3fa474e017,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3216e7ae39094a2295e8ea00806db82b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:12:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:12:31Z,use_quota=True,user_id='52679baac65041bb9ce548ee3dd7269c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:12:30 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-dc6c4a5d-d532-4d9a-bbc9-9773fbb8f304 tempest-ProjectReaderTests-19712737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd2fb8df-dc60-41db-be3f-85aede38e10f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:12:30 devstack sudo[106261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_61f98a8d-a904-44b3-b073-46765439cae2_ds38huvpdevstack@QuobyteHD Jul 10 16:12:30 devstack sudo[106261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:30 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-dc6c4a5d-d532-4d9a-bbc9-9773fbb8f304 tempest-ProjectReaderTests-19712737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd2fb8df-dc60-41db-be3f-85aede38e10f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:12:30 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-dc6c4a5d-d532-4d9a-bbc9-9773fbb8f304 tempest-ProjectReaderTests-19712737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75d15e50-2392-482f-a912-954a08db0ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:12:30 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-dc6c4a5d-d532-4d9a-bbc9-9773fbb8f304 tempest-ProjectReaderTests-19712737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75d15e50-2392-482f-a912-954a08db0ec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1786e0be-5f73-4e0f-b8b2-ad3fa474e017', 'volume_name': 'volume-1786e0be-5f73-4e0f-b8b2-ad3fa474e017', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:12:30 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-dc6c4a5d-d532-4d9a-bbc9-9773fbb8f304 tempest-ProjectReaderTests-19712737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a612be3-9c0f-4889-bb73-888dc9487eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:12:30 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-dc6c4a5d-d532-4d9a-bbc9-9773fbb8f304 tempest-ProjectReaderTests-19712737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a612be3-9c0f-4889-bb73-888dc9487eeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:12:30 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-dc6c4a5d-d532-4d9a-bbc9-9773fbb8f304 tempest-ProjectReaderTests-19712737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27c9b7c1-b327-45c4-b142-2cc61aa56a0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:12:30 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-dc6c4a5d-d532-4d9a-bbc9-9773fbb8f304 tempest-ProjectReaderTests-19712737 None] Volume 1786e0be-5f73-4e0f-b8b2-ad3fa474e017: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1786e0be-5f73-4e0f-b8b2-ad3fa474e017', 'volume_size': 1} Jul 10 16:12:30 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-dc6c4a5d-d532-4d9a-bbc9-9773fbb8f304 tempest-ProjectReaderTests-19712737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:12:30 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-dc6c4a5d-d532-4d9a-bbc9-9773fbb8f304 tempest-ProjectReaderTests-19712737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:12:30 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-dc6c4a5d-d532-4d9a-bbc9-9773fbb8f304 tempest-ProjectReaderTests-19712737 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:12:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-737724855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1786e0be-5f73-4e0f-b8b2-ad3fa474e017,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3216e7ae39094a2295e8ea00806db82b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:12:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:12:31Z,use_quota=True,user_id='52679baac65041bb9ce548ee3dd7269c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 16:12:30 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-dc6c4a5d-d532-4d9a-bbc9-9773fbb8f304 tempest-ProjectReaderTests-19712737 None] Creating volume 1786e0be-5f73-4e0f-b8b2-ad3fa474e017 {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 16:12:30 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-dc6c4a5d-d532-4d9a-bbc9-9773fbb8f304 tempest-ProjectReaderTests-19712737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:12:30 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-dc6c4a5d-d532-4d9a-bbc9-9773fbb8f304 tempest-ProjectReaderTests-19712737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:12:30 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-dc6c4a5d-d532-4d9a-bbc9-9773fbb8f304 tempest-ProjectReaderTests-19712737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:12:30 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-dc6c4a5d-d532-4d9a-bbc9-9773fbb8f304 tempest-ProjectReaderTests-19712737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:12:30 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-dc6c4a5d-d532-4d9a-bbc9-9773fbb8f304 tempest-ProjectReaderTests-19712737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:12:30 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-dc6c4a5d-d532-4d9a-bbc9-9773fbb8f304 tempest-ProjectReaderTests-19712737 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 16:12:30 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-dc6c4a5d-d532-4d9a-bbc9-9773fbb8f304 tempest-ProjectReaderTests-19712737 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 16:12:30 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-dc6c4a5d-d532-4d9a-bbc9-9773fbb8f304 tempest-ProjectReaderTests-19712737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1786e0be-5f73-4e0f-b8b2-ad3fa474e017 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:31 devstack sudo[106263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1786e0be-5f73-4e0f-b8b2-ad3fa474e017 1073741824 Jul 10 16:12:31 devstack sudo[106263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:31 devstack sudo[106257]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:31 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-28f32f0d-5eaa-4a07-8fc9-52ba872e63d1 tempest-ProjectMemberTests-968602289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a60fdf14-c826-4e66-bed9-893e00a8f249.8d19f975-2ae5-43b5-aa1f-1bf19c94397a" returned: 0 in 0.840s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:31 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-28f32f0d-5eaa-4a07-8fc9-52ba872e63d1 tempest-ProjectMemberTests-968602289 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a60fdf14-c826-4e66-bed9-893e00a8f249(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87420) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 16:12:31 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b175cea-714a-40b1-b90c-e505b283d605]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:12:31 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-28f32f0d-5eaa-4a07-8fc9-52ba872e63d1 tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a60fdf14-c826-4e66-bed9-893e00a8f249 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:31 devstack sudo[106268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a60fdf14-c826-4e66-bed9-893e00a8f249 Jul 10 16:12:31 devstack sudo[106268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:31 devstack sudo[106261]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:31 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-586d5338-2b37-4166-8d73-0d8cb34f1be0 tempest-VolumeImageDependencyTests-764993224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_61f98a8d-a904-44b3-b073-46765439cae2_ds38huvpdevstack@QuobyteHD" returned: 1 in 0.747s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:31 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-586d5338-2b37-4166-8d73-0d8cb34f1be0 tempest-VolumeImageDependencyTests-764993224 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_61f98a8d-a904-44b3-b073-46765439cae2_ds38huvpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 16:12:31 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-586d5338-2b37-4166-8d73-0d8cb34f1be0 tempest-VolumeImageDependencyTests-764993224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:12:31 devstack sudo[106263]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:31 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-dc6c4a5d-d532-4d9a-bbc9-9773fbb8f304 tempest-ProjectReaderTests-19712737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1786e0be-5f73-4e0f-b8b2-ad3fa474e017 1073741824" returned: 0 in 0.861s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:31 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-dc6c4a5d-d532-4d9a-bbc9-9773fbb8f304 tempest-ProjectReaderTests-19712737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1786e0be-5f73-4e0f-b8b2-ad3fa474e017 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:31 devstack sudo[106276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1786e0be-5f73-4e0f-b8b2-ad3fa474e017 Jul 10 16:12:31 devstack sudo[106276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:32 devstack sudo[106268]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:32 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-28f32f0d-5eaa-4a07-8fc9-52ba872e63d1 tempest-ProjectMemberTests-968602289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a60fdf14-c826-4e66-bed9-893e00a8f249" returned: 0 in 0.787s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:32 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-28f32f0d-5eaa-4a07-8fc9-52ba872e63d1 tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a60fdf14-c826-4e66-bed9-893e00a8f249.8d19f975-2ae5-43b5-aa1f-1bf19c94397a {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:32 devstack sudo[106282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a60fdf14-c826-4e66-bed9-893e00a8f249.8d19f975-2ae5-43b5-aa1f-1bf19c94397a Jul 10 16:12:32 devstack sudo[106282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:32 devstack sudo[106276]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:32 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-dc6c4a5d-d532-4d9a-bbc9-9773fbb8f304 tempest-ProjectReaderTests-19712737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1786e0be-5f73-4e0f-b8b2-ad3fa474e017" returned: 0 in 0.642s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:32 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-dc6c4a5d-d532-4d9a-bbc9-9773fbb8f304 tempest-ProjectReaderTests-19712737 None] <== create_volume: return (1549ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 16:12:32 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-dc6c4a5d-d532-4d9a-bbc9-9773fbb8f304 tempest-ProjectReaderTests-19712737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.552s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:12:32 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-586d5338-2b37-4166-8d73-0d8cb34f1be0 tempest-VolumeImageDependencyTests-764993224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.954s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:12:32 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-586d5338-2b37-4166-8d73-0d8cb34f1be0 tempest-VolumeImageDependencyTests-764993224 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:12:27Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71a2c01d-3d36-4cfd-884c-b6a76ae8e620,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2d510b424e342aa94f0fdeb1476de40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:12:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:12:28Z,use_quota=True,user_id='af771fb8d474429aa467015c6ecea376',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 16:12:32 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-586d5338-2b37-4166-8d73-0d8cb34f1be0 tempest-VolumeImageDependencyTests-764993224 None] Creating volume 71a2c01d-3d36-4cfd-884c-b6a76ae8e620 {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 16:12:32 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-586d5338-2b37-4166-8d73-0d8cb34f1be0 tempest-VolumeImageDependencyTests-764993224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:12:32 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-586d5338-2b37-4166-8d73-0d8cb34f1be0 tempest-VolumeImageDependencyTests-764993224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:12:32 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-586d5338-2b37-4166-8d73-0d8cb34f1be0 tempest-VolumeImageDependencyTests-764993224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:12:32 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-586d5338-2b37-4166-8d73-0d8cb34f1be0 tempest-VolumeImageDependencyTests-764993224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:12:32 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-586d5338-2b37-4166-8d73-0d8cb34f1be0 tempest-VolumeImageDependencyTests-764993224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:12:32 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-586d5338-2b37-4166-8d73-0d8cb34f1be0 tempest-VolumeImageDependencyTests-764993224 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 16:12:32 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-586d5338-2b37-4166-8d73-0d8cb34f1be0 tempest-VolumeImageDependencyTests-764993224 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 16:12:32 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-586d5338-2b37-4166-8d73-0d8cb34f1be0 tempest-VolumeImageDependencyTests-764993224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-71a2c01d-3d36-4cfd-884c-b6a76ae8e620 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:32 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-dc6c4a5d-d532-4d9a-bbc9-9773fbb8f304 tempest-ProjectReaderTests-19712737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27c9b7c1-b327-45c4-b142-2cc61aa56a0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1786e0be-5f73-4e0f-b8b2-ad3fa474e017', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:12:32 devstack sudo[106285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-71a2c01d-3d36-4cfd-884c-b6a76ae8e620 1073741824 Jul 10 16:12:32 devstack sudo[106285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:32 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-dc6c4a5d-d532-4d9a-bbc9-9773fbb8f304 tempest-ProjectReaderTests-19712737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (063181e1-3b7c-4952-9326-97dafcd982e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:12:32 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-dc6c4a5d-d532-4d9a-bbc9-9773fbb8f304 tempest-ProjectReaderTests-19712737 None] Volume volume-1786e0be-5f73-4e0f-b8b2-ad3fa474e017 (1786e0be-5f73-4e0f-b8b2-ad3fa474e017): created successfully Jul 10 16:12:32 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-dc6c4a5d-d532-4d9a-bbc9-9773fbb8f304 tempest-ProjectReaderTests-19712737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (063181e1-3b7c-4952-9326-97dafcd982e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:12:32 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-dc6c4a5d-d532-4d9a-bbc9-9773fbb8f304 tempest-ProjectReaderTests-19712737 None] Flow 'volume_create_manager' (c4fc8a8a-ce5d-4b9c-8324-e628b3260885) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:12:32 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-dc6c4a5d-d532-4d9a-bbc9-9773fbb8f304 tempest-ProjectReaderTests-19712737 None] Created volume successfully. Jul 10 16:12:32 devstack sudo[106282]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:32 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-28f32f0d-5eaa-4a07-8fc9-52ba872e63d1 tempest-ProjectMemberTests-968602289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a60fdf14-c826-4e66-bed9-893e00a8f249.8d19f975-2ae5-43b5-aa1f-1bf19c94397a" returned: 0 in 0.750s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:32 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-28f32f0d-5eaa-4a07-8fc9-52ba872e63d1 tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a60fdf14-c826-4e66-bed9-893e00a8f249.8d19f975-2ae5-43b5-aa1f-1bf19c94397a {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:32 devstack sudo[106290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a60fdf14-c826-4e66-bed9-893e00a8f249.8d19f975-2ae5-43b5-aa1f-1bf19c94397a Jul 10 16:12:32 devstack sudo[106290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:33 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-40515a30-ef08-44f2-8d5a-d307a0272ad2 tempest-ProjectReaderTests-19712737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:12:33 devstack sudo[106285]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:33 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-586d5338-2b37-4166-8d73-0d8cb34f1be0 tempest-VolumeImageDependencyTests-764993224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-71a2c01d-3d36-4cfd-884c-b6a76ae8e620 1073741824" returned: 0 in 0.834s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:33 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-586d5338-2b37-4166-8d73-0d8cb34f1be0 tempest-VolumeImageDependencyTests-764993224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-71a2c01d-3d36-4cfd-884c-b6a76ae8e620 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:33 devstack sudo[106295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-71a2c01d-3d36-4cfd-884c-b6a76ae8e620 Jul 10 16:12:33 devstack sudo[106295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:33 devstack sudo[106290]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:33 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-28f32f0d-5eaa-4a07-8fc9-52ba872e63d1 tempest-ProjectMemberTests-968602289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a60fdf14-c826-4e66-bed9-893e00a8f249.8d19f975-2ae5-43b5-aa1f-1bf19c94397a" returned: 0 in 0.720s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:33 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-28f32f0d-5eaa-4a07-8fc9-52ba872e63d1 tempest-ProjectMemberTests-968602289 None] Lock "cinder-quobyte-8d19f975-2ae5-43b5-aa1f-1bf19c94397a" released by "_delete_snapshot" :: held 3.204s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:12:33 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-28f32f0d-5eaa-4a07-8fc9-52ba872e63d1 tempest-ProjectMemberTests-968602289 None] Lock "cinder-quobyte-a60fdf14-c826-4e66-bed9-893e00a8f249" released by "delete_snapshot" :: held 3.232s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:12:33 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-28f32f0d-5eaa-4a07-8fc9-52ba872e63d1 tempest-ProjectMemberTests-968602289 None] Created reservations ['799a15f2-d694-4644-ace5-6ca716931606', 'af0a25c7-b123-45d3-8310-566d56e8c112', '061ae09a-fcb3-4fd0-8d58-04e6048e6fda', '0dfe66a0-dfa8-4e7a-a3e5-520983ef9a15'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:12:33 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-28f32f0d-5eaa-4a07-8fc9-52ba872e63d1 tempest-ProjectMemberTests-968602289 None] Delete snapshot completed successfully. Jul 10 16:12:33 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-28f32f0d-5eaa-4a07-8fc9-52ba872e63d1 tempest-ProjectMemberTests-968602289 None] Lock "cinder-8d19f975-2ae5-43b5-aa1f-1bf19c94397a-delete_snapshot" released by "delete_snapshot" :: held 3.368s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:12:34 devstack sudo[106295]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:34 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-586d5338-2b37-4166-8d73-0d8cb34f1be0 tempest-VolumeImageDependencyTests-764993224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-71a2c01d-3d36-4cfd-884c-b6a76ae8e620" returned: 0 in 0.695s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:34 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-586d5338-2b37-4166-8d73-0d8cb34f1be0 tempest-VolumeImageDependencyTests-764993224 None] <== create_volume: return (1571ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 16:12:34 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-586d5338-2b37-4166-8d73-0d8cb34f1be0 tempest-VolumeImageDependencyTests-764993224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.575s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:12:34 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-40515a30-ef08-44f2-8d5a-d307a0272ad2 tempest-ProjectReaderTests-19712737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.969s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:12:34 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-40515a30-ef08-44f2-8d5a-d307a0272ad2 tempest-ProjectReaderTests-19712737 None] Creating offline snapshot 212cfab1-e0f0-4d4a-9737-9ed8dce5e55c of volume 1786e0be-5f73-4e0f-b8b2-ad3fa474e017 {{(pid=87420) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 16:12:34 devstack cinder-volume[87420]: DEBUG cinder.volume.volume_utils [None req-586d5338-2b37-4166-8d73-0d8cb34f1be0 tempest-VolumeImageDependencyTests-764993224 None] Attempting download of 61f98a8d-a904-44b3-b073-46765439cae2 ((None, [{'url': 'file:///opt/stack/data/glance/images/61f98a8d-a904-44b3-b073-46765439cae2', 'metadata': {}}])) to volume 71a2c01d-3d36-4cfd-884c-b6a76ae8e620. {{(pid=87420) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 10 16:12:34 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc255cd4-0cd4-4fac-ae97-8b94780f0737]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:12:34 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-40515a30-ef08-44f2-8d5a-d307a0272ad2 tempest-ProjectReaderTests-19712737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1786e0be-5f73-4e0f-b8b2-ad3fa474e017 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:34 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[dad44fa3-c91b-454a-a628-ee0b0a5814f4]: (4, 'raw') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:12:34 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-586d5338-2b37-4166-8d73-0d8cb34f1be0 tempest-VolumeImageDependencyTests-764993224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_61f98a8d-a904-44b3-b073-46765439cae2_n71wuce3 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:34 devstack sudo[106300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1786e0be-5f73-4e0f-b8b2-ad3fa474e017 Jul 10 16:12:34 devstack sudo[106300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:34 devstack sudo[106301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_61f98a8d-a904-44b3-b073-46765439cae2_n71wuce3 Jul 10 16:12:34 devstack sudo[106301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:34 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-936aa52b-9b78-40a4-a2dd-2dea8fbae8d4 tempest-ProjectMemberTests-968602289 None] Acquiring lock "cinder-a60fdf14-c826-4e66-bed9-893e00a8f249-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:12:34 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-936aa52b-9b78-40a4-a2dd-2dea8fbae8d4 tempest-ProjectMemberTests-968602289 None] Lock "cinder-a60fdf14-c826-4e66-bed9-893e00a8f249-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:12:34 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-936aa52b-9b78-40a4-a2dd-2dea8fbae8d4 tempest-ProjectMemberTests-968602289 None] Acquiring lock "cinder-quobyte-a60fdf14-c826-4e66-bed9-893e00a8f249" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:12:34 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-936aa52b-9b78-40a4-a2dd-2dea8fbae8d4 tempest-ProjectMemberTests-968602289 None] Lock "cinder-quobyte-a60fdf14-c826-4e66-bed9-893e00a8f249" acquired by "delete_volume" :: waited 0.015s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:12:34 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f896f52-8148-4f3c-88ba-99b73631eacb]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:12:34 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-936aa52b-9b78-40a4-a2dd-2dea8fbae8d4 tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a60fdf14-c826-4e66-bed9-893e00a8f249 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:34 devstack sudo[106305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a60fdf14-c826-4e66-bed9-893e00a8f249 Jul 10 16:12:34 devstack sudo[106305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:34 devstack sudo[106300]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:34 devstack sudo[106301]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:34 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-40515a30-ef08-44f2-8d5a-d307a0272ad2 tempest-ProjectReaderTests-19712737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1786e0be-5f73-4e0f-b8b2-ad3fa474e017" returned: 0 in 0.809s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:34 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-40515a30-ef08-44f2-8d5a-d307a0272ad2 tempest-ProjectReaderTests-19712737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1786e0be-5f73-4e0f-b8b2-ad3fa474e017,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1786e0be-5f73-4e0f-b8b2-ad3fa474e017.212cfab1-e0f0-4d4a-9737-9ed8dce5e55c 1G {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:34 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-586d5338-2b37-4166-8d73-0d8cb34f1be0 tempest-VolumeImageDependencyTests-764993224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_61f98a8d-a904-44b3-b073-46765439cae2_n71wuce3" returned: 0 in 0.783s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:34 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-586d5338-2b37-4166-8d73-0d8cb34f1be0 tempest-VolumeImageDependencyTests-764993224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_61f98a8d-a904-44b3-b073-46765439cae2_n71wuce3 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:34 devstack sudo[106311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1786e0be-5f73-4e0f-b8b2-ad3fa474e017,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1786e0be-5f73-4e0f-b8b2-ad3fa474e017.212cfab1-e0f0-4d4a-9737-9ed8dce5e55c 1G Jul 10 16:12:34 devstack sudo[106311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:35 devstack sudo[106312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_61f98a8d-a904-44b3-b073-46765439cae2_n71wuce3 Jul 10 16:12:35 devstack sudo[106312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:35 devstack sudo[106305]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:35 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-936aa52b-9b78-40a4-a2dd-2dea8fbae8d4 tempest-ProjectMemberTests-968602289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a60fdf14-c826-4e66-bed9-893e00a8f249" returned: 0 in 0.798s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:35 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-936aa52b-9b78-40a4-a2dd-2dea8fbae8d4 tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a60fdf14-c826-4e66-bed9-893e00a8f249 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:35 devstack sudo[106321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a60fdf14-c826-4e66-bed9-893e00a8f249 Jul 10 16:12:35 devstack sudo[106321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:35 devstack sudo[106312]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:35 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-586d5338-2b37-4166-8d73-0d8cb34f1be0 tempest-VolumeImageDependencyTests-764993224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_61f98a8d-a904-44b3-b073-46765439cae2_n71wuce3" returned: 1 in 0.800s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:35 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-586d5338-2b37-4166-8d73-0d8cb34f1be0 tempest-VolumeImageDependencyTests-764993224 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_61f98a8d-a904-44b3-b073-46765439cae2_n71wuce3' failed. Not Retrying. {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 16:12:35 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[698141c7-8519-4b00-b003-1f8f94746b38]: (4, 'raw') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:12:35 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-586d5338-2b37-4166-8d73-0d8cb34f1be0 tempest-VolumeImageDependencyTests-764993224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_61f98a8d-a904-44b3-b073-46765439cae2_ds38huvpdevstack@QuobyteHD {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:35 devstack sudo[106311]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:35 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-40515a30-ef08-44f2-8d5a-d307a0272ad2 tempest-ProjectReaderTests-19712737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1786e0be-5f73-4e0f-b8b2-ad3fa474e017,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1786e0be-5f73-4e0f-b8b2-ad3fa474e017.212cfab1-e0f0-4d4a-9737-9ed8dce5e55c 1G" returned: 0 in 0.882s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:35 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-40515a30-ef08-44f2-8d5a-d307a0272ad2 tempest-ProjectReaderTests-19712737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1786e0be-5f73-4e0f-b8b2-ad3fa474e017 -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1786e0be-5f73-4e0f-b8b2-ad3fa474e017.212cfab1-e0f0-4d4a-9737-9ed8dce5e55c {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:35 devstack sudo[106326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1786e0be-5f73-4e0f-b8b2-ad3fa474e017 -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1786e0be-5f73-4e0f-b8b2-ad3fa474e017.212cfab1-e0f0-4d4a-9737-9ed8dce5e55c Jul 10 16:12:35 devstack sudo[106326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:35 devstack sudo[106325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_61f98a8d-a904-44b3-b073-46765439cae2_ds38huvpdevstack@QuobyteHD Jul 10 16:12:35 devstack sudo[106325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:36 devstack sudo[106321]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:36 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-936aa52b-9b78-40a4-a2dd-2dea8fbae8d4 tempest-ProjectMemberTests-968602289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a60fdf14-c826-4e66-bed9-893e00a8f249" returned: 0 in 0.699s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:36 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-936aa52b-9b78-40a4-a2dd-2dea8fbae8d4 tempest-ProjectMemberTests-968602289 None] Lock "cinder-quobyte-a60fdf14-c826-4e66-bed9-893e00a8f249" released by "delete_volume" :: held 1.560s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:12:36 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-936aa52b-9b78-40a4-a2dd-2dea8fbae8d4 tempest-ProjectMemberTests-968602289 None] Created reservations ['9848c8d0-77c3-4ce8-8d30-bc8a5d8647b8', '1ab1eb63-4978-4bb2-8839-aff40c40a18d', 'dd68d800-fa9e-439b-9b45-d8ec44d8da93', '93858c91-7871-40e0-b81a-948a76980864'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:12:36 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-936aa52b-9b78-40a4-a2dd-2dea8fbae8d4 tempest-ProjectMemberTests-968602289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:12:36 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-936aa52b-9b78-40a4-a2dd-2dea8fbae8d4 tempest-ProjectMemberTests-968602289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:12:36 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-936aa52b-9b78-40a4-a2dd-2dea8fbae8d4 tempest-ProjectMemberTests-968602289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:12:36 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-936aa52b-9b78-40a4-a2dd-2dea8fbae8d4 tempest-ProjectMemberTests-968602289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:12:36 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-936aa52b-9b78-40a4-a2dd-2dea8fbae8d4 tempest-ProjectMemberTests-968602289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:12:36 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-936aa52b-9b78-40a4-a2dd-2dea8fbae8d4 tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:36 devstack sudo[106335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:12:36 devstack sudo[106335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:36 devstack sudo[106325]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:36 devstack sudo[106326]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:36 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-586d5338-2b37-4166-8d73-0d8cb34f1be0 tempest-VolumeImageDependencyTests-764993224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_61f98a8d-a904-44b3-b073-46765439cae2_ds38huvpdevstack@QuobyteHD" returned: 0 in 0.771s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:36 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-586d5338-2b37-4166-8d73-0d8cb34f1be0 tempest-VolumeImageDependencyTests-764993224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_61f98a8d-a904-44b3-b073-46765439cae2_ds38huvpdevstack@QuobyteHD {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:36 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-40515a30-ef08-44f2-8d5a-d307a0272ad2 tempest-ProjectReaderTests-19712737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1786e0be-5f73-4e0f-b8b2-ad3fa474e017 -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1786e0be-5f73-4e0f-b8b2-ad3fa474e017.212cfab1-e0f0-4d4a-9737-9ed8dce5e55c" returned: 0 in 0.721s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:36 devstack cinder-volume[87420]: WARNING cinder.volume.drivers.remotefs [None req-40515a30-ef08-44f2-8d5a-d307a0272ad2 tempest-ProjectReaderTests-19712737 None] /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1786e0be-5f73-4e0f-b8b2-ad3fa474e017.212cfab1-e0f0-4d4a-9737-9ed8dce5e55c is being set with open permissions: ugo+rw Jul 10 16:12:36 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-40515a30-ef08-44f2-8d5a-d307a0272ad2 tempest-ProjectReaderTests-19712737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1786e0be-5f73-4e0f-b8b2-ad3fa474e017.212cfab1-e0f0-4d4a-9737-9ed8dce5e55c {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:36 devstack sudo[106338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1786e0be-5f73-4e0f-b8b2-ad3fa474e017.212cfab1-e0f0-4d4a-9737-9ed8dce5e55c Jul 10 16:12:36 devstack sudo[106338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:36 devstack sudo[106337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_61f98a8d-a904-44b3-b073-46765439cae2_ds38huvpdevstack@QuobyteHD Jul 10 16:12:36 devstack sudo[106337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:37 devstack sudo[106335]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:37 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-936aa52b-9b78-40a4-a2dd-2dea8fbae8d4 tempest-ProjectMemberTests-968602289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.764s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:37 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-936aa52b-9b78-40a4-a2dd-2dea8fbae8d4 tempest-ProjectMemberTests-968602289 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:12:37 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-936aa52b-9b78-40a4-a2dd-2dea8fbae8d4 tempest-ProjectMemberTests-968602289 None] Deleted volume successfully. Jul 10 16:12:37 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-936aa52b-9b78-40a4-a2dd-2dea8fbae8d4 tempest-ProjectMemberTests-968602289 None] Lock "cinder-a60fdf14-c826-4e66-bed9-893e00a8f249-delete_volume" released by "delete_volume" :: held 2.605s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:12:37 devstack sudo[106338]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:37 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-40515a30-ef08-44f2-8d5a-d307a0272ad2 tempest-ProjectReaderTests-19712737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1786e0be-5f73-4e0f-b8b2-ad3fa474e017.212cfab1-e0f0-4d4a-9737-9ed8dce5e55c" returned: 0 in 0.740s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:37 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-40515a30-ef08-44f2-8d5a-d307a0272ad2 tempest-ProjectReaderTests-19712737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1786e0be-5f73-4e0f-b8b2-ad3fa474e017.info {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:37 devstack sudo[106337]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:37 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-586d5338-2b37-4166-8d73-0d8cb34f1be0 tempest-VolumeImageDependencyTests-764993224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_61f98a8d-a904-44b3-b073-46765439cae2_ds38huvpdevstack@QuobyteHD" returned: 1 in 0.810s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:37 devstack sudo[106346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1786e0be-5f73-4e0f-b8b2-ad3fa474e017.info Jul 10 16:12:37 devstack sudo[106346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:37 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-586d5338-2b37-4166-8d73-0d8cb34f1be0 tempest-VolumeImageDependencyTests-764993224 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_61f98a8d-a904-44b3-b073-46765439cae2_ds38huvpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 16:12:37 devstack cinder-volume[87420]: DEBUG cinder.image.image_utils [None req-586d5338-2b37-4166-8d73-0d8cb34f1be0 tempest-VolumeImageDependencyTests-764993224 None] 61f98a8d-a904-44b3-b073-46765439cae2 was raw, converting to raw {{(pid=87420) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 10 16:12:37 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-586d5338-2b37-4166-8d73-0d8cb34f1be0 tempest-VolumeImageDependencyTests-764993224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_61f98a8d-a904-44b3-b073-46765439cae2_ds38huvpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-71a2c01d-3d36-4cfd-884c-b6a76ae8e620 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:37 devstack sudo[106348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_61f98a8d-a904-44b3-b073-46765439cae2_ds38huvpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-71a2c01d-3d36-4cfd-884c-b6a76ae8e620 Jul 10 16:12:37 devstack sudo[106348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:37 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-d918da05-8008-47b0-918d-a151171a5bc0 tempest-ProjectMemberTests-968602289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 16:12:37 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d918da05-8008-47b0-918d-a151171a5bc0 tempest-ProjectMemberTests-968602289 None] Flow 'volume_create_manager' (6cfd3600-71ec-4dbc-b3c2-71319977abfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:12:37 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d918da05-8008-47b0-918d-a151171a5bc0 tempest-ProjectMemberTests-968602289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7db989d0-04b5-4f0a-9eae-2e11ef150a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:12:37 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d918da05-8008-47b0-918d-a151171a5bc0 tempest-ProjectMemberTests-968602289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7db989d0-04b5-4f0a-9eae-2e11ef150a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:12:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2110062699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=115c8b34-a79a-40df-84f1-8cd12af6c1f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a62b0a8c6e6a4e9a9b6772e9c7ee6af3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:12:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:12:37Z,use_quota=True,user_id='1a439b56b94841c39eb4e94d953ccde8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:12:37 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d918da05-8008-47b0-918d-a151171a5bc0 tempest-ProjectMemberTests-968602289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6153d2ce-06db-4ba4-a2f6-48287a7c1108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:12:37 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d918da05-8008-47b0-918d-a151171a5bc0 tempest-ProjectMemberTests-968602289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6153d2ce-06db-4ba4-a2f6-48287a7c1108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:12:37 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d918da05-8008-47b0-918d-a151171a5bc0 tempest-ProjectMemberTests-968602289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30db2a45-8230-40b7-b417-ca8a8e128f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:12:37 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d918da05-8008-47b0-918d-a151171a5bc0 tempest-ProjectMemberTests-968602289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30db2a45-8230-40b7-b417-ca8a8e128f9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '115c8b34-a79a-40df-84f1-8cd12af6c1f7', 'volume_name': 'volume-115c8b34-a79a-40df-84f1-8cd12af6c1f7', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:12:37 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d918da05-8008-47b0-918d-a151171a5bc0 tempest-ProjectMemberTests-968602289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d38e2a4f-19b7-4cca-bc52-4be29aef9ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:12:37 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d918da05-8008-47b0-918d-a151171a5bc0 tempest-ProjectMemberTests-968602289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d38e2a4f-19b7-4cca-bc52-4be29aef9ed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:12:37 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d918da05-8008-47b0-918d-a151171a5bc0 tempest-ProjectMemberTests-968602289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (280ee124-c515-4157-9785-710bf92c7f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:12:37 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-d918da05-8008-47b0-918d-a151171a5bc0 tempest-ProjectMemberTests-968602289 None] Volume 115c8b34-a79a-40df-84f1-8cd12af6c1f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-115c8b34-a79a-40df-84f1-8cd12af6c1f7', 'volume_size': 1} Jul 10 16:12:37 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-d918da05-8008-47b0-918d-a151171a5bc0 tempest-ProjectMemberTests-968602289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:12:38 devstack sudo[106346]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:38 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-40515a30-ef08-44f2-8d5a-d307a0272ad2 tempest-ProjectReaderTests-19712737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1786e0be-5f73-4e0f-b8b2-ad3fa474e017.info" returned: 0 in 0.683s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:38 devstack cinder-volume[87420]: WARNING cinder.volume.drivers.remotefs [None req-40515a30-ef08-44f2-8d5a-d307a0272ad2 tempest-ProjectReaderTests-19712737 None] /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1786e0be-5f73-4e0f-b8b2-ad3fa474e017.info is being set with open permissions: ugo+rw Jul 10 16:12:38 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-40515a30-ef08-44f2-8d5a-d307a0272ad2 tempest-ProjectReaderTests-19712737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1786e0be-5f73-4e0f-b8b2-ad3fa474e017.info {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:38 devstack sudo[106354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1786e0be-5f73-4e0f-b8b2-ad3fa474e017.info Jul 10 16:12:38 devstack sudo[106354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:38 devstack sudo[106348]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:38 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-586d5338-2b37-4166-8d73-0d8cb34f1be0 tempest-VolumeImageDependencyTests-764993224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_61f98a8d-a904-44b3-b073-46765439cae2_ds38huvpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-71a2c01d-3d36-4cfd-884c-b6a76ae8e620" returned: 0 in 0.756s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:38 devstack cinder-volume[87420]: DEBUG cinder.image.image_utils [None req-586d5338-2b37-4166-8d73-0d8cb34f1be0 tempest-VolumeImageDependencyTests-764993224 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_61f98a8d-a904-44b3-b073-46765439cae2_ds38huvpdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-71a2c01d-3d36-4cfd-884c-b6a76ae8e620 {{(pid=87420) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 16:12:38 devstack cinder-volume[87420]: INFO cinder.image.image_utils [None req-586d5338-2b37-4166-8d73-0d8cb34f1be0 tempest-VolumeImageDependencyTests-764993224 None] Converted 0.00 MB image at 0.00 MB/s Jul 10 16:12:38 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-586d5338-2b37-4166-8d73-0d8cb34f1be0 tempest-VolumeImageDependencyTests-764993224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-71a2c01d-3d36-4cfd-884c-b6a76ae8e620 1G {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:38 devstack sudo[106356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-71a2c01d-3d36-4cfd-884c-b6a76ae8e620 1G Jul 10 16:12:38 devstack sudo[106356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:38 devstack sudo[106354]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:38 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-40515a30-ef08-44f2-8d5a-d307a0272ad2 tempest-ProjectReaderTests-19712737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1786e0be-5f73-4e0f-b8b2-ad3fa474e017.info" returned: 0 in 0.675s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:38 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-40515a30-ef08-44f2-8d5a-d307a0272ad2 tempest-ProjectReaderTests-19712737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.603s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:12:38 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-d918da05-8008-47b0-918d-a151171a5bc0 tempest-ProjectMemberTests-968602289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.179s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:12:38 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-d918da05-8008-47b0-918d-a151171a5bc0 tempest-ProjectMemberTests-968602289 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:12:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2110062699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=115c8b34-a79a-40df-84f1-8cd12af6c1f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a62b0a8c6e6a4e9a9b6772e9c7ee6af3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:12:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:12:37Z,use_quota=True,user_id='1a439b56b94841c39eb4e94d953ccde8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 16:12:38 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-d918da05-8008-47b0-918d-a151171a5bc0 tempest-ProjectMemberTests-968602289 None] Creating volume 115c8b34-a79a-40df-84f1-8cd12af6c1f7 {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 16:12:38 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-d918da05-8008-47b0-918d-a151171a5bc0 tempest-ProjectMemberTests-968602289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:12:38 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-d918da05-8008-47b0-918d-a151171a5bc0 tempest-ProjectMemberTests-968602289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:12:38 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-d918da05-8008-47b0-918d-a151171a5bc0 tempest-ProjectMemberTests-968602289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:12:38 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-d918da05-8008-47b0-918d-a151171a5bc0 tempest-ProjectMemberTests-968602289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:12:38 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-d918da05-8008-47b0-918d-a151171a5bc0 tempest-ProjectMemberTests-968602289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:12:38 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-d918da05-8008-47b0-918d-a151171a5bc0 tempest-ProjectMemberTests-968602289 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 16:12:38 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-d918da05-8008-47b0-918d-a151171a5bc0 tempest-ProjectMemberTests-968602289 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 16:12:38 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d918da05-8008-47b0-918d-a151171a5bc0 tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-115c8b34-a79a-40df-84f1-8cd12af6c1f7 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:38 devstack sudo[106362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-115c8b34-a79a-40df-84f1-8cd12af6c1f7 1073741824 Jul 10 16:12:38 devstack sudo[106362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:38 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-40515a30-ef08-44f2-8d5a-d307a0272ad2 tempest-ProjectReaderTests-19712737 None] Create snapshot completed successfully Jul 10 16:12:38 devstack sudo[106356]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:38 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-586d5338-2b37-4166-8d73-0d8cb34f1be0 tempest-VolumeImageDependencyTests-764993224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-71a2c01d-3d36-4cfd-884c-b6a76ae8e620 1G" returned: 0 in 0.693s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:38 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d739d6c-82d0-4cb6-8878-0cf5bc63c1c8]: (4, 'raw') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:12:38 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-586d5338-2b37-4166-8d73-0d8cb34f1be0 tempest-VolumeImageDependencyTests-764993224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-71a2c01d-3d36-4cfd-884c-b6a76ae8e620 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:38 devstack sudo[106364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-71a2c01d-3d36-4cfd-884c-b6a76ae8e620 Jul 10 16:12:38 devstack sudo[106364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:39 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-213ffd2d-37fc-40c7-b6e7-9cea3b6f2662 tempest-ProjectReaderTests-19712737 None] Acquiring lock "cinder-212cfab1-e0f0-4d4a-9737-9ed8dce5e55c-delete_snapshot" by "delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:12:39 devstack sudo[106364]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:39 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-586d5338-2b37-4166-8d73-0d8cb34f1be0 tempest-VolumeImageDependencyTests-764993224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-71a2c01d-3d36-4cfd-884c-b6a76ae8e620" returned: 0 in 0.764s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:39 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-586d5338-2b37-4166-8d73-0d8cb34f1be0 tempest-VolumeImageDependencyTests-764993224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-71a2c01d-3d36-4cfd-884c-b6a76ae8e620 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:39 devstack sudo[106362]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:39 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d918da05-8008-47b0-918d-a151171a5bc0 tempest-ProjectMemberTests-968602289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-115c8b34-a79a-40df-84f1-8cd12af6c1f7 1073741824" returned: 0 in 0.935s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:39 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-213ffd2d-37fc-40c7-b6e7-9cea3b6f2662 tempest-ProjectReaderTests-19712737 None] Lock "cinder-212cfab1-e0f0-4d4a-9737-9ed8dce5e55c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:12:39 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-213ffd2d-37fc-40c7-b6e7-9cea3b6f2662 tempest-ProjectReaderTests-19712737 None] Acquiring lock "cinder-quobyte-1786e0be-5f73-4e0f-b8b2-ad3fa474e017" by "delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:12:39 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-213ffd2d-37fc-40c7-b6e7-9cea3b6f2662 tempest-ProjectReaderTests-19712737 None] Lock "cinder-quobyte-1786e0be-5f73-4e0f-b8b2-ad3fa474e017" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:12:39 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-213ffd2d-37fc-40c7-b6e7-9cea3b6f2662 tempest-ProjectReaderTests-19712737 None] Acquiring lock "cinder-quobyte-212cfab1-e0f0-4d4a-9737-9ed8dce5e55c" by "_delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:12:39 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-213ffd2d-37fc-40c7-b6e7-9cea3b6f2662 tempest-ProjectReaderTests-19712737 None] Lock "cinder-quobyte-212cfab1-e0f0-4d4a-9737-9ed8dce5e55c" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:12:39 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-213ffd2d-37fc-40c7-b6e7-9cea3b6f2662 tempest-ProjectReaderTests-19712737 None] Deleting offline snapshot 212cfab1-e0f0-4d4a-9737-9ed8dce5e55c of volume 1786e0be-5f73-4e0f-b8b2-ad3fa474e017 {{(pid=87420) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 16:12:39 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-213ffd2d-37fc-40c7-b6e7-9cea3b6f2662 tempest-ProjectReaderTests-19712737 None] snapshot_file for this snap is: volume-1786e0be-5f73-4e0f-b8b2-ad3fa474e017.212cfab1-e0f0-4d4a-9737-9ed8dce5e55c {{(pid=87420) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 16:12:39 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d918da05-8008-47b0-918d-a151171a5bc0 tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-115c8b34-a79a-40df-84f1-8cd12af6c1f7 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:39 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3ffab88-c3e2-49eb-82dc-8f07f1a69d55]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:12:39 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-213ffd2d-37fc-40c7-b6e7-9cea3b6f2662 tempest-ProjectReaderTests-19712737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1786e0be-5f73-4e0f-b8b2-ad3fa474e017.212cfab1-e0f0-4d4a-9737-9ed8dce5e55c {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:39 devstack sudo[106372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-71a2c01d-3d36-4cfd-884c-b6a76ae8e620 Jul 10 16:12:39 devstack sudo[106372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:39 devstack sudo[106373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-115c8b34-a79a-40df-84f1-8cd12af6c1f7 Jul 10 16:12:39 devstack sudo[106373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:39 devstack sudo[106375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1786e0be-5f73-4e0f-b8b2-ad3fa474e017.212cfab1-e0f0-4d4a-9737-9ed8dce5e55c Jul 10 16:12:39 devstack sudo[106375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:40 devstack sudo[106372]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:40 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-586d5338-2b37-4166-8d73-0d8cb34f1be0 tempest-VolumeImageDependencyTests-764993224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-71a2c01d-3d36-4cfd-884c-b6a76ae8e620" returned: 1 in 0.792s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:40 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-586d5338-2b37-4166-8d73-0d8cb34f1be0 tempest-VolumeImageDependencyTests-764993224 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-71a2c01d-3d36-4cfd-884c-b6a76ae8e620' failed. Not Retrying. {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 16:12:40 devstack cinder-volume[87420]: DEBUG cinder.volume.volume_utils [None req-586d5338-2b37-4166-8d73-0d8cb34f1be0 tempest-VolumeImageDependencyTests-764993224 None] Downloaded image 61f98a8d-a904-44b3-b073-46765439cae2 ((None, [{'url': 'file:///opt/stack/data/glance/images/61f98a8d-a904-44b3-b073-46765439cae2', 'metadata': {}}])) to volume 71a2c01d-3d36-4cfd-884c-b6a76ae8e620 successfully. {{(pid=87420) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 10 16:12:40 devstack cinder-volume[87420]: DEBUG cinder.image.image_utils [None req-586d5338-2b37-4166-8d73-0d8cb34f1be0 tempest-VolumeImageDependencyTests-764993224 None] Temporary image 61f98a8d-a904-44b3-b073-46765439cae2 for user af771fb8d474429aa467015c6ecea376 is deleted. {{(pid=87420) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 10 16:12:40 devstack cinder-volume[87420]: DEBUG cinder.volume.volume_utils [None req-586d5338-2b37-4166-8d73-0d8cb34f1be0 tempest-VolumeImageDependencyTests-764993224 None] Marking volume 71a2c01d-3d36-4cfd-884c-b6a76ae8e620 as bootable. {{(pid=87420) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 10 16:12:40 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-586d5338-2b37-4166-8d73-0d8cb34f1be0 tempest-VolumeImageDependencyTests-764993224 None] Copying metadata from image 61f98a8d-a904-44b3-b073-46765439cae2 to 71a2c01d-3d36-4cfd-884c-b6a76ae8e620. {{(pid=87420) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 10 16:12:40 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-586d5338-2b37-4166-8d73-0d8cb34f1be0 tempest-VolumeImageDependencyTests-764993224 None] Creating volume glance metadata for volume 71a2c01d-3d36-4cfd-884c-b6a76ae8e620 backed by image 61f98a8d-a904-44b3-b073-46765439cae2 with: {'image_id': '61f98a8d-a904-44b3-b073-46765439cae2', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'bef5d0f1c666fcd59e1c6f22e6bdc9c3', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87420) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 10 16:12:40 devstack sudo[106373]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:40 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d918da05-8008-47b0-918d-a151171a5bc0 tempest-ProjectMemberTests-968602289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-115c8b34-a79a-40df-84f1-8cd12af6c1f7" returned: 0 in 0.724s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:40 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-d918da05-8008-47b0-918d-a151171a5bc0 tempest-ProjectMemberTests-968602289 None] <== create_volume: return (1753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 16:12:40 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-d918da05-8008-47b0-918d-a151171a5bc0 tempest-ProjectMemberTests-968602289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.756s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:12:40 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d918da05-8008-47b0-918d-a151171a5bc0 tempest-ProjectMemberTests-968602289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (280ee124-c515-4157-9785-710bf92c7f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-115c8b34-a79a-40df-84f1-8cd12af6c1f7', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:12:40 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d918da05-8008-47b0-918d-a151171a5bc0 tempest-ProjectMemberTests-968602289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6e28447-e258-45d3-923b-213c1e773768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:12:40 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-d918da05-8008-47b0-918d-a151171a5bc0 tempest-ProjectMemberTests-968602289 None] Volume volume-115c8b34-a79a-40df-84f1-8cd12af6c1f7 (115c8b34-a79a-40df-84f1-8cd12af6c1f7): created successfully Jul 10 16:12:40 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d918da05-8008-47b0-918d-a151171a5bc0 tempest-ProjectMemberTests-968602289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6e28447-e258-45d3-923b-213c1e773768) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:12:40 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d918da05-8008-47b0-918d-a151171a5bc0 tempest-ProjectMemberTests-968602289 None] Flow 'volume_create_manager' (6cfd3600-71ec-4dbc-b3c2-71319977abfd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:12:40 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-d918da05-8008-47b0-918d-a151171a5bc0 tempest-ProjectMemberTests-968602289 None] Created volume successfully. Jul 10 16:12:40 devstack sudo[106375]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:40 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-586d5338-2b37-4166-8d73-0d8cb34f1be0 tempest-VolumeImageDependencyTests-764993224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e27b38d7-70b2-4639-8f09-0ce5aee59833) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71a2c01d-3d36-4cfd-884c-b6a76ae8e620', 'volume_size': 1, 'image_id': '61f98a8d-a904-44b3-b073-46765439cae2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/61f98a8d-a904-44b3-b073-46765439cae2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'bef5d0f1c666fcd59e1c6f22e6bdc9c3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f2d510b424e342aa94f0fdeb1476de40', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '718366038995c9bcff7f5b77dbffbed4682e7f10b7faa1168263da20427556bc9c674a0ad86fb2d915c5991c5b71d70357aa0334c582382c4e38b2f774cc1ca8', 'id': '61f98a8d-a904-44b3-b073-46765439cae2', 'created_at': datetime.datetime(2026, 7, 10, 14, 12, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 14, 12, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/61f98a8d-a904-44b3-b073-46765439cae2/file', 'properties': {}}, 'image_service': }' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:12:40 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-586d5338-2b37-4166-8d73-0d8cb34f1be0 tempest-VolumeImageDependencyTests-764993224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50e56413-8b69-4d2f-8ee2-8e103f9e0f41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:12:40 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-213ffd2d-37fc-40c7-b6e7-9cea3b6f2662 tempest-ProjectReaderTests-19712737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1786e0be-5f73-4e0f-b8b2-ad3fa474e017.212cfab1-e0f0-4d4a-9737-9ed8dce5e55c" returned: 0 in 0.860s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:40 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-213ffd2d-37fc-40c7-b6e7-9cea3b6f2662 tempest-ProjectReaderTests-19712737 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1786e0be-5f73-4e0f-b8b2-ad3fa474e017(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87420) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 16:12:40 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-586d5338-2b37-4166-8d73-0d8cb34f1be0 tempest-VolumeImageDependencyTests-764993224 None] Volume volume-71a2c01d-3d36-4cfd-884c-b6a76ae8e620 (71a2c01d-3d36-4cfd-884c-b6a76ae8e620): created successfully Jul 10 16:12:40 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-586d5338-2b37-4166-8d73-0d8cb34f1be0 tempest-VolumeImageDependencyTests-764993224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50e56413-8b69-4d2f-8ee2-8e103f9e0f41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:12:40 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-586d5338-2b37-4166-8d73-0d8cb34f1be0 tempest-VolumeImageDependencyTests-764993224 None] Flow 'volume_create_manager' (cc36ad5f-f404-46bb-bda1-7f5557249b87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:12:40 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[77074258-c720-4dc3-9e02-ec647fca7f34]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:12:40 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-213ffd2d-37fc-40c7-b6e7-9cea3b6f2662 tempest-ProjectReaderTests-19712737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1786e0be-5f73-4e0f-b8b2-ad3fa474e017 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:40 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-586d5338-2b37-4166-8d73-0d8cb34f1be0 tempest-VolumeImageDependencyTests-764993224 None] Created volume successfully. Jul 10 16:12:40 devstack sudo[106419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1786e0be-5f73-4e0f-b8b2-ad3fa474e017 Jul 10 16:12:40 devstack sudo[106419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:41 devstack sudo[106419]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:41 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-213ffd2d-37fc-40c7-b6e7-9cea3b6f2662 tempest-ProjectReaderTests-19712737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1786e0be-5f73-4e0f-b8b2-ad3fa474e017" returned: 0 in 0.777s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:41 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-213ffd2d-37fc-40c7-b6e7-9cea3b6f2662 tempest-ProjectReaderTests-19712737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1786e0be-5f73-4e0f-b8b2-ad3fa474e017.212cfab1-e0f0-4d4a-9737-9ed8dce5e55c {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:41 devstack sudo[106426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1786e0be-5f73-4e0f-b8b2-ad3fa474e017.212cfab1-e0f0-4d4a-9737-9ed8dce5e55c Jul 10 16:12:41 devstack sudo[106426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:41 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-16bb2336-b6ee-4483-92cf-0abb4bce293b tempest-VolumeImageDependencyTests-764993224 None] Acquiring lock "cinder-71a2c01d-3d36-4cfd-884c-b6a76ae8e620-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:12:41 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-16bb2336-b6ee-4483-92cf-0abb4bce293b tempest-VolumeImageDependencyTests-764993224 None] Lock "cinder-71a2c01d-3d36-4cfd-884c-b6a76ae8e620-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:12:41 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-3d8354d1-7c15-4fa5-8efa-7529d8c4c6cf tempest-ProjectMemberTests-968602289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:12:41 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-3d8354d1-7c15-4fa5-8efa-7529d8c4c6cf tempest-ProjectMemberTests-968602289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:12:41 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-16bb2336-b6ee-4483-92cf-0abb4bce293b tempest-VolumeImageDependencyTests-764993224 None] Acquiring lock "cinder-quobyte-71a2c01d-3d36-4cfd-884c-b6a76ae8e620" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:12:41 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-3d8354d1-7c15-4fa5-8efa-7529d8c4c6cf tempest-ProjectMemberTests-968602289 None] Creating offline snapshot 52cafee3-babc-458c-ac6f-fddceb4538f6 of volume 115c8b34-a79a-40df-84f1-8cd12af6c1f7 {{(pid=87420) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 16:12:41 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-16bb2336-b6ee-4483-92cf-0abb4bce293b tempest-VolumeImageDependencyTests-764993224 None] Lock "cinder-quobyte-71a2c01d-3d36-4cfd-884c-b6a76ae8e620" acquired by "delete_volume" :: waited 0.028s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:12:41 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfe2ad5b-a9fa-4dd3-8bf9-ab0cae00f408]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:12:41 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-3d8354d1-7c15-4fa5-8efa-7529d8c4c6cf tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-115c8b34-a79a-40df-84f1-8cd12af6c1f7 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:41 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a08529a-aa93-4a64-9a06-77d3c47f4edf]: (4, 'raw') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:12:41 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-16bb2336-b6ee-4483-92cf-0abb4bce293b tempest-VolumeImageDependencyTests-764993224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-71a2c01d-3d36-4cfd-884c-b6a76ae8e620 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:41 devstack sudo[106428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-115c8b34-a79a-40df-84f1-8cd12af6c1f7 Jul 10 16:12:41 devstack sudo[106428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:42 devstack sudo[106429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-71a2c01d-3d36-4cfd-884c-b6a76ae8e620 Jul 10 16:12:42 devstack sudo[106429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:42 devstack sudo[106426]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:42 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-213ffd2d-37fc-40c7-b6e7-9cea3b6f2662 tempest-ProjectReaderTests-19712737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1786e0be-5f73-4e0f-b8b2-ad3fa474e017.212cfab1-e0f0-4d4a-9737-9ed8dce5e55c" returned: 0 in 0.797s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:42 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-213ffd2d-37fc-40c7-b6e7-9cea3b6f2662 tempest-ProjectReaderTests-19712737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1786e0be-5f73-4e0f-b8b2-ad3fa474e017.212cfab1-e0f0-4d4a-9737-9ed8dce5e55c {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:42 devstack sudo[106436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1786e0be-5f73-4e0f-b8b2-ad3fa474e017.212cfab1-e0f0-4d4a-9737-9ed8dce5e55c Jul 10 16:12:42 devstack sudo[106436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:42 devstack sudo[106428]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:42 devstack sudo[106429]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:42 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-3d8354d1-7c15-4fa5-8efa-7529d8c4c6cf tempest-ProjectMemberTests-968602289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-115c8b34-a79a-40df-84f1-8cd12af6c1f7" returned: 0 in 0.783s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:42 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-3d8354d1-7c15-4fa5-8efa-7529d8c4c6cf tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-115c8b34-a79a-40df-84f1-8cd12af6c1f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-115c8b34-a79a-40df-84f1-8cd12af6c1f7.52cafee3-babc-458c-ac6f-fddceb4538f6 1G {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:42 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-16bb2336-b6ee-4483-92cf-0abb4bce293b tempest-VolumeImageDependencyTests-764993224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-71a2c01d-3d36-4cfd-884c-b6a76ae8e620" returned: 0 in 0.764s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:42 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-16bb2336-b6ee-4483-92cf-0abb4bce293b tempest-VolumeImageDependencyTests-764993224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-71a2c01d-3d36-4cfd-884c-b6a76ae8e620 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:42 devstack sudo[106443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-115c8b34-a79a-40df-84f1-8cd12af6c1f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-115c8b34-a79a-40df-84f1-8cd12af6c1f7.52cafee3-babc-458c-ac6f-fddceb4538f6 1G Jul 10 16:12:42 devstack sudo[106443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:42 devstack sudo[106444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-71a2c01d-3d36-4cfd-884c-b6a76ae8e620 Jul 10 16:12:42 devstack sudo[106444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:42 devstack sudo[106436]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:42 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-213ffd2d-37fc-40c7-b6e7-9cea3b6f2662 tempest-ProjectReaderTests-19712737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1786e0be-5f73-4e0f-b8b2-ad3fa474e017.212cfab1-e0f0-4d4a-9737-9ed8dce5e55c" returned: 0 in 0.706s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:42 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-213ffd2d-37fc-40c7-b6e7-9cea3b6f2662 tempest-ProjectReaderTests-19712737 None] Lock "cinder-quobyte-212cfab1-e0f0-4d4a-9737-9ed8dce5e55c" released by "_delete_snapshot" :: held 3.256s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:12:42 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-213ffd2d-37fc-40c7-b6e7-9cea3b6f2662 tempest-ProjectReaderTests-19712737 None] Lock "cinder-quobyte-1786e0be-5f73-4e0f-b8b2-ad3fa474e017" released by "delete_snapshot" :: held 3.286s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:12:43 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-213ffd2d-37fc-40c7-b6e7-9cea3b6f2662 tempest-ProjectReaderTests-19712737 None] Created reservations ['5e9bdcfd-1afb-4d73-b994-bb160586d0a6', '47ceba89-e637-4979-a0c6-ef2b20408a24', '3db51686-1743-4237-a7f1-64d086ea6422', '8735b455-9fa4-40ec-ac0c-07dd52d153fe'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:12:43 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-213ffd2d-37fc-40c7-b6e7-9cea3b6f2662 tempest-ProjectReaderTests-19712737 None] Delete snapshot completed successfully. Jul 10 16:12:43 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-213ffd2d-37fc-40c7-b6e7-9cea3b6f2662 tempest-ProjectReaderTests-19712737 None] Lock "cinder-212cfab1-e0f0-4d4a-9737-9ed8dce5e55c-delete_snapshot" released by "delete_snapshot" :: held 3.437s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:12:43 devstack sudo[106444]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:43 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-16bb2336-b6ee-4483-92cf-0abb4bce293b tempest-VolumeImageDependencyTests-764993224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-71a2c01d-3d36-4cfd-884c-b6a76ae8e620" returned: 1 in 0.775s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:43 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-16bb2336-b6ee-4483-92cf-0abb4bce293b tempest-VolumeImageDependencyTests-764993224 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-71a2c01d-3d36-4cfd-884c-b6a76ae8e620' failed. Not Retrying. {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 16:12:43 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-16bb2336-b6ee-4483-92cf-0abb4bce293b tempest-VolumeImageDependencyTests-764993224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-71a2c01d-3d36-4cfd-884c-b6a76ae8e620 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:43 devstack sudo[106443]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:43 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-3d8354d1-7c15-4fa5-8efa-7529d8c4c6cf tempest-ProjectMemberTests-968602289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-115c8b34-a79a-40df-84f1-8cd12af6c1f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-115c8b34-a79a-40df-84f1-8cd12af6c1f7.52cafee3-babc-458c-ac6f-fddceb4538f6 1G" returned: 0 in 0.817s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:43 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-3d8354d1-7c15-4fa5-8efa-7529d8c4c6cf tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-115c8b34-a79a-40df-84f1-8cd12af6c1f7 -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-115c8b34-a79a-40df-84f1-8cd12af6c1f7.52cafee3-babc-458c-ac6f-fddceb4538f6 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:43 devstack sudo[106455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-71a2c01d-3d36-4cfd-884c-b6a76ae8e620 Jul 10 16:12:43 devstack sudo[106455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:43 devstack sudo[106457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-115c8b34-a79a-40df-84f1-8cd12af6c1f7 -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-115c8b34-a79a-40df-84f1-8cd12af6c1f7.52cafee3-babc-458c-ac6f-fddceb4538f6 Jul 10 16:12:43 devstack sudo[106457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:43 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-72828483-414a-4923-a465-502a94dab491 tempest-ProjectReaderTests-19712737 None] Acquiring lock "cinder-1786e0be-5f73-4e0f-b8b2-ad3fa474e017-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:12:43 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-72828483-414a-4923-a465-502a94dab491 tempest-ProjectReaderTests-19712737 None] Lock "cinder-1786e0be-5f73-4e0f-b8b2-ad3fa474e017-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:12:44 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-72828483-414a-4923-a465-502a94dab491 tempest-ProjectReaderTests-19712737 None] Acquiring lock "cinder-quobyte-1786e0be-5f73-4e0f-b8b2-ad3fa474e017" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:12:44 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-72828483-414a-4923-a465-502a94dab491 tempest-ProjectReaderTests-19712737 None] Lock "cinder-quobyte-1786e0be-5f73-4e0f-b8b2-ad3fa474e017" acquired by "delete_volume" :: waited 0.023s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:12:44 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[6133d618-d9f2-4055-8917-2d3b93ec9c90]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:12:44 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-72828483-414a-4923-a465-502a94dab491 tempest-ProjectReaderTests-19712737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1786e0be-5f73-4e0f-b8b2-ad3fa474e017 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:44 devstack sudo[106457]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:44 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-3d8354d1-7c15-4fa5-8efa-7529d8c4c6cf tempest-ProjectMemberTests-968602289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-115c8b34-a79a-40df-84f1-8cd12af6c1f7 -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-115c8b34-a79a-40df-84f1-8cd12af6c1f7.52cafee3-babc-458c-ac6f-fddceb4538f6" returned: 0 in 0.715s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:44 devstack cinder-volume[87420]: WARNING cinder.volume.drivers.remotefs [None req-3d8354d1-7c15-4fa5-8efa-7529d8c4c6cf tempest-ProjectMemberTests-968602289 None] /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-115c8b34-a79a-40df-84f1-8cd12af6c1f7.52cafee3-babc-458c-ac6f-fddceb4538f6 is being set with open permissions: ugo+rw Jul 10 16:12:44 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-3d8354d1-7c15-4fa5-8efa-7529d8c4c6cf tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-115c8b34-a79a-40df-84f1-8cd12af6c1f7.52cafee3-babc-458c-ac6f-fddceb4538f6 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:44 devstack sudo[106455]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:44 devstack sudo[106464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1786e0be-5f73-4e0f-b8b2-ad3fa474e017 Jul 10 16:12:44 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-16bb2336-b6ee-4483-92cf-0abb4bce293b tempest-VolumeImageDependencyTests-764993224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-71a2c01d-3d36-4cfd-884c-b6a76ae8e620" returned: 0 in 0.759s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:44 devstack sudo[106464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:44 devstack sudo[106465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-115c8b34-a79a-40df-84f1-8cd12af6c1f7.52cafee3-babc-458c-ac6f-fddceb4538f6 Jul 10 16:12:44 devstack sudo[106465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:44 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-16bb2336-b6ee-4483-92cf-0abb4bce293b tempest-VolumeImageDependencyTests-764993224 None] Lock "cinder-quobyte-71a2c01d-3d36-4cfd-884c-b6a76ae8e620" released by "delete_volume" :: held 2.371s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:12:44 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-16bb2336-b6ee-4483-92cf-0abb4bce293b tempest-VolumeImageDependencyTests-764993224 None] Created reservations ['0e76fa51-60be-4a79-8f2a-ddf9c6140d9e', '0c16e3e8-b2ed-46a9-b1cd-97b46c86d860', '90337726-5917-48f3-bed5-ab3b2de31740', '2217e6ff-7708-496f-ba05-7af7c1a185b6'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:12:44 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-16bb2336-b6ee-4483-92cf-0abb4bce293b tempest-VolumeImageDependencyTests-764993224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:12:44 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-16bb2336-b6ee-4483-92cf-0abb4bce293b tempest-VolumeImageDependencyTests-764993224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:12:44 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-16bb2336-b6ee-4483-92cf-0abb4bce293b tempest-VolumeImageDependencyTests-764993224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:12:44 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-16bb2336-b6ee-4483-92cf-0abb4bce293b tempest-VolumeImageDependencyTests-764993224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:12:44 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-16bb2336-b6ee-4483-92cf-0abb4bce293b tempest-VolumeImageDependencyTests-764993224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:12:44 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-16bb2336-b6ee-4483-92cf-0abb4bce293b tempest-VolumeImageDependencyTests-764993224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:44 devstack sudo[106468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:12:44 devstack sudo[106468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:44 devstack sudo[106465]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:44 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-3d8354d1-7c15-4fa5-8efa-7529d8c4c6cf tempest-ProjectMemberTests-968602289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-115c8b34-a79a-40df-84f1-8cd12af6c1f7.52cafee3-babc-458c-ac6f-fddceb4538f6" returned: 0 in 0.679s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:44 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-3d8354d1-7c15-4fa5-8efa-7529d8c4c6cf tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-115c8b34-a79a-40df-84f1-8cd12af6c1f7.info {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:44 devstack sudo[106464]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:44 devstack sudo[106475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-115c8b34-a79a-40df-84f1-8cd12af6c1f7.info Jul 10 16:12:44 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-72828483-414a-4923-a465-502a94dab491 tempest-ProjectReaderTests-19712737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1786e0be-5f73-4e0f-b8b2-ad3fa474e017" returned: 0 in 0.840s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:44 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-72828483-414a-4923-a465-502a94dab491 tempest-ProjectReaderTests-19712737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1786e0be-5f73-4e0f-b8b2-ad3fa474e017 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:44 devstack sudo[106475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:44 devstack sudo[106477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1786e0be-5f73-4e0f-b8b2-ad3fa474e017 Jul 10 16:12:44 devstack sudo[106477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:45 devstack sudo[106468]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:45 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-16bb2336-b6ee-4483-92cf-0abb4bce293b tempest-VolumeImageDependencyTests-764993224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.711s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:45 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-16bb2336-b6ee-4483-92cf-0abb4bce293b tempest-VolumeImageDependencyTests-764993224 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:12:45 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-16bb2336-b6ee-4483-92cf-0abb4bce293b tempest-VolumeImageDependencyTests-764993224 None] Deleted volume successfully. Jul 10 16:12:45 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-16bb2336-b6ee-4483-92cf-0abb4bce293b tempest-VolumeImageDependencyTests-764993224 None] Lock "cinder-71a2c01d-3d36-4cfd-884c-b6a76ae8e620-delete_volume" released by "delete_volume" :: held 3.342s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:12:45 devstack sudo[106475]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:45 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-3d8354d1-7c15-4fa5-8efa-7529d8c4c6cf tempest-ProjectMemberTests-968602289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-115c8b34-a79a-40df-84f1-8cd12af6c1f7.info" returned: 0 in 0.726s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:45 devstack cinder-volume[87420]: WARNING cinder.volume.drivers.remotefs [None req-3d8354d1-7c15-4fa5-8efa-7529d8c4c6cf tempest-ProjectMemberTests-968602289 None] /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-115c8b34-a79a-40df-84f1-8cd12af6c1f7.info is being set with open permissions: ugo+rw Jul 10 16:12:45 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-3d8354d1-7c15-4fa5-8efa-7529d8c4c6cf tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-115c8b34-a79a-40df-84f1-8cd12af6c1f7.info {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:45 devstack sudo[106481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-115c8b34-a79a-40df-84f1-8cd12af6c1f7.info Jul 10 16:12:45 devstack sudo[106481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:45 devstack sudo[106477]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:45 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-72828483-414a-4923-a465-502a94dab491 tempest-ProjectReaderTests-19712737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1786e0be-5f73-4e0f-b8b2-ad3fa474e017" returned: 0 in 0.742s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:45 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-72828483-414a-4923-a465-502a94dab491 tempest-ProjectReaderTests-19712737 None] Lock "cinder-quobyte-1786e0be-5f73-4e0f-b8b2-ad3fa474e017" released by "delete_volume" :: held 1.640s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:12:45 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-72828483-414a-4923-a465-502a94dab491 tempest-ProjectReaderTests-19712737 None] Created reservations ['ab3c3bce-2d8a-49dc-864f-803a7eae3d8d', 'f9489603-b1e7-4abb-963e-13e261c8d356', '72c496e4-acc3-4583-beec-de82fcfafba8', 'e0a688eb-f52d-4988-a973-665a815c2c6f'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:12:45 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-72828483-414a-4923-a465-502a94dab491 tempest-ProjectReaderTests-19712737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:12:45 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-72828483-414a-4923-a465-502a94dab491 tempest-ProjectReaderTests-19712737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:12:45 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-72828483-414a-4923-a465-502a94dab491 tempest-ProjectReaderTests-19712737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:12:45 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-72828483-414a-4923-a465-502a94dab491 tempest-ProjectReaderTests-19712737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:12:45 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-72828483-414a-4923-a465-502a94dab491 tempest-ProjectReaderTests-19712737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:12:45 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-72828483-414a-4923-a465-502a94dab491 tempest-ProjectReaderTests-19712737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:45 devstack sudo[106483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:12:45 devstack sudo[106483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:46 devstack sudo[106481]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:46 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-3d8354d1-7c15-4fa5-8efa-7529d8c4c6cf tempest-ProjectMemberTests-968602289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-115c8b34-a79a-40df-84f1-8cd12af6c1f7.info" returned: 0 in 0.743s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:46 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-3d8354d1-7c15-4fa5-8efa-7529d8c4c6cf tempest-ProjectMemberTests-968602289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.566s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:12:46 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-3d8354d1-7c15-4fa5-8efa-7529d8c4c6cf tempest-ProjectMemberTests-968602289 None] Create snapshot completed successfully Jul 10 16:12:46 devstack sudo[106483]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:46 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-72828483-414a-4923-a465-502a94dab491 tempest-ProjectReaderTests-19712737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.808s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:46 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-72828483-414a-4923-a465-502a94dab491 tempest-ProjectReaderTests-19712737 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:12:46 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-72828483-414a-4923-a465-502a94dab491 tempest-ProjectReaderTests-19712737 None] Deleted volume successfully. Jul 10 16:12:46 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-72828483-414a-4923-a465-502a94dab491 tempest-ProjectReaderTests-19712737 None] Lock "cinder-1786e0be-5f73-4e0f-b8b2-ad3fa474e017-delete_volume" released by "delete_volume" :: held 2.710s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:12:46 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-acc4d1fb-8317-4491-8179-5cb0939eb522 tempest-ProjectReaderTests-19712737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 16:12:46 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-acc4d1fb-8317-4491-8179-5cb0939eb522 tempest-ProjectReaderTests-19712737 None] Flow 'volume_create_manager' (b4d9057c-4a05-4e4b-b19a-5e44fe769a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:12:46 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-acc4d1fb-8317-4491-8179-5cb0939eb522 tempest-ProjectReaderTests-19712737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e52191b6-bbe2-4176-b412-8f3f4986be79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:12:46 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-acc4d1fb-8317-4491-8179-5cb0939eb522 tempest-ProjectReaderTests-19712737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e52191b6-bbe2-4176-b412-8f3f4986be79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:12:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-395945689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6adf0e9f-7c01-411e-baca-adedc1384679,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3216e7ae39094a2295e8ea00806db82b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:12:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:12:47Z,use_quota=True,user_id='52679baac65041bb9ce548ee3dd7269c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:12:46 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-acc4d1fb-8317-4491-8179-5cb0939eb522 tempest-ProjectReaderTests-19712737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (994bd669-7468-4cf6-abdc-4d169ab16825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:12:46 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-acc4d1fb-8317-4491-8179-5cb0939eb522 tempest-ProjectReaderTests-19712737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (994bd669-7468-4cf6-abdc-4d169ab16825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:12:46 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-acc4d1fb-8317-4491-8179-5cb0939eb522 tempest-ProjectReaderTests-19712737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0240398e-f55c-4aac-926b-9ef80247b383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:12:46 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-acc4d1fb-8317-4491-8179-5cb0939eb522 tempest-ProjectReaderTests-19712737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0240398e-f55c-4aac-926b-9ef80247b383) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6adf0e9f-7c01-411e-baca-adedc1384679', 'volume_name': 'volume-6adf0e9f-7c01-411e-baca-adedc1384679', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:12:46 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-acc4d1fb-8317-4491-8179-5cb0939eb522 tempest-ProjectReaderTests-19712737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b982bc3-9527-45c5-8f3d-55531f5c291f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:12:46 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-acc4d1fb-8317-4491-8179-5cb0939eb522 tempest-ProjectReaderTests-19712737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b982bc3-9527-45c5-8f3d-55531f5c291f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:12:46 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-acc4d1fb-8317-4491-8179-5cb0939eb522 tempest-ProjectReaderTests-19712737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de4a72d2-f210-4a04-852f-289d2c998021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:12:46 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-acc4d1fb-8317-4491-8179-5cb0939eb522 tempest-ProjectReaderTests-19712737 None] Volume 6adf0e9f-7c01-411e-baca-adedc1384679: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6adf0e9f-7c01-411e-baca-adedc1384679', 'volume_size': 1} Jul 10 16:12:46 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-acc4d1fb-8317-4491-8179-5cb0939eb522 tempest-ProjectReaderTests-19712737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:12:46 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-acc4d1fb-8317-4491-8179-5cb0939eb522 tempest-ProjectReaderTests-19712737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:12:46 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-acc4d1fb-8317-4491-8179-5cb0939eb522 tempest-ProjectReaderTests-19712737 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:12:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-395945689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6adf0e9f-7c01-411e-baca-adedc1384679,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3216e7ae39094a2295e8ea00806db82b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:12:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:12:47Z,use_quota=True,user_id='52679baac65041bb9ce548ee3dd7269c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 16:12:46 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-acc4d1fb-8317-4491-8179-5cb0939eb522 tempest-ProjectReaderTests-19712737 None] Creating volume 6adf0e9f-7c01-411e-baca-adedc1384679 {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 16:12:46 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-acc4d1fb-8317-4491-8179-5cb0939eb522 tempest-ProjectReaderTests-19712737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:12:46 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-acc4d1fb-8317-4491-8179-5cb0939eb522 tempest-ProjectReaderTests-19712737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:12:46 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-acc4d1fb-8317-4491-8179-5cb0939eb522 tempest-ProjectReaderTests-19712737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:12:46 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-acc4d1fb-8317-4491-8179-5cb0939eb522 tempest-ProjectReaderTests-19712737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:12:46 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-acc4d1fb-8317-4491-8179-5cb0939eb522 tempest-ProjectReaderTests-19712737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:12:46 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-acc4d1fb-8317-4491-8179-5cb0939eb522 tempest-ProjectReaderTests-19712737 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 16:12:46 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-acc4d1fb-8317-4491-8179-5cb0939eb522 tempest-ProjectReaderTests-19712737 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 16:12:46 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-acc4d1fb-8317-4491-8179-5cb0939eb522 tempest-ProjectReaderTests-19712737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6adf0e9f-7c01-411e-baca-adedc1384679 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:46 devstack sudo[106493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6adf0e9f-7c01-411e-baca-adedc1384679 1073741824 Jul 10 16:12:46 devstack sudo[106493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:47 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-151e2e2c-e8e3-4f51-8079-13f4040562cd tempest-ProjectMemberTests-968602289 None] Acquiring lock "cinder-52cafee3-babc-458c-ac6f-fddceb4538f6-delete_snapshot" by "delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:12:47 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-151e2e2c-e8e3-4f51-8079-13f4040562cd tempest-ProjectMemberTests-968602289 None] Lock "cinder-52cafee3-babc-458c-ac6f-fddceb4538f6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:12:47 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-151e2e2c-e8e3-4f51-8079-13f4040562cd tempest-ProjectMemberTests-968602289 None] Acquiring lock "cinder-quobyte-115c8b34-a79a-40df-84f1-8cd12af6c1f7" by "delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:12:47 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-151e2e2c-e8e3-4f51-8079-13f4040562cd tempest-ProjectMemberTests-968602289 None] Lock "cinder-quobyte-115c8b34-a79a-40df-84f1-8cd12af6c1f7" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:12:47 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-151e2e2c-e8e3-4f51-8079-13f4040562cd tempest-ProjectMemberTests-968602289 None] Acquiring lock "cinder-quobyte-52cafee3-babc-458c-ac6f-fddceb4538f6" by "_delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:12:47 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-151e2e2c-e8e3-4f51-8079-13f4040562cd tempest-ProjectMemberTests-968602289 None] Lock "cinder-quobyte-52cafee3-babc-458c-ac6f-fddceb4538f6" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:12:47 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-151e2e2c-e8e3-4f51-8079-13f4040562cd tempest-ProjectMemberTests-968602289 None] Deleting offline snapshot 52cafee3-babc-458c-ac6f-fddceb4538f6 of volume 115c8b34-a79a-40df-84f1-8cd12af6c1f7 {{(pid=87420) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 16:12:47 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-151e2e2c-e8e3-4f51-8079-13f4040562cd tempest-ProjectMemberTests-968602289 None] snapshot_file for this snap is: volume-115c8b34-a79a-40df-84f1-8cd12af6c1f7.52cafee3-babc-458c-ac6f-fddceb4538f6 {{(pid=87420) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 16:12:47 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a3753e-f258-473d-a3a5-43e40f4b036c]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:12:47 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-151e2e2c-e8e3-4f51-8079-13f4040562cd tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-115c8b34-a79a-40df-84f1-8cd12af6c1f7.52cafee3-babc-458c-ac6f-fddceb4538f6 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:47 devstack sudo[106495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-115c8b34-a79a-40df-84f1-8cd12af6c1f7.52cafee3-babc-458c-ac6f-fddceb4538f6 Jul 10 16:12:47 devstack sudo[106495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:47 devstack sudo[106493]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:47 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-acc4d1fb-8317-4491-8179-5cb0939eb522 tempest-ProjectReaderTests-19712737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6adf0e9f-7c01-411e-baca-adedc1384679 1073741824" returned: 0 in 0.937s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:47 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-acc4d1fb-8317-4491-8179-5cb0939eb522 tempest-ProjectReaderTests-19712737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6adf0e9f-7c01-411e-baca-adedc1384679 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:47 devstack sudo[106502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6adf0e9f-7c01-411e-baca-adedc1384679 Jul 10 16:12:47 devstack sudo[106502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:48 devstack sudo[106495]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:48 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-151e2e2c-e8e3-4f51-8079-13f4040562cd tempest-ProjectMemberTests-968602289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-115c8b34-a79a-40df-84f1-8cd12af6c1f7.52cafee3-babc-458c-ac6f-fddceb4538f6" returned: 0 in 0.842s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:48 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-151e2e2c-e8e3-4f51-8079-13f4040562cd tempest-ProjectMemberTests-968602289 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-115c8b34-a79a-40df-84f1-8cd12af6c1f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87420) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 16:12:48 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[baf689c4-a482-4dfc-bd20-1bd85c1218f2]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:12:48 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-151e2e2c-e8e3-4f51-8079-13f4040562cd tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-115c8b34-a79a-40df-84f1-8cd12af6c1f7 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:48 devstack sudo[106506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-115c8b34-a79a-40df-84f1-8cd12af6c1f7 Jul 10 16:12:48 devstack sudo[106506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:48 devstack sudo[106502]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:48 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-acc4d1fb-8317-4491-8179-5cb0939eb522 tempest-ProjectReaderTests-19712737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6adf0e9f-7c01-411e-baca-adedc1384679" returned: 0 in 0.693s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:48 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-acc4d1fb-8317-4491-8179-5cb0939eb522 tempest-ProjectReaderTests-19712737 None] <== create_volume: return (1679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 16:12:48 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-acc4d1fb-8317-4491-8179-5cb0939eb522 tempest-ProjectReaderTests-19712737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.682s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:12:48 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-acc4d1fb-8317-4491-8179-5cb0939eb522 tempest-ProjectReaderTests-19712737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de4a72d2-f210-4a04-852f-289d2c998021) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6adf0e9f-7c01-411e-baca-adedc1384679', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:12:48 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-acc4d1fb-8317-4491-8179-5cb0939eb522 tempest-ProjectReaderTests-19712737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4011894-6ebd-45de-87f4-a71d3481befa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:12:48 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-acc4d1fb-8317-4491-8179-5cb0939eb522 tempest-ProjectReaderTests-19712737 None] Volume volume-6adf0e9f-7c01-411e-baca-adedc1384679 (6adf0e9f-7c01-411e-baca-adedc1384679): created successfully Jul 10 16:12:48 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-acc4d1fb-8317-4491-8179-5cb0939eb522 tempest-ProjectReaderTests-19712737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4011894-6ebd-45de-87f4-a71d3481befa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:12:48 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-acc4d1fb-8317-4491-8179-5cb0939eb522 tempest-ProjectReaderTests-19712737 None] Flow 'volume_create_manager' (b4d9057c-4a05-4e4b-b19a-5e44fe769a78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:12:48 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-acc4d1fb-8317-4491-8179-5cb0939eb522 tempest-ProjectReaderTests-19712737 None] Created volume successfully. Jul 10 16:12:48 devstack sudo[106506]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:48 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-151e2e2c-e8e3-4f51-8079-13f4040562cd tempest-ProjectMemberTests-968602289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-115c8b34-a79a-40df-84f1-8cd12af6c1f7" returned: 0 in 0.819s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:48 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-151e2e2c-e8e3-4f51-8079-13f4040562cd tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-115c8b34-a79a-40df-84f1-8cd12af6c1f7.52cafee3-babc-458c-ac6f-fddceb4538f6 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:48 devstack sudo[106512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-115c8b34-a79a-40df-84f1-8cd12af6c1f7.52cafee3-babc-458c-ac6f-fddceb4538f6 Jul 10 16:12:48 devstack sudo[106512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:49 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-8a9c03e1-b72f-4b54-bf16-0a87910ad4fb tempest-ProjectReaderTests-19712737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:12:49 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-8a9c03e1-b72f-4b54-bf16-0a87910ad4fb tempest-ProjectReaderTests-19712737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:12:49 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-8a9c03e1-b72f-4b54-bf16-0a87910ad4fb tempest-ProjectReaderTests-19712737 None] Creating offline snapshot aee0743a-f056-4072-8d6d-6ba31b0ce16e of volume 6adf0e9f-7c01-411e-baca-adedc1384679 {{(pid=87420) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 16:12:49 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fb99467-5bed-481e-af23-f86718fd5aa9]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:12:49 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8a9c03e1-b72f-4b54-bf16-0a87910ad4fb tempest-ProjectReaderTests-19712737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6adf0e9f-7c01-411e-baca-adedc1384679 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:49 devstack sudo[106514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6adf0e9f-7c01-411e-baca-adedc1384679 Jul 10 16:12:49 devstack sudo[106514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:49 devstack sudo[106512]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:49 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-151e2e2c-e8e3-4f51-8079-13f4040562cd tempest-ProjectMemberTests-968602289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-115c8b34-a79a-40df-84f1-8cd12af6c1f7.52cafee3-babc-458c-ac6f-fddceb4538f6" returned: 0 in 0.804s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:49 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-151e2e2c-e8e3-4f51-8079-13f4040562cd tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-115c8b34-a79a-40df-84f1-8cd12af6c1f7.52cafee3-babc-458c-ac6f-fddceb4538f6 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:49 devstack sudo[106519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-115c8b34-a79a-40df-84f1-8cd12af6c1f7.52cafee3-babc-458c-ac6f-fddceb4538f6 Jul 10 16:12:49 devstack sudo[106519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:49 devstack sudo[106514]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:49 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8a9c03e1-b72f-4b54-bf16-0a87910ad4fb tempest-ProjectReaderTests-19712737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6adf0e9f-7c01-411e-baca-adedc1384679" returned: 0 in 0.796s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:49 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8a9c03e1-b72f-4b54-bf16-0a87910ad4fb tempest-ProjectReaderTests-19712737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6adf0e9f-7c01-411e-baca-adedc1384679,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6adf0e9f-7c01-411e-baca-adedc1384679.aee0743a-f056-4072-8d6d-6ba31b0ce16e 1G {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:49 devstack sudo[106524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6adf0e9f-7c01-411e-baca-adedc1384679,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6adf0e9f-7c01-411e-baca-adedc1384679.aee0743a-f056-4072-8d6d-6ba31b0ce16e 1G Jul 10 16:12:49 devstack sudo[106524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:50 devstack sudo[106519]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:50 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-151e2e2c-e8e3-4f51-8079-13f4040562cd tempest-ProjectMemberTests-968602289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-115c8b34-a79a-40df-84f1-8cd12af6c1f7.52cafee3-babc-458c-ac6f-fddceb4538f6" returned: 0 in 0.703s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:50 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-151e2e2c-e8e3-4f51-8079-13f4040562cd tempest-ProjectMemberTests-968602289 None] Lock "cinder-quobyte-52cafee3-babc-458c-ac6f-fddceb4538f6" released by "_delete_snapshot" :: held 3.295s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:12:50 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-151e2e2c-e8e3-4f51-8079-13f4040562cd tempest-ProjectMemberTests-968602289 None] Lock "cinder-quobyte-115c8b34-a79a-40df-84f1-8cd12af6c1f7" released by "delete_snapshot" :: held 3.322s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:12:50 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-151e2e2c-e8e3-4f51-8079-13f4040562cd tempest-ProjectMemberTests-968602289 None] Created reservations ['77bd8610-5154-47c8-a9a0-088341c3eba7', 'b8f2fcc0-b132-4450-9ca4-15a6391d2508', '39f6d2f2-c54d-42ab-b1c4-34bf97f1a81c', 'd1431f33-f2a8-43be-ade3-070e0560dbe1'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:12:50 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-151e2e2c-e8e3-4f51-8079-13f4040562cd tempest-ProjectMemberTests-968602289 None] Delete snapshot completed successfully. Jul 10 16:12:50 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-151e2e2c-e8e3-4f51-8079-13f4040562cd tempest-ProjectMemberTests-968602289 None] Lock "cinder-52cafee3-babc-458c-ac6f-fddceb4538f6-delete_snapshot" released by "delete_snapshot" :: held 3.494s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:12:50 devstack sudo[106524]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:50 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8a9c03e1-b72f-4b54-bf16-0a87910ad4fb tempest-ProjectReaderTests-19712737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6adf0e9f-7c01-411e-baca-adedc1384679,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6adf0e9f-7c01-411e-baca-adedc1384679.aee0743a-f056-4072-8d6d-6ba31b0ce16e 1G" returned: 0 in 0.905s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:50 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8a9c03e1-b72f-4b54-bf16-0a87910ad4fb tempest-ProjectReaderTests-19712737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6adf0e9f-7c01-411e-baca-adedc1384679 -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6adf0e9f-7c01-411e-baca-adedc1384679.aee0743a-f056-4072-8d6d-6ba31b0ce16e {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:50 devstack sudo[106531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6adf0e9f-7c01-411e-baca-adedc1384679 -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6adf0e9f-7c01-411e-baca-adedc1384679.aee0743a-f056-4072-8d6d-6ba31b0ce16e Jul 10 16:12:50 devstack sudo[106531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:51 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-c79ab1bd-96db-49d9-bba6-cbbda5e678c0 tempest-ProjectMemberTests-968602289 None] Acquiring lock "cinder-115c8b34-a79a-40df-84f1-8cd12af6c1f7-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:12:51 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-c79ab1bd-96db-49d9-bba6-cbbda5e678c0 tempest-ProjectMemberTests-968602289 None] Lock "cinder-115c8b34-a79a-40df-84f1-8cd12af6c1f7-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:12:51 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-c79ab1bd-96db-49d9-bba6-cbbda5e678c0 tempest-ProjectMemberTests-968602289 None] Acquiring lock "cinder-quobyte-115c8b34-a79a-40df-84f1-8cd12af6c1f7" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:12:51 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-c79ab1bd-96db-49d9-bba6-cbbda5e678c0 tempest-ProjectMemberTests-968602289 None] Lock "cinder-quobyte-115c8b34-a79a-40df-84f1-8cd12af6c1f7" acquired by "delete_volume" :: waited 0.015s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:12:51 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[588e7310-2209-46e8-92cd-58f2ad746c16]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:12:51 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c79ab1bd-96db-49d9-bba6-cbbda5e678c0 tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-115c8b34-a79a-40df-84f1-8cd12af6c1f7 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:51 devstack sudo[106531]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:51 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8a9c03e1-b72f-4b54-bf16-0a87910ad4fb tempest-ProjectReaderTests-19712737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6adf0e9f-7c01-411e-baca-adedc1384679 -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6adf0e9f-7c01-411e-baca-adedc1384679.aee0743a-f056-4072-8d6d-6ba31b0ce16e" returned: 0 in 0.812s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:51 devstack cinder-volume[87420]: WARNING cinder.volume.drivers.remotefs [None req-8a9c03e1-b72f-4b54-bf16-0a87910ad4fb tempest-ProjectReaderTests-19712737 None] /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6adf0e9f-7c01-411e-baca-adedc1384679.aee0743a-f056-4072-8d6d-6ba31b0ce16e is being set with open permissions: ugo+rw Jul 10 16:12:51 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8a9c03e1-b72f-4b54-bf16-0a87910ad4fb tempest-ProjectReaderTests-19712737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6adf0e9f-7c01-411e-baca-adedc1384679.aee0743a-f056-4072-8d6d-6ba31b0ce16e {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:51 devstack sudo[106537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6adf0e9f-7c01-411e-baca-adedc1384679.aee0743a-f056-4072-8d6d-6ba31b0ce16e Jul 10 16:12:51 devstack sudo[106537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:51 devstack sudo[106536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-115c8b34-a79a-40df-84f1-8cd12af6c1f7 Jul 10 16:12:51 devstack sudo[106536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:52 devstack sudo[106537]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:52 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8a9c03e1-b72f-4b54-bf16-0a87910ad4fb tempest-ProjectReaderTests-19712737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6adf0e9f-7c01-411e-baca-adedc1384679.aee0743a-f056-4072-8d6d-6ba31b0ce16e" returned: 0 in 0.699s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:52 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8a9c03e1-b72f-4b54-bf16-0a87910ad4fb tempest-ProjectReaderTests-19712737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6adf0e9f-7c01-411e-baca-adedc1384679.info {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:52 devstack sudo[106544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6adf0e9f-7c01-411e-baca-adedc1384679.info Jul 10 16:12:52 devstack sudo[106544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:52 devstack sudo[106536]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:52 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c79ab1bd-96db-49d9-bba6-cbbda5e678c0 tempest-ProjectMemberTests-968602289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-115c8b34-a79a-40df-84f1-8cd12af6c1f7" returned: 0 in 0.854s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:52 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c79ab1bd-96db-49d9-bba6-cbbda5e678c0 tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-115c8b34-a79a-40df-84f1-8cd12af6c1f7 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:52 devstack sudo[106546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-115c8b34-a79a-40df-84f1-8cd12af6c1f7 Jul 10 16:12:52 devstack sudo[106546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:53 devstack sudo[106544]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:53 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8a9c03e1-b72f-4b54-bf16-0a87910ad4fb tempest-ProjectReaderTests-19712737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6adf0e9f-7c01-411e-baca-adedc1384679.info" returned: 0 in 0.693s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:53 devstack cinder-volume[87420]: WARNING cinder.volume.drivers.remotefs [None req-8a9c03e1-b72f-4b54-bf16-0a87910ad4fb tempest-ProjectReaderTests-19712737 None] /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6adf0e9f-7c01-411e-baca-adedc1384679.info is being set with open permissions: ugo+rw Jul 10 16:12:53 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8a9c03e1-b72f-4b54-bf16-0a87910ad4fb tempest-ProjectReaderTests-19712737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6adf0e9f-7c01-411e-baca-adedc1384679.info {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:53 devstack sudo[106550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6adf0e9f-7c01-411e-baca-adedc1384679.info Jul 10 16:12:53 devstack sudo[106546]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:53 devstack sudo[106550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:53 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c79ab1bd-96db-49d9-bba6-cbbda5e678c0 tempest-ProjectMemberTests-968602289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-115c8b34-a79a-40df-84f1-8cd12af6c1f7" returned: 0 in 0.681s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:53 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-c79ab1bd-96db-49d9-bba6-cbbda5e678c0 tempest-ProjectMemberTests-968602289 None] Lock "cinder-quobyte-115c8b34-a79a-40df-84f1-8cd12af6c1f7" released by "delete_volume" :: held 1.611s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:12:53 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-c79ab1bd-96db-49d9-bba6-cbbda5e678c0 tempest-ProjectMemberTests-968602289 None] Created reservations ['a0bdfb49-ebd2-4186-95be-22fc508188af', 'b87fcbde-6008-4228-8e11-8636ed9b386c', '1f466df6-3a1d-4d20-998f-b18a88f6cf6d', '12ece6eb-a172-4590-8aab-d6dbbd7556ea'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:12:53 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-c79ab1bd-96db-49d9-bba6-cbbda5e678c0 tempest-ProjectMemberTests-968602289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:12:53 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-c79ab1bd-96db-49d9-bba6-cbbda5e678c0 tempest-ProjectMemberTests-968602289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:12:53 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-c79ab1bd-96db-49d9-bba6-cbbda5e678c0 tempest-ProjectMemberTests-968602289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:12:53 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-c79ab1bd-96db-49d9-bba6-cbbda5e678c0 tempest-ProjectMemberTests-968602289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:12:53 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-c79ab1bd-96db-49d9-bba6-cbbda5e678c0 tempest-ProjectMemberTests-968602289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:12:53 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c79ab1bd-96db-49d9-bba6-cbbda5e678c0 tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:53 devstack sudo[106552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:12:53 devstack sudo[106552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:53 devstack sudo[106550]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:53 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8a9c03e1-b72f-4b54-bf16-0a87910ad4fb tempest-ProjectReaderTests-19712737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6adf0e9f-7c01-411e-baca-adedc1384679.info" returned: 0 in 0.704s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:53 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-8a9c03e1-b72f-4b54-bf16-0a87910ad4fb tempest-ProjectReaderTests-19712737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.722s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:12:53 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-8a9c03e1-b72f-4b54-bf16-0a87910ad4fb tempest-ProjectReaderTests-19712737 None] Create snapshot completed successfully Jul 10 16:12:53 devstack sudo[106552]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:54 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c79ab1bd-96db-49d9-bba6-cbbda5e678c0 tempest-ProjectMemberTests-968602289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.770s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:54 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-c79ab1bd-96db-49d9-bba6-cbbda5e678c0 tempest-ProjectMemberTests-968602289 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:12:54 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-c79ab1bd-96db-49d9-bba6-cbbda5e678c0 tempest-ProjectMemberTests-968602289 None] Deleted volume successfully. Jul 10 16:12:54 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-c79ab1bd-96db-49d9-bba6-cbbda5e678c0 tempest-ProjectMemberTests-968602289 None] Lock "cinder-115c8b34-a79a-40df-84f1-8cd12af6c1f7-delete_volume" released by "delete_volume" :: held 2.633s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:12:54 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-c34712fd-f562-4d7f-bb73-b279a93afb99 tempest-ProjectMemberTests-968602289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 16:12:54 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c34712fd-f562-4d7f-bb73-b279a93afb99 tempest-ProjectMemberTests-968602289 None] Flow 'volume_create_manager' (e7759f3f-1d00-474a-bc17-c69ab7c54e1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:12:54 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c34712fd-f562-4d7f-bb73-b279a93afb99 tempest-ProjectMemberTests-968602289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0ca78c7-0a66-4c21-8024-5f105fbb4fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:12:54 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-8f1258b5-3195-4244-a7f8-350bbcb151a5 tempest-ProjectReaderTests-19712737 None] Acquiring lock "cinder-aee0743a-f056-4072-8d6d-6ba31b0ce16e-delete_snapshot" by "delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:12:54 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c34712fd-f562-4d7f-bb73-b279a93afb99 tempest-ProjectMemberTests-968602289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0ca78c7-0a66-4c21-8024-5f105fbb4fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:12:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-815518211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c33765df-a722-4be2-9f84-97d92b627e61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a62b0a8c6e6a4e9a9b6772e9c7ee6af3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:12:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:12:54Z,use_quota=True,user_id='1a439b56b94841c39eb4e94d953ccde8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:12:54 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c34712fd-f562-4d7f-bb73-b279a93afb99 tempest-ProjectMemberTests-968602289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (673698ee-0b20-454e-b222-89214bf73408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:12:54 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c34712fd-f562-4d7f-bb73-b279a93afb99 tempest-ProjectMemberTests-968602289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (673698ee-0b20-454e-b222-89214bf73408) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:12:54 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c34712fd-f562-4d7f-bb73-b279a93afb99 tempest-ProjectMemberTests-968602289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4f10ac6-4133-419d-9239-59d04576f086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:12:54 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c34712fd-f562-4d7f-bb73-b279a93afb99 tempest-ProjectMemberTests-968602289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4f10ac6-4133-419d-9239-59d04576f086) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c33765df-a722-4be2-9f84-97d92b627e61', 'volume_name': 'volume-c33765df-a722-4be2-9f84-97d92b627e61', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:12:54 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c34712fd-f562-4d7f-bb73-b279a93afb99 tempest-ProjectMemberTests-968602289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cf24517-3777-4eed-a2db-61339c3bb396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:12:54 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c34712fd-f562-4d7f-bb73-b279a93afb99 tempest-ProjectMemberTests-968602289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cf24517-3777-4eed-a2db-61339c3bb396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:12:54 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c34712fd-f562-4d7f-bb73-b279a93afb99 tempest-ProjectMemberTests-968602289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6feb7f8-e2ad-44b4-9603-f428b4042b99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:12:54 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-c34712fd-f562-4d7f-bb73-b279a93afb99 tempest-ProjectMemberTests-968602289 None] Volume c33765df-a722-4be2-9f84-97d92b627e61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c33765df-a722-4be2-9f84-97d92b627e61', 'volume_size': 1} Jul 10 16:12:54 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-c34712fd-f562-4d7f-bb73-b279a93afb99 tempest-ProjectMemberTests-968602289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:12:54 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-c34712fd-f562-4d7f-bb73-b279a93afb99 tempest-ProjectMemberTests-968602289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:12:54 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-c34712fd-f562-4d7f-bb73-b279a93afb99 tempest-ProjectMemberTests-968602289 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:12:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-815518211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c33765df-a722-4be2-9f84-97d92b627e61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a62b0a8c6e6a4e9a9b6772e9c7ee6af3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:12:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:12:54Z,use_quota=True,user_id='1a439b56b94841c39eb4e94d953ccde8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 16:12:54 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-c34712fd-f562-4d7f-bb73-b279a93afb99 tempest-ProjectMemberTests-968602289 None] Creating volume c33765df-a722-4be2-9f84-97d92b627e61 {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 16:12:54 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-c34712fd-f562-4d7f-bb73-b279a93afb99 tempest-ProjectMemberTests-968602289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:12:54 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-c34712fd-f562-4d7f-bb73-b279a93afb99 tempest-ProjectMemberTests-968602289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:12:54 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-c34712fd-f562-4d7f-bb73-b279a93afb99 tempest-ProjectMemberTests-968602289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:12:54 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-c34712fd-f562-4d7f-bb73-b279a93afb99 tempest-ProjectMemberTests-968602289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:12:54 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-c34712fd-f562-4d7f-bb73-b279a93afb99 tempest-ProjectMemberTests-968602289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:12:54 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-c34712fd-f562-4d7f-bb73-b279a93afb99 tempest-ProjectMemberTests-968602289 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 16:12:54 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-c34712fd-f562-4d7f-bb73-b279a93afb99 tempest-ProjectMemberTests-968602289 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 16:12:54 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c34712fd-f562-4d7f-bb73-b279a93afb99 tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-c33765df-a722-4be2-9f84-97d92b627e61 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:54 devstack sudo[106557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-c33765df-a722-4be2-9f84-97d92b627e61 1073741824 Jul 10 16:12:54 devstack sudo[106557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:54 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-8f1258b5-3195-4244-a7f8-350bbcb151a5 tempest-ProjectReaderTests-19712737 None] Lock "cinder-aee0743a-f056-4072-8d6d-6ba31b0ce16e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.107s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:12:54 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-8f1258b5-3195-4244-a7f8-350bbcb151a5 tempest-ProjectReaderTests-19712737 None] Acquiring lock "cinder-quobyte-6adf0e9f-7c01-411e-baca-adedc1384679" by "delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:12:54 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-8f1258b5-3195-4244-a7f8-350bbcb151a5 tempest-ProjectReaderTests-19712737 None] Lock "cinder-quobyte-6adf0e9f-7c01-411e-baca-adedc1384679" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:12:54 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-8f1258b5-3195-4244-a7f8-350bbcb151a5 tempest-ProjectReaderTests-19712737 None] Acquiring lock "cinder-quobyte-aee0743a-f056-4072-8d6d-6ba31b0ce16e" by "_delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:12:54 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-8f1258b5-3195-4244-a7f8-350bbcb151a5 tempest-ProjectReaderTests-19712737 None] Lock "cinder-quobyte-aee0743a-f056-4072-8d6d-6ba31b0ce16e" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:12:54 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-8f1258b5-3195-4244-a7f8-350bbcb151a5 tempest-ProjectReaderTests-19712737 None] Deleting offline snapshot aee0743a-f056-4072-8d6d-6ba31b0ce16e of volume 6adf0e9f-7c01-411e-baca-adedc1384679 {{(pid=87420) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 16:12:54 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-8f1258b5-3195-4244-a7f8-350bbcb151a5 tempest-ProjectReaderTests-19712737 None] snapshot_file for this snap is: volume-6adf0e9f-7c01-411e-baca-adedc1384679.aee0743a-f056-4072-8d6d-6ba31b0ce16e {{(pid=87420) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 16:12:54 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[38141674-58be-4ca5-aa78-bc21881cd1f1]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:12:54 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8f1258b5-3195-4244-a7f8-350bbcb151a5 tempest-ProjectReaderTests-19712737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6adf0e9f-7c01-411e-baca-adedc1384679.aee0743a-f056-4072-8d6d-6ba31b0ce16e {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:54 devstack sudo[106559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6adf0e9f-7c01-411e-baca-adedc1384679.aee0743a-f056-4072-8d6d-6ba31b0ce16e Jul 10 16:12:54 devstack sudo[106559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:55 devstack sudo[106557]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:55 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c34712fd-f562-4d7f-bb73-b279a93afb99 tempest-ProjectMemberTests-968602289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-c33765df-a722-4be2-9f84-97d92b627e61 1073741824" returned: 0 in 0.989s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:55 devstack sudo[106559]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:55 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8f1258b5-3195-4244-a7f8-350bbcb151a5 tempest-ProjectReaderTests-19712737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6adf0e9f-7c01-411e-baca-adedc1384679.aee0743a-f056-4072-8d6d-6ba31b0ce16e" returned: 0 in 0.878s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:55 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-8f1258b5-3195-4244-a7f8-350bbcb151a5 tempest-ProjectReaderTests-19712737 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6adf0e9f-7c01-411e-baca-adedc1384679(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87420) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 16:12:55 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c34712fd-f562-4d7f-bb73-b279a93afb99 tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-c33765df-a722-4be2-9f84-97d92b627e61 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:55 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b962baa-c42b-4d59-975f-80a9ff8343d0]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:12:55 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8f1258b5-3195-4244-a7f8-350bbcb151a5 tempest-ProjectReaderTests-19712737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6adf0e9f-7c01-411e-baca-adedc1384679 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:55 devstack sudo[106568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-c33765df-a722-4be2-9f84-97d92b627e61 Jul 10 16:12:55 devstack sudo[106568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:55 devstack sudo[106569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6adf0e9f-7c01-411e-baca-adedc1384679 Jul 10 16:12:55 devstack sudo[106569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:56 devstack sudo[106568]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:56 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c34712fd-f562-4d7f-bb73-b279a93afb99 tempest-ProjectMemberTests-968602289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-c33765df-a722-4be2-9f84-97d92b627e61" returned: 0 in 0.782s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:56 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-c34712fd-f562-4d7f-bb73-b279a93afb99 tempest-ProjectMemberTests-968602289 None] <== create_volume: return (1839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 16:12:56 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-c34712fd-f562-4d7f-bb73-b279a93afb99 tempest-ProjectMemberTests-968602289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.844s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:12:56 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c34712fd-f562-4d7f-bb73-b279a93afb99 tempest-ProjectMemberTests-968602289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6feb7f8-e2ad-44b4-9603-f428b4042b99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c33765df-a722-4be2-9f84-97d92b627e61', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:12:56 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c34712fd-f562-4d7f-bb73-b279a93afb99 tempest-ProjectMemberTests-968602289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0a93c5f-b060-45ef-a802-f37557df5c02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:12:56 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-c34712fd-f562-4d7f-bb73-b279a93afb99 tempest-ProjectMemberTests-968602289 None] Volume volume-c33765df-a722-4be2-9f84-97d92b627e61 (c33765df-a722-4be2-9f84-97d92b627e61): created successfully Jul 10 16:12:56 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c34712fd-f562-4d7f-bb73-b279a93afb99 tempest-ProjectMemberTests-968602289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0a93c5f-b060-45ef-a802-f37557df5c02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:12:56 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-c34712fd-f562-4d7f-bb73-b279a93afb99 tempest-ProjectMemberTests-968602289 None] Flow 'volume_create_manager' (e7759f3f-1d00-474a-bc17-c69ab7c54e1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:12:56 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-c34712fd-f562-4d7f-bb73-b279a93afb99 tempest-ProjectMemberTests-968602289 None] Created volume successfully. Jul 10 16:12:56 devstack sudo[106569]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:56 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8f1258b5-3195-4244-a7f8-350bbcb151a5 tempest-ProjectReaderTests-19712737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6adf0e9f-7c01-411e-baca-adedc1384679" returned: 0 in 0.885s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:56 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8f1258b5-3195-4244-a7f8-350bbcb151a5 tempest-ProjectReaderTests-19712737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6adf0e9f-7c01-411e-baca-adedc1384679.aee0743a-f056-4072-8d6d-6ba31b0ce16e {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:56 devstack sudo[106577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6adf0e9f-7c01-411e-baca-adedc1384679.aee0743a-f056-4072-8d6d-6ba31b0ce16e Jul 10 16:12:56 devstack sudo[106577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:57 devstack sudo[106577]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:57 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8f1258b5-3195-4244-a7f8-350bbcb151a5 tempest-ProjectReaderTests-19712737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6adf0e9f-7c01-411e-baca-adedc1384679.aee0743a-f056-4072-8d6d-6ba31b0ce16e" returned: 0 in 0.776s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:57 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8f1258b5-3195-4244-a7f8-350bbcb151a5 tempest-ProjectReaderTests-19712737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6adf0e9f-7c01-411e-baca-adedc1384679.aee0743a-f056-4072-8d6d-6ba31b0ce16e {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:57 devstack sudo[106582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6adf0e9f-7c01-411e-baca-adedc1384679.aee0743a-f056-4072-8d6d-6ba31b0ce16e Jul 10 16:12:57 devstack sudo[106582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:57 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-372f9161-8bf0-44f4-9a29-1655ecd6d409 tempest-ProjectMemberTests-968602289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:12:57 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-372f9161-8bf0-44f4-9a29-1655ecd6d409 tempest-ProjectMemberTests-968602289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:12:57 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-372f9161-8bf0-44f4-9a29-1655ecd6d409 tempest-ProjectMemberTests-968602289 None] Creating offline snapshot fe410870-9554-42b3-8c32-d18d9d268de3 of volume c33765df-a722-4be2-9f84-97d92b627e61 {{(pid=87420) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 16:12:57 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcfa235f-6b5a-4185-8c76-93db56573b79]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:12:57 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-372f9161-8bf0-44f4-9a29-1655ecd6d409 tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-c33765df-a722-4be2-9f84-97d92b627e61 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:57 devstack sudo[106584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-c33765df-a722-4be2-9f84-97d92b627e61 Jul 10 16:12:57 devstack sudo[106584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:57 devstack sudo[106582]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:57 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8f1258b5-3195-4244-a7f8-350bbcb151a5 tempest-ProjectReaderTests-19712737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6adf0e9f-7c01-411e-baca-adedc1384679.aee0743a-f056-4072-8d6d-6ba31b0ce16e" returned: 0 in 0.721s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:57 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-8f1258b5-3195-4244-a7f8-350bbcb151a5 tempest-ProjectReaderTests-19712737 None] Lock "cinder-quobyte-aee0743a-f056-4072-8d6d-6ba31b0ce16e" released by "_delete_snapshot" :: held 3.402s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:12:57 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-8f1258b5-3195-4244-a7f8-350bbcb151a5 tempest-ProjectReaderTests-19712737 None] Lock "cinder-quobyte-6adf0e9f-7c01-411e-baca-adedc1384679" released by "delete_snapshot" :: held 3.430s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:12:57 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-8f1258b5-3195-4244-a7f8-350bbcb151a5 tempest-ProjectReaderTests-19712737 None] Created reservations ['e5b5a1a2-534c-4cf0-9bfd-e31b8af64a04', '3156de74-7e29-48e9-a544-dc01549c365f', '1092ed15-f420-4a8e-aed3-f9f33846cb94', 'e72b6241-e05e-4aeb-ac77-6f8f0c4f93ec'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:12:57 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-8f1258b5-3195-4244-a7f8-350bbcb151a5 tempest-ProjectReaderTests-19712737 None] Delete snapshot completed successfully. Jul 10 16:12:58 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-8f1258b5-3195-4244-a7f8-350bbcb151a5 tempest-ProjectReaderTests-19712737 None] Lock "cinder-aee0743a-f056-4072-8d6d-6ba31b0ce16e-delete_snapshot" released by "delete_snapshot" :: held 3.600s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:12:58 devstack sudo[106584]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:58 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-372f9161-8bf0-44f4-9a29-1655ecd6d409 tempest-ProjectMemberTests-968602289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-c33765df-a722-4be2-9f84-97d92b627e61" returned: 0 in 0.809s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:58 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-372f9161-8bf0-44f4-9a29-1655ecd6d409 tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-c33765df-a722-4be2-9f84-97d92b627e61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-c33765df-a722-4be2-9f84-97d92b627e61.fe410870-9554-42b3-8c32-d18d9d268de3 1G {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:58 devstack sudo[106590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-c33765df-a722-4be2-9f84-97d92b627e61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-c33765df-a722-4be2-9f84-97d92b627e61.fe410870-9554-42b3-8c32-d18d9d268de3 1G Jul 10 16:12:58 devstack sudo[106590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:58 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-03cb14db-9ab1-4c24-8f19-072c0ee00b73 tempest-ProjectReaderTests-19712737 None] Acquiring lock "cinder-6adf0e9f-7c01-411e-baca-adedc1384679-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:12:58 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-03cb14db-9ab1-4c24-8f19-072c0ee00b73 tempest-ProjectReaderTests-19712737 None] Lock "cinder-6adf0e9f-7c01-411e-baca-adedc1384679-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:12:58 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-03cb14db-9ab1-4c24-8f19-072c0ee00b73 tempest-ProjectReaderTests-19712737 None] Acquiring lock "cinder-quobyte-6adf0e9f-7c01-411e-baca-adedc1384679" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:12:58 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-03cb14db-9ab1-4c24-8f19-072c0ee00b73 tempest-ProjectReaderTests-19712737 None] Lock "cinder-quobyte-6adf0e9f-7c01-411e-baca-adedc1384679" acquired by "delete_volume" :: waited 0.023s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:12:58 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[e961f4e6-359c-450a-9052-12d4f15211bb]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:12:58 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-03cb14db-9ab1-4c24-8f19-072c0ee00b73 tempest-ProjectReaderTests-19712737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6adf0e9f-7c01-411e-baca-adedc1384679 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:58 devstack sudo[106592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6adf0e9f-7c01-411e-baca-adedc1384679 Jul 10 16:12:58 devstack sudo[106592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:59 devstack sudo[106590]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:59 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-372f9161-8bf0-44f4-9a29-1655ecd6d409 tempest-ProjectMemberTests-968602289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-c33765df-a722-4be2-9f84-97d92b627e61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-c33765df-a722-4be2-9f84-97d92b627e61.fe410870-9554-42b3-8c32-d18d9d268de3 1G" returned: 0 in 0.917s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:59 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-372f9161-8bf0-44f4-9a29-1655ecd6d409 tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c33765df-a722-4be2-9f84-97d92b627e61 -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-c33765df-a722-4be2-9f84-97d92b627e61.fe410870-9554-42b3-8c32-d18d9d268de3 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:59 devstack sudo[106598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c33765df-a722-4be2-9f84-97d92b627e61 -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-c33765df-a722-4be2-9f84-97d92b627e61.fe410870-9554-42b3-8c32-d18d9d268de3 Jul 10 16:12:59 devstack sudo[106598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:12:59 devstack sudo[106592]: pam_unix(sudo:session): session closed for user root Jul 10 16:12:59 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-03cb14db-9ab1-4c24-8f19-072c0ee00b73 tempest-ProjectReaderTests-19712737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6adf0e9f-7c01-411e-baca-adedc1384679" returned: 0 in 0.818s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:12:59 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-03cb14db-9ab1-4c24-8f19-072c0ee00b73 tempest-ProjectReaderTests-19712737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6adf0e9f-7c01-411e-baca-adedc1384679 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:12:59 devstack sudo[106603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6adf0e9f-7c01-411e-baca-adedc1384679 Jul 10 16:12:59 devstack sudo[106603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:13:00 devstack sudo[106598]: pam_unix(sudo:session): session closed for user root Jul 10 16:13:00 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-372f9161-8bf0-44f4-9a29-1655ecd6d409 tempest-ProjectMemberTests-968602289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c33765df-a722-4be2-9f84-97d92b627e61 -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-c33765df-a722-4be2-9f84-97d92b627e61.fe410870-9554-42b3-8c32-d18d9d268de3" returned: 0 in 0.754s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:13:00 devstack cinder-volume[87420]: WARNING cinder.volume.drivers.remotefs [None req-372f9161-8bf0-44f4-9a29-1655ecd6d409 tempest-ProjectMemberTests-968602289 None] /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-c33765df-a722-4be2-9f84-97d92b627e61.fe410870-9554-42b3-8c32-d18d9d268de3 is being set with open permissions: ugo+rw Jul 10 16:13:00 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-372f9161-8bf0-44f4-9a29-1655ecd6d409 tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-c33765df-a722-4be2-9f84-97d92b627e61.fe410870-9554-42b3-8c32-d18d9d268de3 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:13:00 devstack sudo[106609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-c33765df-a722-4be2-9f84-97d92b627e61.fe410870-9554-42b3-8c32-d18d9d268de3 Jul 10 16:13:00 devstack sudo[106609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:13:00 devstack sudo[106603]: pam_unix(sudo:session): session closed for user root Jul 10 16:13:00 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-03cb14db-9ab1-4c24-8f19-072c0ee00b73 tempest-ProjectReaderTests-19712737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-6adf0e9f-7c01-411e-baca-adedc1384679" returned: 0 in 0.672s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:13:00 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-03cb14db-9ab1-4c24-8f19-072c0ee00b73 tempest-ProjectReaderTests-19712737 None] Lock "cinder-quobyte-6adf0e9f-7c01-411e-baca-adedc1384679" released by "delete_volume" :: held 1.573s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:13:00 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-03cb14db-9ab1-4c24-8f19-072c0ee00b73 tempest-ProjectReaderTests-19712737 None] Created reservations ['62163e65-e6cb-4535-8cc4-0153e2a25fd8', '057447ba-1379-490c-b926-63dc56146bf4', 'cf937d59-5c23-4e2a-8a0b-95a2ef15cc50', 'c376a521-a9d4-4102-8cd9-da3f396722e7'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:13:00 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-03cb14db-9ab1-4c24-8f19-072c0ee00b73 tempest-ProjectReaderTests-19712737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:13:00 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-03cb14db-9ab1-4c24-8f19-072c0ee00b73 tempest-ProjectReaderTests-19712737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:13:00 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-03cb14db-9ab1-4c24-8f19-072c0ee00b73 tempest-ProjectReaderTests-19712737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:13:00 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-03cb14db-9ab1-4c24-8f19-072c0ee00b73 tempest-ProjectReaderTests-19712737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:13:00 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-03cb14db-9ab1-4c24-8f19-072c0ee00b73 tempest-ProjectReaderTests-19712737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:13:00 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-03cb14db-9ab1-4c24-8f19-072c0ee00b73 tempest-ProjectReaderTests-19712737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:13:00 devstack sudo[106611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:13:00 devstack sudo[106611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:13:00 devstack sudo[106609]: pam_unix(sudo:session): session closed for user root Jul 10 16:13:00 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-372f9161-8bf0-44f4-9a29-1655ecd6d409 tempest-ProjectMemberTests-968602289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-c33765df-a722-4be2-9f84-97d92b627e61.fe410870-9554-42b3-8c32-d18d9d268de3" returned: 0 in 0.837s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:13:00 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-372f9161-8bf0-44f4-9a29-1655ecd6d409 tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-c33765df-a722-4be2-9f84-97d92b627e61.info {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:13:01 devstack sudo[106615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-c33765df-a722-4be2-9f84-97d92b627e61.info Jul 10 16:13:01 devstack sudo[106615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:13:01 devstack sudo[106611]: pam_unix(sudo:session): session closed for user root Jul 10 16:13:01 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-03cb14db-9ab1-4c24-8f19-072c0ee00b73 tempest-ProjectReaderTests-19712737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.761s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:13:01 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-03cb14db-9ab1-4c24-8f19-072c0ee00b73 tempest-ProjectReaderTests-19712737 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:13:01 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-03cb14db-9ab1-4c24-8f19-072c0ee00b73 tempest-ProjectReaderTests-19712737 None] Deleted volume successfully. Jul 10 16:13:01 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-03cb14db-9ab1-4c24-8f19-072c0ee00b73 tempest-ProjectReaderTests-19712737 None] Lock "cinder-6adf0e9f-7c01-411e-baca-adedc1384679-delete_volume" released by "delete_volume" :: held 2.574s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:13:01 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7e90003-41c7-4b19-abb1-07c834e326bc tempest-ProjectReaderTests-19712737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 16:13:01 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d7e90003-41c7-4b19-abb1-07c834e326bc tempest-ProjectReaderTests-19712737 None] Flow 'volume_create_manager' (54f5ad33-e7eb-41bb-8802-8aea5fd90bc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:13:01 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d7e90003-41c7-4b19-abb1-07c834e326bc tempest-ProjectReaderTests-19712737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5885c342-a94c-4f27-9c9e-3e8817388a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:13:01 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d7e90003-41c7-4b19-abb1-07c834e326bc tempest-ProjectReaderTests-19712737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5885c342-a94c-4f27-9c9e-3e8817388a26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:13:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-589264207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=135ee875-fe4e-4129-bb73-5d0cfe04487e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3216e7ae39094a2295e8ea00806db82b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:13:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:13:01Z,use_quota=True,user_id='52679baac65041bb9ce548ee3dd7269c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:13:01 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d7e90003-41c7-4b19-abb1-07c834e326bc tempest-ProjectReaderTests-19712737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15b84303-ad1a-48c6-9710-9815a7ff3443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:13:01 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d7e90003-41c7-4b19-abb1-07c834e326bc tempest-ProjectReaderTests-19712737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15b84303-ad1a-48c6-9710-9815a7ff3443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:13:01 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d7e90003-41c7-4b19-abb1-07c834e326bc tempest-ProjectReaderTests-19712737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b181eef-8666-4ebd-9d06-de4deed32e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:13:01 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d7e90003-41c7-4b19-abb1-07c834e326bc tempest-ProjectReaderTests-19712737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b181eef-8666-4ebd-9d06-de4deed32e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '135ee875-fe4e-4129-bb73-5d0cfe04487e', 'volume_name': 'volume-135ee875-fe4e-4129-bb73-5d0cfe04487e', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:13:01 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d7e90003-41c7-4b19-abb1-07c834e326bc tempest-ProjectReaderTests-19712737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f068ed7-bad4-484d-8933-f7ffd91f784b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:13:01 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d7e90003-41c7-4b19-abb1-07c834e326bc tempest-ProjectReaderTests-19712737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f068ed7-bad4-484d-8933-f7ffd91f784b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:13:01 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d7e90003-41c7-4b19-abb1-07c834e326bc tempest-ProjectReaderTests-19712737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7186724-c6be-40cd-aff7-0c51f3e63ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:13:01 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-d7e90003-41c7-4b19-abb1-07c834e326bc tempest-ProjectReaderTests-19712737 None] Volume 135ee875-fe4e-4129-bb73-5d0cfe04487e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-135ee875-fe4e-4129-bb73-5d0cfe04487e', 'volume_size': 1} Jul 10 16:13:01 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-d7e90003-41c7-4b19-abb1-07c834e326bc tempest-ProjectReaderTests-19712737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:13:01 devstack sudo[106615]: pam_unix(sudo:session): session closed for user root Jul 10 16:13:01 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-372f9161-8bf0-44f4-9a29-1655ecd6d409 tempest-ProjectMemberTests-968602289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-c33765df-a722-4be2-9f84-97d92b627e61.info" returned: 0 in 0.799s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:13:01 devstack cinder-volume[87420]: WARNING cinder.volume.drivers.remotefs [None req-372f9161-8bf0-44f4-9a29-1655ecd6d409 tempest-ProjectMemberTests-968602289 None] /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-c33765df-a722-4be2-9f84-97d92b627e61.info is being set with open permissions: ugo+rw Jul 10 16:13:01 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-372f9161-8bf0-44f4-9a29-1655ecd6d409 tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-c33765df-a722-4be2-9f84-97d92b627e61.info {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:13:01 devstack sudo[106618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-c33765df-a722-4be2-9f84-97d92b627e61.info Jul 10 16:13:01 devstack sudo[106618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:13:02 devstack sudo[106618]: pam_unix(sudo:session): session closed for user root Jul 10 16:13:02 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-372f9161-8bf0-44f4-9a29-1655ecd6d409 tempest-ProjectMemberTests-968602289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-c33765df-a722-4be2-9f84-97d92b627e61.info" returned: 0 in 0.651s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:13:02 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-372f9161-8bf0-44f4-9a29-1655ecd6d409 tempest-ProjectMemberTests-968602289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.857s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:13:02 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-d7e90003-41c7-4b19-abb1-07c834e326bc tempest-ProjectReaderTests-19712737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.914s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:13:02 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-d7e90003-41c7-4b19-abb1-07c834e326bc tempest-ProjectReaderTests-19712737 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:13:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-589264207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=135ee875-fe4e-4129-bb73-5d0cfe04487e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3216e7ae39094a2295e8ea00806db82b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:13:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:13:01Z,use_quota=True,user_id='52679baac65041bb9ce548ee3dd7269c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 16:13:02 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-d7e90003-41c7-4b19-abb1-07c834e326bc tempest-ProjectReaderTests-19712737 None] Creating volume 135ee875-fe4e-4129-bb73-5d0cfe04487e {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 16:13:02 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-d7e90003-41c7-4b19-abb1-07c834e326bc tempest-ProjectReaderTests-19712737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:13:02 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-d7e90003-41c7-4b19-abb1-07c834e326bc tempest-ProjectReaderTests-19712737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:13:02 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-d7e90003-41c7-4b19-abb1-07c834e326bc tempest-ProjectReaderTests-19712737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:13:02 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-d7e90003-41c7-4b19-abb1-07c834e326bc tempest-ProjectReaderTests-19712737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:13:02 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-d7e90003-41c7-4b19-abb1-07c834e326bc tempest-ProjectReaderTests-19712737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:13:02 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-d7e90003-41c7-4b19-abb1-07c834e326bc tempest-ProjectReaderTests-19712737 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 16:13:02 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-d7e90003-41c7-4b19-abb1-07c834e326bc tempest-ProjectReaderTests-19712737 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 16:13:02 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d7e90003-41c7-4b19-abb1-07c834e326bc tempest-ProjectReaderTests-19712737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-135ee875-fe4e-4129-bb73-5d0cfe04487e 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:13:02 devstack sudo[106621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-135ee875-fe4e-4129-bb73-5d0cfe04487e 1073741824 Jul 10 16:13:02 devstack sudo[106621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:13:02 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-372f9161-8bf0-44f4-9a29-1655ecd6d409 tempest-ProjectMemberTests-968602289 None] Create snapshot completed successfully Jul 10 16:13:02 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-5b3cef94-4b34-4222-8284-743a6b57d7ab tempest-ProjectMemberTests-968602289 None] Acquiring lock "cinder-fe410870-9554-42b3-8c32-d18d9d268de3-delete_snapshot" by "delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:13:02 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-5b3cef94-4b34-4222-8284-743a6b57d7ab tempest-ProjectMemberTests-968602289 None] Lock "cinder-fe410870-9554-42b3-8c32-d18d9d268de3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:13:02 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-5b3cef94-4b34-4222-8284-743a6b57d7ab tempest-ProjectMemberTests-968602289 None] Acquiring lock "cinder-quobyte-c33765df-a722-4be2-9f84-97d92b627e61" by "delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:13:02 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-5b3cef94-4b34-4222-8284-743a6b57d7ab tempest-ProjectMemberTests-968602289 None] Lock "cinder-quobyte-c33765df-a722-4be2-9f84-97d92b627e61" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:13:02 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-5b3cef94-4b34-4222-8284-743a6b57d7ab tempest-ProjectMemberTests-968602289 None] Acquiring lock "cinder-quobyte-fe410870-9554-42b3-8c32-d18d9d268de3" by "_delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:13:02 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-5b3cef94-4b34-4222-8284-743a6b57d7ab tempest-ProjectMemberTests-968602289 None] Lock "cinder-quobyte-fe410870-9554-42b3-8c32-d18d9d268de3" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:13:02 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-5b3cef94-4b34-4222-8284-743a6b57d7ab tempest-ProjectMemberTests-968602289 None] Deleting offline snapshot fe410870-9554-42b3-8c32-d18d9d268de3 of volume c33765df-a722-4be2-9f84-97d92b627e61 {{(pid=87420) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 16:13:02 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-5b3cef94-4b34-4222-8284-743a6b57d7ab tempest-ProjectMemberTests-968602289 None] snapshot_file for this snap is: volume-c33765df-a722-4be2-9f84-97d92b627e61.fe410870-9554-42b3-8c32-d18d9d268de3 {{(pid=87420) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 16:13:02 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[34929291-f326-4613-b4d7-ff289fa2165b]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:13:02 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-5b3cef94-4b34-4222-8284-743a6b57d7ab tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-c33765df-a722-4be2-9f84-97d92b627e61.fe410870-9554-42b3-8c32-d18d9d268de3 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:13:03 devstack sudo[106623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-c33765df-a722-4be2-9f84-97d92b627e61.fe410870-9554-42b3-8c32-d18d9d268de3 Jul 10 16:13:03 devstack sudo[106623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:13:03 devstack sudo[106621]: pam_unix(sudo:session): session closed for user root Jul 10 16:13:03 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d7e90003-41c7-4b19-abb1-07c834e326bc tempest-ProjectReaderTests-19712737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-135ee875-fe4e-4129-bb73-5d0cfe04487e 1073741824" returned: 0 in 0.825s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:13:03 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d7e90003-41c7-4b19-abb1-07c834e326bc tempest-ProjectReaderTests-19712737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-135ee875-fe4e-4129-bb73-5d0cfe04487e {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:13:03 devstack sudo[106628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-135ee875-fe4e-4129-bb73-5d0cfe04487e Jul 10 16:13:03 devstack sudo[106628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:13:03 devstack sudo[106623]: pam_unix(sudo:session): session closed for user root Jul 10 16:13:03 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-5b3cef94-4b34-4222-8284-743a6b57d7ab tempest-ProjectMemberTests-968602289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-c33765df-a722-4be2-9f84-97d92b627e61.fe410870-9554-42b3-8c32-d18d9d268de3" returned: 0 in 0.767s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:13:03 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-5b3cef94-4b34-4222-8284-743a6b57d7ab tempest-ProjectMemberTests-968602289 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c33765df-a722-4be2-9f84-97d92b627e61(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87420) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 16:13:03 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[09a30174-1979-4045-a7d7-3ec328b6e8fc]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:13:03 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-5b3cef94-4b34-4222-8284-743a6b57d7ab tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-c33765df-a722-4be2-9f84-97d92b627e61 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:13:03 devstack sudo[106634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-c33765df-a722-4be2-9f84-97d92b627e61 Jul 10 16:13:03 devstack sudo[106634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:13:03 devstack sudo[106628]: pam_unix(sudo:session): session closed for user root Jul 10 16:13:03 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d7e90003-41c7-4b19-abb1-07c834e326bc tempest-ProjectReaderTests-19712737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-135ee875-fe4e-4129-bb73-5d0cfe04487e" returned: 0 in 0.689s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:13:03 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-d7e90003-41c7-4b19-abb1-07c834e326bc tempest-ProjectReaderTests-19712737 None] <== create_volume: return (1554ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 16:13:03 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-d7e90003-41c7-4b19-abb1-07c834e326bc tempest-ProjectReaderTests-19712737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.557s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:13:04 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d7e90003-41c7-4b19-abb1-07c834e326bc tempest-ProjectReaderTests-19712737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7186724-c6be-40cd-aff7-0c51f3e63ec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-135ee875-fe4e-4129-bb73-5d0cfe04487e', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:13:04 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d7e90003-41c7-4b19-abb1-07c834e326bc tempest-ProjectReaderTests-19712737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (903db5f9-ed75-423d-a3a5-2634247c162a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:13:04 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-d7e90003-41c7-4b19-abb1-07c834e326bc tempest-ProjectReaderTests-19712737 None] Volume volume-135ee875-fe4e-4129-bb73-5d0cfe04487e (135ee875-fe4e-4129-bb73-5d0cfe04487e): created successfully Jul 10 16:13:04 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d7e90003-41c7-4b19-abb1-07c834e326bc tempest-ProjectReaderTests-19712737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (903db5f9-ed75-423d-a3a5-2634247c162a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:13:04 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d7e90003-41c7-4b19-abb1-07c834e326bc tempest-ProjectReaderTests-19712737 None] Flow 'volume_create_manager' (54f5ad33-e7eb-41bb-8802-8aea5fd90bc6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:13:04 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-d7e90003-41c7-4b19-abb1-07c834e326bc tempest-ProjectReaderTests-19712737 None] Created volume successfully. Jul 10 16:13:04 devstack sudo[106634]: pam_unix(sudo:session): session closed for user root Jul 10 16:13:04 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-5b3cef94-4b34-4222-8284-743a6b57d7ab tempest-ProjectMemberTests-968602289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-c33765df-a722-4be2-9f84-97d92b627e61" returned: 0 in 0.782s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:13:04 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-5b3cef94-4b34-4222-8284-743a6b57d7ab tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-c33765df-a722-4be2-9f84-97d92b627e61.fe410870-9554-42b3-8c32-d18d9d268de3 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:13:04 devstack sudo[106640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-c33765df-a722-4be2-9f84-97d92b627e61.fe410870-9554-42b3-8c32-d18d9d268de3 Jul 10 16:13:04 devstack sudo[106640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:13:04 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-69868918-d8cb-479c-baae-4e764c5ca1f3 tempest-ProjectReaderTests-19712737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:13:04 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-69868918-d8cb-479c-baae-4e764c5ca1f3 tempest-ProjectReaderTests-19712737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:13:04 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-69868918-d8cb-479c-baae-4e764c5ca1f3 tempest-ProjectReaderTests-19712737 None] Creating offline snapshot 1b72e693-37e1-44a1-8cdc-ce4469db826b of volume 135ee875-fe4e-4129-bb73-5d0cfe04487e {{(pid=87420) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 16:13:04 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[34308f00-b9e6-4846-b4ab-34ee65729b92]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:13:04 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-69868918-d8cb-479c-baae-4e764c5ca1f3 tempest-ProjectReaderTests-19712737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-135ee875-fe4e-4129-bb73-5d0cfe04487e {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:13:04 devstack sudo[106642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-135ee875-fe4e-4129-bb73-5d0cfe04487e Jul 10 16:13:04 devstack sudo[106642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:13:05 devstack sudo[106640]: pam_unix(sudo:session): session closed for user root Jul 10 16:13:05 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-5b3cef94-4b34-4222-8284-743a6b57d7ab tempest-ProjectMemberTests-968602289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-c33765df-a722-4be2-9f84-97d92b627e61.fe410870-9554-42b3-8c32-d18d9d268de3" returned: 0 in 0.755s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:13:05 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-5b3cef94-4b34-4222-8284-743a6b57d7ab tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-c33765df-a722-4be2-9f84-97d92b627e61.fe410870-9554-42b3-8c32-d18d9d268de3 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:13:05 devstack sudo[106647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-c33765df-a722-4be2-9f84-97d92b627e61.fe410870-9554-42b3-8c32-d18d9d268de3 Jul 10 16:13:05 devstack sudo[106647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:13:05 devstack sudo[106642]: pam_unix(sudo:session): session closed for user root Jul 10 16:13:05 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-69868918-d8cb-479c-baae-4e764c5ca1f3 tempest-ProjectReaderTests-19712737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-135ee875-fe4e-4129-bb73-5d0cfe04487e" returned: 0 in 0.811s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:13:05 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-69868918-d8cb-479c-baae-4e764c5ca1f3 tempest-ProjectReaderTests-19712737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-135ee875-fe4e-4129-bb73-5d0cfe04487e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-135ee875-fe4e-4129-bb73-5d0cfe04487e.1b72e693-37e1-44a1-8cdc-ce4469db826b 1G {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:13:05 devstack sudo[106652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-135ee875-fe4e-4129-bb73-5d0cfe04487e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-135ee875-fe4e-4129-bb73-5d0cfe04487e.1b72e693-37e1-44a1-8cdc-ce4469db826b 1G Jul 10 16:13:05 devstack sudo[106652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:13:05 devstack sudo[106647]: pam_unix(sudo:session): session closed for user root Jul 10 16:13:05 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-5b3cef94-4b34-4222-8284-743a6b57d7ab tempest-ProjectMemberTests-968602289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-c33765df-a722-4be2-9f84-97d92b627e61.fe410870-9554-42b3-8c32-d18d9d268de3" returned: 0 in 0.672s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:13:06 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-5b3cef94-4b34-4222-8284-743a6b57d7ab tempest-ProjectMemberTests-968602289 None] Lock "cinder-quobyte-fe410870-9554-42b3-8c32-d18d9d268de3" released by "_delete_snapshot" :: held 3.084s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:13:06 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-5b3cef94-4b34-4222-8284-743a6b57d7ab tempest-ProjectMemberTests-968602289 None] Lock "cinder-quobyte-c33765df-a722-4be2-9f84-97d92b627e61" released by "delete_snapshot" :: held 3.104s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:13:06 devstack cinder-volume[87420]: DEBUG dbcounter [-] [87420] Writing DB stats cinder:SELECT=164,cinder:INSERT=61,cinder:UPDATE=168,cinder:DELETE=12 {{(pid=87420) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 16:13:06 devstack cinder-volume[87420]: DEBUG dbcounter [-] [87420] Writing DB stats cinder:SELECT=126,cinder:UPDATE=210,cinder:DELETE=18,cinder:INSERT=47 {{(pid=87420) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 16:13:06 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-5b3cef94-4b34-4222-8284-743a6b57d7ab tempest-ProjectMemberTests-968602289 None] Created reservations ['cd4254dc-d533-4c45-a7f4-db7b0b15fc82', '1e876807-bd16-4bae-bfb9-b0209b18d9a5', '17ad790e-e391-41b9-ba9d-933a45e7ab42', '77e4b5d8-c964-4efd-97db-ca1b56a4b7c3'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:13:06 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-5b3cef94-4b34-4222-8284-743a6b57d7ab tempest-ProjectMemberTests-968602289 None] Delete snapshot completed successfully. Jul 10 16:13:06 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-5b3cef94-4b34-4222-8284-743a6b57d7ab tempest-ProjectMemberTests-968602289 None] Lock "cinder-fe410870-9554-42b3-8c32-d18d9d268de3-delete_snapshot" released by "delete_snapshot" :: held 3.260s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:13:06 devstack sudo[106652]: pam_unix(sudo:session): session closed for user root Jul 10 16:13:06 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-69868918-d8cb-479c-baae-4e764c5ca1f3 tempest-ProjectReaderTests-19712737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-135ee875-fe4e-4129-bb73-5d0cfe04487e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-135ee875-fe4e-4129-bb73-5d0cfe04487e.1b72e693-37e1-44a1-8cdc-ce4469db826b 1G" returned: 0 in 0.800s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:13:06 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-69868918-d8cb-479c-baae-4e764c5ca1f3 tempest-ProjectReaderTests-19712737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-135ee875-fe4e-4129-bb73-5d0cfe04487e -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-135ee875-fe4e-4129-bb73-5d0cfe04487e.1b72e693-37e1-44a1-8cdc-ce4469db826b {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:13:06 devstack sudo[106658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-135ee875-fe4e-4129-bb73-5d0cfe04487e -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-135ee875-fe4e-4129-bb73-5d0cfe04487e.1b72e693-37e1-44a1-8cdc-ce4469db826b Jul 10 16:13:06 devstack sudo[106658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:13:07 devstack sudo[106658]: pam_unix(sudo:session): session closed for user root Jul 10 16:13:07 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-69868918-d8cb-479c-baae-4e764c5ca1f3 tempest-ProjectReaderTests-19712737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-135ee875-fe4e-4129-bb73-5d0cfe04487e -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-135ee875-fe4e-4129-bb73-5d0cfe04487e.1b72e693-37e1-44a1-8cdc-ce4469db826b" returned: 0 in 0.680s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:13:07 devstack cinder-volume[87420]: WARNING cinder.volume.drivers.remotefs [None req-69868918-d8cb-479c-baae-4e764c5ca1f3 tempest-ProjectReaderTests-19712737 None] /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-135ee875-fe4e-4129-bb73-5d0cfe04487e.1b72e693-37e1-44a1-8cdc-ce4469db826b is being set with open permissions: ugo+rw Jul 10 16:13:07 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-69868918-d8cb-479c-baae-4e764c5ca1f3 tempest-ProjectReaderTests-19712737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-135ee875-fe4e-4129-bb73-5d0cfe04487e.1b72e693-37e1-44a1-8cdc-ce4469db826b {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:13:07 devstack sudo[106663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-135ee875-fe4e-4129-bb73-5d0cfe04487e.1b72e693-37e1-44a1-8cdc-ce4469db826b Jul 10 16:13:07 devstack sudo[106663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:13:07 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-fb1d2fe0-b434-49cf-8220-b116e3c9eb04 tempest-ProjectMemberTests-968602289 None] Acquiring lock "cinder-c33765df-a722-4be2-9f84-97d92b627e61-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:13:07 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-fb1d2fe0-b434-49cf-8220-b116e3c9eb04 tempest-ProjectMemberTests-968602289 None] Lock "cinder-c33765df-a722-4be2-9f84-97d92b627e61-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:13:07 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-fb1d2fe0-b434-49cf-8220-b116e3c9eb04 tempest-ProjectMemberTests-968602289 None] Acquiring lock "cinder-quobyte-c33765df-a722-4be2-9f84-97d92b627e61" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:13:07 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-fb1d2fe0-b434-49cf-8220-b116e3c9eb04 tempest-ProjectMemberTests-968602289 None] Lock "cinder-quobyte-c33765df-a722-4be2-9f84-97d92b627e61" acquired by "delete_volume" :: waited 0.017s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:13:07 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[6619c249-d471-41d8-9263-6f6b9bf4180f]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:13:07 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-fb1d2fe0-b434-49cf-8220-b116e3c9eb04 tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-c33765df-a722-4be2-9f84-97d92b627e61 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:13:07 devstack sudo[106665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-c33765df-a722-4be2-9f84-97d92b627e61 Jul 10 16:13:07 devstack sudo[106665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:13:07 devstack sudo[106663]: pam_unix(sudo:session): session closed for user root Jul 10 16:13:07 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-69868918-d8cb-479c-baae-4e764c5ca1f3 tempest-ProjectReaderTests-19712737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-135ee875-fe4e-4129-bb73-5d0cfe04487e.1b72e693-37e1-44a1-8cdc-ce4469db826b" returned: 0 in 0.652s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:13:07 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-69868918-d8cb-479c-baae-4e764c5ca1f3 tempest-ProjectReaderTests-19712737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-135ee875-fe4e-4129-bb73-5d0cfe04487e.info {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:13:07 devstack sudo[106668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-135ee875-fe4e-4129-bb73-5d0cfe04487e.info Jul 10 16:13:07 devstack sudo[106668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:13:07 devstack sudo[106665]: pam_unix(sudo:session): session closed for user root Jul 10 16:13:07 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-fb1d2fe0-b434-49cf-8220-b116e3c9eb04 tempest-ProjectMemberTests-968602289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-c33765df-a722-4be2-9f84-97d92b627e61" returned: 0 in 0.760s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:13:07 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-fb1d2fe0-b434-49cf-8220-b116e3c9eb04 tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-c33765df-a722-4be2-9f84-97d92b627e61 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:13:07 devstack sudo[106673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-c33765df-a722-4be2-9f84-97d92b627e61 Jul 10 16:13:07 devstack sudo[106673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:13:08 devstack sudo[106668]: pam_unix(sudo:session): session closed for user root Jul 10 16:13:08 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-69868918-d8cb-479c-baae-4e764c5ca1f3 tempest-ProjectReaderTests-19712737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-135ee875-fe4e-4129-bb73-5d0cfe04487e.info" returned: 0 in 0.656s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:13:08 devstack cinder-volume[87420]: WARNING cinder.volume.drivers.remotefs [None req-69868918-d8cb-479c-baae-4e764c5ca1f3 tempest-ProjectReaderTests-19712737 None] /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-135ee875-fe4e-4129-bb73-5d0cfe04487e.info is being set with open permissions: ugo+rw Jul 10 16:13:08 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-69868918-d8cb-479c-baae-4e764c5ca1f3 tempest-ProjectReaderTests-19712737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-135ee875-fe4e-4129-bb73-5d0cfe04487e.info {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:13:08 devstack sudo[106676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-135ee875-fe4e-4129-bb73-5d0cfe04487e.info Jul 10 16:13:08 devstack sudo[106676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:13:08 devstack sudo[106673]: pam_unix(sudo:session): session closed for user root Jul 10 16:13:08 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-fb1d2fe0-b434-49cf-8220-b116e3c9eb04 tempest-ProjectMemberTests-968602289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-c33765df-a722-4be2-9f84-97d92b627e61" returned: 0 in 0.649s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:13:08 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-fb1d2fe0-b434-49cf-8220-b116e3c9eb04 tempest-ProjectMemberTests-968602289 None] Lock "cinder-quobyte-c33765df-a722-4be2-9f84-97d92b627e61" released by "delete_volume" :: held 1.470s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:13:08 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-fb1d2fe0-b434-49cf-8220-b116e3c9eb04 tempest-ProjectMemberTests-968602289 None] Created reservations ['b79ea736-6321-40e0-87b6-ee31b40624a5', '9b12eab0-b7e6-496b-be18-528ac11c0690', '8c826709-2fa8-4386-97c8-97da162853c3', '82d5af82-eb46-4c64-b3e7-8e4343f345dd'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:13:08 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-fb1d2fe0-b434-49cf-8220-b116e3c9eb04 tempest-ProjectMemberTests-968602289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:13:08 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-fb1d2fe0-b434-49cf-8220-b116e3c9eb04 tempest-ProjectMemberTests-968602289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:13:08 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-fb1d2fe0-b434-49cf-8220-b116e3c9eb04 tempest-ProjectMemberTests-968602289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:13:08 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-fb1d2fe0-b434-49cf-8220-b116e3c9eb04 tempest-ProjectMemberTests-968602289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:13:08 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-fb1d2fe0-b434-49cf-8220-b116e3c9eb04 tempest-ProjectMemberTests-968602289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:13:08 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-fb1d2fe0-b434-49cf-8220-b116e3c9eb04 tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:13:08 devstack sudo[106679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:13:08 devstack sudo[106679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:13:09 devstack sudo[106676]: pam_unix(sudo:session): session closed for user root Jul 10 16:13:09 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-69868918-d8cb-479c-baae-4e764c5ca1f3 tempest-ProjectReaderTests-19712737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-135ee875-fe4e-4129-bb73-5d0cfe04487e.info" returned: 0 in 0.652s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:13:09 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-69868918-d8cb-479c-baae-4e764c5ca1f3 tempest-ProjectReaderTests-19712737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.334s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:13:09 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-69868918-d8cb-479c-baae-4e764c5ca1f3 tempest-ProjectReaderTests-19712737 None] Create snapshot completed successfully Jul 10 16:13:09 devstack sudo[106679]: pam_unix(sudo:session): session closed for user root Jul 10 16:13:09 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-fb1d2fe0-b434-49cf-8220-b116e3c9eb04 tempest-ProjectMemberTests-968602289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.654s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:13:09 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-fb1d2fe0-b434-49cf-8220-b116e3c9eb04 tempest-ProjectMemberTests-968602289 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:13:09 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-fb1d2fe0-b434-49cf-8220-b116e3c9eb04 tempest-ProjectMemberTests-968602289 None] Deleted volume successfully. Jul 10 16:13:09 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-fb1d2fe0-b434-49cf-8220-b116e3c9eb04 tempest-ProjectMemberTests-968602289 None] Lock "cinder-c33765df-a722-4be2-9f84-97d92b627e61-delete_volume" released by "delete_volume" :: held 2.328s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:13:09 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b622e70-72ac-4204-9400-360942000de6 tempest-ProjectMemberTests-968602289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 16:13:09 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-5b622e70-72ac-4204-9400-360942000de6 tempest-ProjectMemberTests-968602289 None] Flow 'volume_create_manager' (a9a3009b-b802-4139-989a-907f652b2621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:13:09 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-5b622e70-72ac-4204-9400-360942000de6 tempest-ProjectMemberTests-968602289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2f838f2-546e-4b9f-9783-41c319346f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:13:09 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-5b622e70-72ac-4204-9400-360942000de6 tempest-ProjectMemberTests-968602289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2f838f2-546e-4b9f-9783-41c319346f83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:13:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-182824908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77157962-ae2f-477d-afda-b230635283a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a62b0a8c6e6a4e9a9b6772e9c7ee6af3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:13:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:13:10Z,use_quota=True,user_id='1a439b56b94841c39eb4e94d953ccde8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:13:09 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-5b622e70-72ac-4204-9400-360942000de6 tempest-ProjectMemberTests-968602289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ba64d1b-86b7-4197-8ee5-8094be6ce720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:13:09 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-5b622e70-72ac-4204-9400-360942000de6 tempest-ProjectMemberTests-968602289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ba64d1b-86b7-4197-8ee5-8094be6ce720) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:13:09 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-5b622e70-72ac-4204-9400-360942000de6 tempest-ProjectMemberTests-968602289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a18aa15f-2ac2-47df-b332-81c0f90bc6f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:13:09 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-5b622e70-72ac-4204-9400-360942000de6 tempest-ProjectMemberTests-968602289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a18aa15f-2ac2-47df-b332-81c0f90bc6f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77157962-ae2f-477d-afda-b230635283a0', 'volume_name': 'volume-77157962-ae2f-477d-afda-b230635283a0', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:13:09 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-5b622e70-72ac-4204-9400-360942000de6 tempest-ProjectMemberTests-968602289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c8966db-1f7c-4c9b-a476-ce106d677c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:13:09 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-5b622e70-72ac-4204-9400-360942000de6 tempest-ProjectMemberTests-968602289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c8966db-1f7c-4c9b-a476-ce106d677c00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:13:09 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-5b622e70-72ac-4204-9400-360942000de6 tempest-ProjectMemberTests-968602289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (859c05e1-c4cd-44bc-85e2-477969aa28f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:13:09 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-5b622e70-72ac-4204-9400-360942000de6 tempest-ProjectMemberTests-968602289 None] Volume 77157962-ae2f-477d-afda-b230635283a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77157962-ae2f-477d-afda-b230635283a0', 'volume_size': 1} Jul 10 16:13:09 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-5b622e70-72ac-4204-9400-360942000de6 tempest-ProjectMemberTests-968602289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:13:09 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-5b622e70-72ac-4204-9400-360942000de6 tempest-ProjectMemberTests-968602289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:13:09 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-5b622e70-72ac-4204-9400-360942000de6 tempest-ProjectMemberTests-968602289 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:13:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-182824908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77157962-ae2f-477d-afda-b230635283a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a62b0a8c6e6a4e9a9b6772e9c7ee6af3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:13:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:13:10Z,use_quota=True,user_id='1a439b56b94841c39eb4e94d953ccde8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 16:13:09 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-5b622e70-72ac-4204-9400-360942000de6 tempest-ProjectMemberTests-968602289 None] Creating volume 77157962-ae2f-477d-afda-b230635283a0 {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 16:13:09 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-5b622e70-72ac-4204-9400-360942000de6 tempest-ProjectMemberTests-968602289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:13:09 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-5b622e70-72ac-4204-9400-360942000de6 tempest-ProjectMemberTests-968602289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:13:09 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-5b622e70-72ac-4204-9400-360942000de6 tempest-ProjectMemberTests-968602289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:13:09 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-5b622e70-72ac-4204-9400-360942000de6 tempest-ProjectMemberTests-968602289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:13:09 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-5b622e70-72ac-4204-9400-360942000de6 tempest-ProjectMemberTests-968602289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:13:09 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-5b622e70-72ac-4204-9400-360942000de6 tempest-ProjectMemberTests-968602289 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 16:13:09 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-5b622e70-72ac-4204-9400-360942000de6 tempest-ProjectMemberTests-968602289 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 16:13:09 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-5b622e70-72ac-4204-9400-360942000de6 tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-77157962-ae2f-477d-afda-b230635283a0 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:13:09 devstack sudo[106683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-77157962-ae2f-477d-afda-b230635283a0 1073741824 Jul 10 16:13:09 devstack sudo[106683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:13:09 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-f7494e2b-dd2a-458f-834a-95551043b41d tempest-ProjectReaderTests-19712737 None] Acquiring lock "cinder-1b72e693-37e1-44a1-8cdc-ce4469db826b-delete_snapshot" by "delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:13:10 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-f7494e2b-dd2a-458f-834a-95551043b41d tempest-ProjectReaderTests-19712737 None] Lock "cinder-1b72e693-37e1-44a1-8cdc-ce4469db826b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:13:10 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-f7494e2b-dd2a-458f-834a-95551043b41d tempest-ProjectReaderTests-19712737 None] Acquiring lock "cinder-quobyte-135ee875-fe4e-4129-bb73-5d0cfe04487e" by "delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:13:10 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-f7494e2b-dd2a-458f-834a-95551043b41d tempest-ProjectReaderTests-19712737 None] Lock "cinder-quobyte-135ee875-fe4e-4129-bb73-5d0cfe04487e" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:13:10 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-f7494e2b-dd2a-458f-834a-95551043b41d tempest-ProjectReaderTests-19712737 None] Acquiring lock "cinder-quobyte-1b72e693-37e1-44a1-8cdc-ce4469db826b" by "_delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:13:10 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-f7494e2b-dd2a-458f-834a-95551043b41d tempest-ProjectReaderTests-19712737 None] Lock "cinder-quobyte-1b72e693-37e1-44a1-8cdc-ce4469db826b" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:13:10 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-f7494e2b-dd2a-458f-834a-95551043b41d tempest-ProjectReaderTests-19712737 None] Deleting offline snapshot 1b72e693-37e1-44a1-8cdc-ce4469db826b of volume 135ee875-fe4e-4129-bb73-5d0cfe04487e {{(pid=87420) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 16:13:10 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-f7494e2b-dd2a-458f-834a-95551043b41d tempest-ProjectReaderTests-19712737 None] snapshot_file for this snap is: volume-135ee875-fe4e-4129-bb73-5d0cfe04487e.1b72e693-37e1-44a1-8cdc-ce4469db826b {{(pid=87420) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 16:13:10 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a09e98-7849-4bab-9e35-99a604a4a1c0]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:13:10 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f7494e2b-dd2a-458f-834a-95551043b41d tempest-ProjectReaderTests-19712737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-135ee875-fe4e-4129-bb73-5d0cfe04487e.1b72e693-37e1-44a1-8cdc-ce4469db826b {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:13:10 devstack sudo[106685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-135ee875-fe4e-4129-bb73-5d0cfe04487e.1b72e693-37e1-44a1-8cdc-ce4469db826b Jul 10 16:13:10 devstack sudo[106685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:13:10 devstack sudo[106683]: pam_unix(sudo:session): session closed for user root Jul 10 16:13:10 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-5b622e70-72ac-4204-9400-360942000de6 tempest-ProjectMemberTests-968602289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-77157962-ae2f-477d-afda-b230635283a0 1073741824" returned: 0 in 0.821s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:13:10 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-5b622e70-72ac-4204-9400-360942000de6 tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-77157962-ae2f-477d-afda-b230635283a0 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:13:10 devstack sudo[106694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-77157962-ae2f-477d-afda-b230635283a0 Jul 10 16:13:10 devstack sudo[106694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:13:10 devstack sudo[106685]: pam_unix(sudo:session): session closed for user root Jul 10 16:13:10 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f7494e2b-dd2a-458f-834a-95551043b41d tempest-ProjectReaderTests-19712737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-135ee875-fe4e-4129-bb73-5d0cfe04487e.1b72e693-37e1-44a1-8cdc-ce4469db826b" returned: 0 in 0.832s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:13:10 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-f7494e2b-dd2a-458f-834a-95551043b41d tempest-ProjectReaderTests-19712737 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-135ee875-fe4e-4129-bb73-5d0cfe04487e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87420) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 16:13:10 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[aacedf6c-4dcd-44a6-9049-f9c741d3fdef]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:13:10 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f7494e2b-dd2a-458f-834a-95551043b41d tempest-ProjectReaderTests-19712737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-135ee875-fe4e-4129-bb73-5d0cfe04487e {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:13:11 devstack sudo[106696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-135ee875-fe4e-4129-bb73-5d0cfe04487e Jul 10 16:13:11 devstack sudo[106696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:13:11 devstack sudo[106694]: pam_unix(sudo:session): session closed for user root Jul 10 16:13:11 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-5b622e70-72ac-4204-9400-360942000de6 tempest-ProjectMemberTests-968602289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-77157962-ae2f-477d-afda-b230635283a0" returned: 0 in 0.654s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:13:11 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-5b622e70-72ac-4204-9400-360942000de6 tempest-ProjectMemberTests-968602289 None] <== create_volume: return (1534ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 16:13:11 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-5b622e70-72ac-4204-9400-360942000de6 tempest-ProjectMemberTests-968602289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.537s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:13:11 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-5b622e70-72ac-4204-9400-360942000de6 tempest-ProjectMemberTests-968602289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (859c05e1-c4cd-44bc-85e2-477969aa28f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77157962-ae2f-477d-afda-b230635283a0', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:13:11 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-5b622e70-72ac-4204-9400-360942000de6 tempest-ProjectMemberTests-968602289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acbc9a32-9e42-455d-a155-44e90fed2407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:13:11 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-5b622e70-72ac-4204-9400-360942000de6 tempest-ProjectMemberTests-968602289 None] Volume volume-77157962-ae2f-477d-afda-b230635283a0 (77157962-ae2f-477d-afda-b230635283a0): created successfully Jul 10 16:13:11 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-5b622e70-72ac-4204-9400-360942000de6 tempest-ProjectMemberTests-968602289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acbc9a32-9e42-455d-a155-44e90fed2407) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:13:11 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-5b622e70-72ac-4204-9400-360942000de6 tempest-ProjectMemberTests-968602289 None] Flow 'volume_create_manager' (a9a3009b-b802-4139-989a-907f652b2621) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:13:11 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-5b622e70-72ac-4204-9400-360942000de6 tempest-ProjectMemberTests-968602289 None] Created volume successfully. Jul 10 16:13:11 devstack sudo[106696]: pam_unix(sudo:session): session closed for user root Jul 10 16:13:11 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f7494e2b-dd2a-458f-834a-95551043b41d tempest-ProjectReaderTests-19712737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-135ee875-fe4e-4129-bb73-5d0cfe04487e" returned: 0 in 0.766s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:13:11 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f7494e2b-dd2a-458f-834a-95551043b41d tempest-ProjectReaderTests-19712737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-135ee875-fe4e-4129-bb73-5d0cfe04487e.1b72e693-37e1-44a1-8cdc-ce4469db826b {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:13:11 devstack sudo[106702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-135ee875-fe4e-4129-bb73-5d0cfe04487e.1b72e693-37e1-44a1-8cdc-ce4469db826b Jul 10 16:13:11 devstack sudo[106702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:13:12 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-8b02ed32-4c98-4d60-a101-b1e411a2a62e tempest-ProjectMemberTests-968602289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:13:12 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-8b02ed32-4c98-4d60-a101-b1e411a2a62e tempest-ProjectMemberTests-968602289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:13:12 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-8b02ed32-4c98-4d60-a101-b1e411a2a62e tempest-ProjectMemberTests-968602289 None] Creating offline snapshot e5bce533-c34e-4afb-a5e3-80fb0ba879ab of volume 77157962-ae2f-477d-afda-b230635283a0 {{(pid=87420) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 16:13:12 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[b77f7072-5a69-4f12-b715-feb59a3a76d4]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:13:12 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8b02ed32-4c98-4d60-a101-b1e411a2a62e tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-77157962-ae2f-477d-afda-b230635283a0 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:13:12 devstack sudo[106704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-77157962-ae2f-477d-afda-b230635283a0 Jul 10 16:13:12 devstack sudo[106704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:13:12 devstack sudo[106702]: pam_unix(sudo:session): session closed for user root Jul 10 16:13:12 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f7494e2b-dd2a-458f-834a-95551043b41d tempest-ProjectReaderTests-19712737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-135ee875-fe4e-4129-bb73-5d0cfe04487e.1b72e693-37e1-44a1-8cdc-ce4469db826b" returned: 0 in 0.729s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:13:12 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f7494e2b-dd2a-458f-834a-95551043b41d tempest-ProjectReaderTests-19712737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-135ee875-fe4e-4129-bb73-5d0cfe04487e.1b72e693-37e1-44a1-8cdc-ce4469db826b {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:13:12 devstack sudo[106709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-135ee875-fe4e-4129-bb73-5d0cfe04487e.1b72e693-37e1-44a1-8cdc-ce4469db826b Jul 10 16:13:12 devstack sudo[106709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:13:12 devstack sudo[106704]: pam_unix(sudo:session): session closed for user root Jul 10 16:13:12 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8b02ed32-4c98-4d60-a101-b1e411a2a62e tempest-ProjectMemberTests-968602289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-77157962-ae2f-477d-afda-b230635283a0" returned: 0 in 0.769s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:13:12 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8b02ed32-4c98-4d60-a101-b1e411a2a62e tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-77157962-ae2f-477d-afda-b230635283a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-77157962-ae2f-477d-afda-b230635283a0.e5bce533-c34e-4afb-a5e3-80fb0ba879ab 1G {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:13:12 devstack sudo[106714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-77157962-ae2f-477d-afda-b230635283a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-77157962-ae2f-477d-afda-b230635283a0.e5bce533-c34e-4afb-a5e3-80fb0ba879ab 1G Jul 10 16:13:12 devstack sudo[106714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:13:13 devstack sudo[106709]: pam_unix(sudo:session): session closed for user root Jul 10 16:13:13 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f7494e2b-dd2a-458f-834a-95551043b41d tempest-ProjectReaderTests-19712737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-135ee875-fe4e-4129-bb73-5d0cfe04487e.1b72e693-37e1-44a1-8cdc-ce4469db826b" returned: 0 in 0.646s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:13:13 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-f7494e2b-dd2a-458f-834a-95551043b41d tempest-ProjectReaderTests-19712737 None] Lock "cinder-quobyte-1b72e693-37e1-44a1-8cdc-ce4469db826b" released by "_delete_snapshot" :: held 3.080s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:13:13 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-f7494e2b-dd2a-458f-834a-95551043b41d tempest-ProjectReaderTests-19712737 None] Lock "cinder-quobyte-135ee875-fe4e-4129-bb73-5d0cfe04487e" released by "delete_snapshot" :: held 3.109s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:13:13 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-f7494e2b-dd2a-458f-834a-95551043b41d tempest-ProjectReaderTests-19712737 None] Created reservations ['7b55c9f0-53f7-43e4-826f-151d1a5a59eb', 'd8bd55d8-2014-4c9d-9595-ff1f65ac1a6d', 'e71c3c93-57f4-435b-bd45-d3eab709127a', 'a0dae835-f2b1-4e0f-973d-15a6796f0516'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:13:13 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-f7494e2b-dd2a-458f-834a-95551043b41d tempest-ProjectReaderTests-19712737 None] Delete snapshot completed successfully. Jul 10 16:13:13 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-f7494e2b-dd2a-458f-834a-95551043b41d tempest-ProjectReaderTests-19712737 None] Lock "cinder-1b72e693-37e1-44a1-8cdc-ce4469db826b-delete_snapshot" released by "delete_snapshot" :: held 3.245s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:13:13 devstack sudo[106714]: pam_unix(sudo:session): session closed for user root Jul 10 16:13:13 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8b02ed32-4c98-4d60-a101-b1e411a2a62e tempest-ProjectMemberTests-968602289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-77157962-ae2f-477d-afda-b230635283a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-77157962-ae2f-477d-afda-b230635283a0.e5bce533-c34e-4afb-a5e3-80fb0ba879ab 1G" returned: 0 in 0.820s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:13:13 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8b02ed32-4c98-4d60-a101-b1e411a2a62e tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77157962-ae2f-477d-afda-b230635283a0 -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-77157962-ae2f-477d-afda-b230635283a0.e5bce533-c34e-4afb-a5e3-80fb0ba879ab {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:13:13 devstack sudo[106722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77157962-ae2f-477d-afda-b230635283a0 -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-77157962-ae2f-477d-afda-b230635283a0.e5bce533-c34e-4afb-a5e3-80fb0ba879ab Jul 10 16:13:13 devstack sudo[106722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:13:14 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-889da6fd-0e7a-4a64-9741-6b28adeb7cde tempest-ProjectReaderTests-19712737 None] Acquiring lock "cinder-135ee875-fe4e-4129-bb73-5d0cfe04487e-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:13:14 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-889da6fd-0e7a-4a64-9741-6b28adeb7cde tempest-ProjectReaderTests-19712737 None] Lock "cinder-135ee875-fe4e-4129-bb73-5d0cfe04487e-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:13:14 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-889da6fd-0e7a-4a64-9741-6b28adeb7cde tempest-ProjectReaderTests-19712737 None] Acquiring lock "cinder-quobyte-135ee875-fe4e-4129-bb73-5d0cfe04487e" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:13:14 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-889da6fd-0e7a-4a64-9741-6b28adeb7cde tempest-ProjectReaderTests-19712737 None] Lock "cinder-quobyte-135ee875-fe4e-4129-bb73-5d0cfe04487e" acquired by "delete_volume" :: waited 0.018s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:13:14 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4443fbb-c143-48ee-9da0-72395021bbe5]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:13:14 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-889da6fd-0e7a-4a64-9741-6b28adeb7cde tempest-ProjectReaderTests-19712737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-135ee875-fe4e-4129-bb73-5d0cfe04487e {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:13:14 devstack sudo[106722]: pam_unix(sudo:session): session closed for user root Jul 10 16:13:14 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8b02ed32-4c98-4d60-a101-b1e411a2a62e tempest-ProjectMemberTests-968602289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77157962-ae2f-477d-afda-b230635283a0 -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-77157962-ae2f-477d-afda-b230635283a0.e5bce533-c34e-4afb-a5e3-80fb0ba879ab" returned: 0 in 0.749s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:13:14 devstack cinder-volume[87420]: WARNING cinder.volume.drivers.remotefs [None req-8b02ed32-4c98-4d60-a101-b1e411a2a62e tempest-ProjectMemberTests-968602289 None] /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-77157962-ae2f-477d-afda-b230635283a0.e5bce533-c34e-4afb-a5e3-80fb0ba879ab is being set with open permissions: ugo+rw Jul 10 16:13:14 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8b02ed32-4c98-4d60-a101-b1e411a2a62e tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-77157962-ae2f-477d-afda-b230635283a0.e5bce533-c34e-4afb-a5e3-80fb0ba879ab {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:13:14 devstack sudo[106727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-135ee875-fe4e-4129-bb73-5d0cfe04487e Jul 10 16:13:14 devstack sudo[106727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:13:14 devstack sudo[106728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-77157962-ae2f-477d-afda-b230635283a0.e5bce533-c34e-4afb-a5e3-80fb0ba879ab Jul 10 16:13:14 devstack sudo[106728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:13:15 devstack sudo[106728]: pam_unix(sudo:session): session closed for user root Jul 10 16:13:15 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8b02ed32-4c98-4d60-a101-b1e411a2a62e tempest-ProjectMemberTests-968602289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-77157962-ae2f-477d-afda-b230635283a0.e5bce533-c34e-4afb-a5e3-80fb0ba879ab" returned: 0 in 0.640s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:13:15 devstack sudo[106727]: pam_unix(sudo:session): session closed for user root Jul 10 16:13:15 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-889da6fd-0e7a-4a64-9741-6b28adeb7cde tempest-ProjectReaderTests-19712737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-135ee875-fe4e-4129-bb73-5d0cfe04487e" returned: 0 in 0.758s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:13:15 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-889da6fd-0e7a-4a64-9741-6b28adeb7cde tempest-ProjectReaderTests-19712737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-135ee875-fe4e-4129-bb73-5d0cfe04487e {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:13:15 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8b02ed32-4c98-4d60-a101-b1e411a2a62e tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-77157962-ae2f-477d-afda-b230635283a0.info {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:13:15 devstack sudo[106735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-135ee875-fe4e-4129-bb73-5d0cfe04487e Jul 10 16:13:15 devstack sudo[106735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:13:15 devstack sudo[106736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-77157962-ae2f-477d-afda-b230635283a0.info Jul 10 16:13:15 devstack sudo[106736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:13:15 devstack sudo[106736]: pam_unix(sudo:session): session closed for user root Jul 10 16:13:15 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8b02ed32-4c98-4d60-a101-b1e411a2a62e tempest-ProjectMemberTests-968602289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-77157962-ae2f-477d-afda-b230635283a0.info" returned: 0 in 0.640s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:13:15 devstack cinder-volume[87420]: WARNING cinder.volume.drivers.remotefs [None req-8b02ed32-4c98-4d60-a101-b1e411a2a62e tempest-ProjectMemberTests-968602289 None] /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-77157962-ae2f-477d-afda-b230635283a0.info is being set with open permissions: ugo+rw Jul 10 16:13:15 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8b02ed32-4c98-4d60-a101-b1e411a2a62e tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-77157962-ae2f-477d-afda-b230635283a0.info {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:13:15 devstack sudo[106735]: pam_unix(sudo:session): session closed for user root Jul 10 16:13:15 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-889da6fd-0e7a-4a64-9741-6b28adeb7cde tempest-ProjectReaderTests-19712737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-135ee875-fe4e-4129-bb73-5d0cfe04487e" returned: 0 in 0.673s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:13:15 devstack sudo[106741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-77157962-ae2f-477d-afda-b230635283a0.info Jul 10 16:13:15 devstack sudo[106741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:13:15 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-889da6fd-0e7a-4a64-9741-6b28adeb7cde tempest-ProjectReaderTests-19712737 None] Lock "cinder-quobyte-135ee875-fe4e-4129-bb73-5d0cfe04487e" released by "delete_volume" :: held 1.498s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:13:15 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-889da6fd-0e7a-4a64-9741-6b28adeb7cde tempest-ProjectReaderTests-19712737 None] Created reservations ['340600da-8ab1-498a-9c53-4c9337690e57', '7910305c-fa00-42e1-9dde-7b93cdc6b0f3', 'aae1a65a-2cfe-4c21-9d5d-eb4d7a7e767e', '50392505-f34a-4c60-9cd2-3783230f7652'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:13:15 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-889da6fd-0e7a-4a64-9741-6b28adeb7cde tempest-ProjectReaderTests-19712737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:13:15 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-889da6fd-0e7a-4a64-9741-6b28adeb7cde tempest-ProjectReaderTests-19712737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:13:15 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-889da6fd-0e7a-4a64-9741-6b28adeb7cde tempest-ProjectReaderTests-19712737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:13:15 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-889da6fd-0e7a-4a64-9741-6b28adeb7cde tempest-ProjectReaderTests-19712737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:13:15 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-889da6fd-0e7a-4a64-9741-6b28adeb7cde tempest-ProjectReaderTests-19712737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:13:15 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-889da6fd-0e7a-4a64-9741-6b28adeb7cde tempest-ProjectReaderTests-19712737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:13:15 devstack sudo[106743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:13:15 devstack sudo[106743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:13:16 devstack sudo[106741]: pam_unix(sudo:session): session closed for user root Jul 10 16:13:16 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-8b02ed32-4c98-4d60-a101-b1e411a2a62e tempest-ProjectMemberTests-968602289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-77157962-ae2f-477d-afda-b230635283a0.info" returned: 0 in 0.724s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:13:16 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-8b02ed32-4c98-4d60-a101-b1e411a2a62e tempest-ProjectMemberTests-968602289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.459s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:13:16 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-8b02ed32-4c98-4d60-a101-b1e411a2a62e tempest-ProjectMemberTests-968602289 None] Create snapshot completed successfully Jul 10 16:13:16 devstack sudo[106743]: pam_unix(sudo:session): session closed for user root Jul 10 16:13:16 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-889da6fd-0e7a-4a64-9741-6b28adeb7cde tempest-ProjectReaderTests-19712737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.649s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:13:16 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-889da6fd-0e7a-4a64-9741-6b28adeb7cde tempest-ProjectReaderTests-19712737 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:13:16 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-889da6fd-0e7a-4a64-9741-6b28adeb7cde tempest-ProjectReaderTests-19712737 None] Deleted volume successfully. Jul 10 16:13:16 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-889da6fd-0e7a-4a64-9741-6b28adeb7cde tempest-ProjectReaderTests-19712737 None] Lock "cinder-135ee875-fe4e-4129-bb73-5d0cfe04487e-delete_volume" released by "delete_volume" :: held 2.352s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:13:16 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a78aedf-cabc-42c7-a4c9-8ce9e4537822 tempest-ProjectReaderTests-19712737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 16:13:16 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6a78aedf-cabc-42c7-a4c9-8ce9e4537822 tempest-ProjectReaderTests-19712737 None] Flow 'volume_create_manager' (1bc30e7d-7f0b-4288-be4b-fdc859f691f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:13:16 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6a78aedf-cabc-42c7-a4c9-8ce9e4537822 tempest-ProjectReaderTests-19712737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a480f505-980e-4e9a-8474-a879ace4c133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:13:16 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6a78aedf-cabc-42c7-a4c9-8ce9e4537822 tempest-ProjectReaderTests-19712737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a480f505-980e-4e9a-8474-a879ace4c133) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:13:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-215941392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5f3fb44-606e-4a82-b65a-c031c073afd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3216e7ae39094a2295e8ea00806db82b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:13:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:13:17Z,use_quota=True,user_id='52679baac65041bb9ce548ee3dd7269c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:13:16 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6a78aedf-cabc-42c7-a4c9-8ce9e4537822 tempest-ProjectReaderTests-19712737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a8a4718-664d-41a9-af95-42c9b03f6c1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:13:16 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6a78aedf-cabc-42c7-a4c9-8ce9e4537822 tempest-ProjectReaderTests-19712737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a8a4718-664d-41a9-af95-42c9b03f6c1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:13:16 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6a78aedf-cabc-42c7-a4c9-8ce9e4537822 tempest-ProjectReaderTests-19712737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (512bad4d-e8d4-45d3-8a85-9e2356c5cd56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:13:16 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6a78aedf-cabc-42c7-a4c9-8ce9e4537822 tempest-ProjectReaderTests-19712737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (512bad4d-e8d4-45d3-8a85-9e2356c5cd56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5f3fb44-606e-4a82-b65a-c031c073afd8', 'volume_name': 'volume-d5f3fb44-606e-4a82-b65a-c031c073afd8', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:13:16 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6a78aedf-cabc-42c7-a4c9-8ce9e4537822 tempest-ProjectReaderTests-19712737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08034fa0-5c1c-4b50-9608-13fcbe19f30f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:13:16 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6a78aedf-cabc-42c7-a4c9-8ce9e4537822 tempest-ProjectReaderTests-19712737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08034fa0-5c1c-4b50-9608-13fcbe19f30f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:13:16 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6a78aedf-cabc-42c7-a4c9-8ce9e4537822 tempest-ProjectReaderTests-19712737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae47169e-10d9-4bab-8803-76c2928003aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:13:16 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-6a78aedf-cabc-42c7-a4c9-8ce9e4537822 tempest-ProjectReaderTests-19712737 None] Volume d5f3fb44-606e-4a82-b65a-c031c073afd8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5f3fb44-606e-4a82-b65a-c031c073afd8', 'volume_size': 1} Jul 10 16:13:16 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-6a78aedf-cabc-42c7-a4c9-8ce9e4537822 tempest-ProjectReaderTests-19712737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:13:16 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-6a78aedf-cabc-42c7-a4c9-8ce9e4537822 tempest-ProjectReaderTests-19712737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:13:17 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-6a78aedf-cabc-42c7-a4c9-8ce9e4537822 tempest-ProjectReaderTests-19712737 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:13:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-215941392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5f3fb44-606e-4a82-b65a-c031c073afd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3216e7ae39094a2295e8ea00806db82b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:13:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:13:17Z,use_quota=True,user_id='52679baac65041bb9ce548ee3dd7269c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 16:13:17 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-6a78aedf-cabc-42c7-a4c9-8ce9e4537822 tempest-ProjectReaderTests-19712737 None] Creating volume d5f3fb44-606e-4a82-b65a-c031c073afd8 {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 16:13:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-6a78aedf-cabc-42c7-a4c9-8ce9e4537822 tempest-ProjectReaderTests-19712737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:13:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-6a78aedf-cabc-42c7-a4c9-8ce9e4537822 tempest-ProjectReaderTests-19712737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:13:17 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-6a78aedf-cabc-42c7-a4c9-8ce9e4537822 tempest-ProjectReaderTests-19712737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:13:17 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-6a78aedf-cabc-42c7-a4c9-8ce9e4537822 tempest-ProjectReaderTests-19712737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:13:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-6a78aedf-cabc-42c7-a4c9-8ce9e4537822 tempest-ProjectReaderTests-19712737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:13:17 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-6a78aedf-cabc-42c7-a4c9-8ce9e4537822 tempest-ProjectReaderTests-19712737 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 16:13:17 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-6a78aedf-cabc-42c7-a4c9-8ce9e4537822 tempest-ProjectReaderTests-19712737 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 16:13:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6a78aedf-cabc-42c7-a4c9-8ce9e4537822 tempest-ProjectReaderTests-19712737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d5f3fb44-606e-4a82-b65a-c031c073afd8 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:13:17 devstack sudo[106747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d5f3fb44-606e-4a82-b65a-c031c073afd8 1073741824 Jul 10 16:13:17 devstack sudo[106747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:13:17 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-72d7af40-f6c7-4bfd-b38e-034ad6da6d01 tempest-ProjectMemberTests-968602289 None] Acquiring lock "cinder-e5bce533-c34e-4afb-a5e3-80fb0ba879ab-delete_snapshot" by "delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:13:17 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-72d7af40-f6c7-4bfd-b38e-034ad6da6d01 tempest-ProjectMemberTests-968602289 None] Lock "cinder-e5bce533-c34e-4afb-a5e3-80fb0ba879ab-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:13:17 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-72d7af40-f6c7-4bfd-b38e-034ad6da6d01 tempest-ProjectMemberTests-968602289 None] Acquiring lock "cinder-quobyte-77157962-ae2f-477d-afda-b230635283a0" by "delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:13:17 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-72d7af40-f6c7-4bfd-b38e-034ad6da6d01 tempest-ProjectMemberTests-968602289 None] Lock "cinder-quobyte-77157962-ae2f-477d-afda-b230635283a0" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:13:17 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-72d7af40-f6c7-4bfd-b38e-034ad6da6d01 tempest-ProjectMemberTests-968602289 None] Acquiring lock "cinder-quobyte-e5bce533-c34e-4afb-a5e3-80fb0ba879ab" by "_delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:13:17 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-72d7af40-f6c7-4bfd-b38e-034ad6da6d01 tempest-ProjectMemberTests-968602289 None] Lock "cinder-quobyte-e5bce533-c34e-4afb-a5e3-80fb0ba879ab" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:13:17 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-72d7af40-f6c7-4bfd-b38e-034ad6da6d01 tempest-ProjectMemberTests-968602289 None] Deleting offline snapshot e5bce533-c34e-4afb-a5e3-80fb0ba879ab of volume 77157962-ae2f-477d-afda-b230635283a0 {{(pid=87420) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 16:13:17 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-72d7af40-f6c7-4bfd-b38e-034ad6da6d01 tempest-ProjectMemberTests-968602289 None] snapshot_file for this snap is: volume-77157962-ae2f-477d-afda-b230635283a0.e5bce533-c34e-4afb-a5e3-80fb0ba879ab {{(pid=87420) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 16:13:17 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5685701-9d7e-4a24-91a3-c35a7da88415]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:13:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-72d7af40-f6c7-4bfd-b38e-034ad6da6d01 tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-77157962-ae2f-477d-afda-b230635283a0.e5bce533-c34e-4afb-a5e3-80fb0ba879ab {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:13:17 devstack cinder-volume[87420]: DEBUG oslo_service.periodic_task [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87420) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 16:13:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:13:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:13:17 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:13:17 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:13:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:13:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:13:17 devstack sudo[106750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:13:17 devstack sudo[106750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:13:17 devstack sudo[106749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-77157962-ae2f-477d-afda-b230635283a0.e5bce533-c34e-4afb-a5e3-80fb0ba879ab Jul 10 16:13:17 devstack sudo[106749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:13:17 devstack sudo[106747]: pam_unix(sudo:session): session closed for user root Jul 10 16:13:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6a78aedf-cabc-42c7-a4c9-8ce9e4537822 tempest-ProjectReaderTests-19712737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d5f3fb44-606e-4a82-b65a-c031c073afd8 1073741824" returned: 0 in 0.836s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:13:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6a78aedf-cabc-42c7-a4c9-8ce9e4537822 tempest-ProjectReaderTests-19712737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d5f3fb44-606e-4a82-b65a-c031c073afd8 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:13:17 devstack sudo[106756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d5f3fb44-606e-4a82-b65a-c031c073afd8 Jul 10 16:13:17 devstack sudo[106756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:13:18 devstack sudo[106750]: pam_unix(sudo:session): session closed for user root Jul 10 16:13:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.679s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:13:18 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:13:18 devstack cinder-volume[87420]: DEBUG oslo_service.periodic_task [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Running periodic task VolumeManager._thread_info {{(pid=87420) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 16:13:18 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] thread count: 29 {{(pid=87420) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 16:13:18 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] thread info: [<_MainThread(MainThread, started 133639250378880)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87420) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 16:13:18 devstack sudo[106749]: pam_unix(sudo:session): session closed for user root Jul 10 16:13:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-72d7af40-f6c7-4bfd-b38e-034ad6da6d01 tempest-ProjectMemberTests-968602289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-77157962-ae2f-477d-afda-b230635283a0.e5bce533-c34e-4afb-a5e3-80fb0ba879ab" returned: 0 in 0.782s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:13:18 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-72d7af40-f6c7-4bfd-b38e-034ad6da6d01 tempest-ProjectMemberTests-968602289 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-77157962-ae2f-477d-afda-b230635283a0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87420) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 16:13:18 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[db0b3155-768e-475e-955c-236f657b83cf]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:13:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-72d7af40-f6c7-4bfd-b38e-034ad6da6d01 tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-77157962-ae2f-477d-afda-b230635283a0 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:13:18 devstack sudo[106762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-77157962-ae2f-477d-afda-b230635283a0 Jul 10 16:13:18 devstack sudo[106762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:13:18 devstack sudo[106756]: pam_unix(sudo:session): session closed for user root Jul 10 16:13:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6a78aedf-cabc-42c7-a4c9-8ce9e4537822 tempest-ProjectReaderTests-19712737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d5f3fb44-606e-4a82-b65a-c031c073afd8" returned: 0 in 0.662s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:13:18 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-6a78aedf-cabc-42c7-a4c9-8ce9e4537822 tempest-ProjectReaderTests-19712737 None] <== create_volume: return (1554ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 16:13:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-6a78aedf-cabc-42c7-a4c9-8ce9e4537822 tempest-ProjectReaderTests-19712737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.556s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:13:18 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6a78aedf-cabc-42c7-a4c9-8ce9e4537822 tempest-ProjectReaderTests-19712737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae47169e-10d9-4bab-8803-76c2928003aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5f3fb44-606e-4a82-b65a-c031c073afd8', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:13:18 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6a78aedf-cabc-42c7-a4c9-8ce9e4537822 tempest-ProjectReaderTests-19712737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45741d3d-5081-413e-a5c3-9d0a3460e60d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:13:18 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-6a78aedf-cabc-42c7-a4c9-8ce9e4537822 tempest-ProjectReaderTests-19712737 None] Volume volume-d5f3fb44-606e-4a82-b65a-c031c073afd8 (d5f3fb44-606e-4a82-b65a-c031c073afd8): created successfully Jul 10 16:13:18 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6a78aedf-cabc-42c7-a4c9-8ce9e4537822 tempest-ProjectReaderTests-19712737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45741d3d-5081-413e-a5c3-9d0a3460e60d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:13:18 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6a78aedf-cabc-42c7-a4c9-8ce9e4537822 tempest-ProjectReaderTests-19712737 None] Flow 'volume_create_manager' (1bc30e7d-7f0b-4288-be4b-fdc859f691f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:13:18 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-6a78aedf-cabc-42c7-a4c9-8ce9e4537822 tempest-ProjectReaderTests-19712737 None] Created volume successfully. Jul 10 16:13:18 devstack sudo[106762]: pam_unix(sudo:session): session closed for user root Jul 10 16:13:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-72d7af40-f6c7-4bfd-b38e-034ad6da6d01 tempest-ProjectMemberTests-968602289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-77157962-ae2f-477d-afda-b230635283a0" returned: 0 in 0.737s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:13:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-72d7af40-f6c7-4bfd-b38e-034ad6da6d01 tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-77157962-ae2f-477d-afda-b230635283a0.e5bce533-c34e-4afb-a5e3-80fb0ba879ab {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:13:19 devstack sudo[106768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-77157962-ae2f-477d-afda-b230635283a0.e5bce533-c34e-4afb-a5e3-80fb0ba879ab Jul 10 16:13:19 devstack sudo[106768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:13:19 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-673c835b-9d4e-4116-a306-5ae83280a3ee tempest-ProjectReaderTests-19712737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:13:19 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-673c835b-9d4e-4116-a306-5ae83280a3ee tempest-ProjectReaderTests-19712737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:13:19 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-673c835b-9d4e-4116-a306-5ae83280a3ee tempest-ProjectReaderTests-19712737 None] Creating offline snapshot 39430c1b-0334-42ed-a340-881bc8a44687 of volume d5f3fb44-606e-4a82-b65a-c031c073afd8 {{(pid=87420) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 16:13:19 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb9a970f-20e5-4c65-9213-f659e95102b2]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:13:19 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-673c835b-9d4e-4116-a306-5ae83280a3ee tempest-ProjectReaderTests-19712737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d5f3fb44-606e-4a82-b65a-c031c073afd8 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:13:19 devstack sudo[106770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d5f3fb44-606e-4a82-b65a-c031c073afd8 Jul 10 16:13:19 devstack sudo[106770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:13:19 devstack sudo[106768]: pam_unix(sudo:session): session closed for user root Jul 10 16:13:19 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-72d7af40-f6c7-4bfd-b38e-034ad6da6d01 tempest-ProjectMemberTests-968602289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-77157962-ae2f-477d-afda-b230635283a0.e5bce533-c34e-4afb-a5e3-80fb0ba879ab" returned: 0 in 0.764s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:13:19 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-72d7af40-f6c7-4bfd-b38e-034ad6da6d01 tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-77157962-ae2f-477d-afda-b230635283a0.e5bce533-c34e-4afb-a5e3-80fb0ba879ab {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:13:19 devstack sudo[106775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-77157962-ae2f-477d-afda-b230635283a0.e5bce533-c34e-4afb-a5e3-80fb0ba879ab Jul 10 16:13:19 devstack sudo[106775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:13:19 devstack sudo[106770]: pam_unix(sudo:session): session closed for user root Jul 10 16:13:19 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-673c835b-9d4e-4116-a306-5ae83280a3ee tempest-ProjectReaderTests-19712737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d5f3fb44-606e-4a82-b65a-c031c073afd8" returned: 0 in 0.785s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:13:19 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-673c835b-9d4e-4116-a306-5ae83280a3ee tempest-ProjectReaderTests-19712737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d5f3fb44-606e-4a82-b65a-c031c073afd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d5f3fb44-606e-4a82-b65a-c031c073afd8.39430c1b-0334-42ed-a340-881bc8a44687 1G {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:13:20 devstack sudo[106780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d5f3fb44-606e-4a82-b65a-c031c073afd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d5f3fb44-606e-4a82-b65a-c031c073afd8.39430c1b-0334-42ed-a340-881bc8a44687 1G Jul 10 16:13:20 devstack sudo[106780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:13:20 devstack sudo[106775]: pam_unix(sudo:session): session closed for user root Jul 10 16:13:20 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-72d7af40-f6c7-4bfd-b38e-034ad6da6d01 tempest-ProjectMemberTests-968602289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-77157962-ae2f-477d-afda-b230635283a0.e5bce533-c34e-4afb-a5e3-80fb0ba879ab" returned: 0 in 0.649s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:13:20 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-72d7af40-f6c7-4bfd-b38e-034ad6da6d01 tempest-ProjectMemberTests-968602289 None] Lock "cinder-quobyte-e5bce533-c34e-4afb-a5e3-80fb0ba879ab" released by "_delete_snapshot" :: held 3.034s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:13:20 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-72d7af40-f6c7-4bfd-b38e-034ad6da6d01 tempest-ProjectMemberTests-968602289 None] Lock "cinder-quobyte-77157962-ae2f-477d-afda-b230635283a0" released by "delete_snapshot" :: held 3.057s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:13:20 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-72d7af40-f6c7-4bfd-b38e-034ad6da6d01 tempest-ProjectMemberTests-968602289 None] Created reservations ['2ffabde5-0897-4957-9f59-fcc842f84d3d', '953d732e-3772-413c-b8a2-e2522171c063', 'aa905097-82d4-43e9-bff2-7c4f41aec730', '1bea79be-d679-4bcb-a55e-7f480fe2f661'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:13:20 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-72d7af40-f6c7-4bfd-b38e-034ad6da6d01 tempest-ProjectMemberTests-968602289 None] Delete snapshot completed successfully. Jul 10 16:13:20 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-72d7af40-f6c7-4bfd-b38e-034ad6da6d01 tempest-ProjectMemberTests-968602289 None] Lock "cinder-e5bce533-c34e-4afb-a5e3-80fb0ba879ab-delete_snapshot" released by "delete_snapshot" :: held 3.187s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:13:20 devstack sudo[106780]: pam_unix(sudo:session): session closed for user root Jul 10 16:13:20 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-673c835b-9d4e-4116-a306-5ae83280a3ee tempest-ProjectReaderTests-19712737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d5f3fb44-606e-4a82-b65a-c031c073afd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d5f3fb44-606e-4a82-b65a-c031c073afd8.39430c1b-0334-42ed-a340-881bc8a44687 1G" returned: 0 in 0.804s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:13:20 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-673c835b-9d4e-4116-a306-5ae83280a3ee tempest-ProjectReaderTests-19712737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5f3fb44-606e-4a82-b65a-c031c073afd8 -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d5f3fb44-606e-4a82-b65a-c031c073afd8.39430c1b-0334-42ed-a340-881bc8a44687 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:13:20 devstack sudo[106786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5f3fb44-606e-4a82-b65a-c031c073afd8 -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d5f3fb44-606e-4a82-b65a-c031c073afd8.39430c1b-0334-42ed-a340-881bc8a44687 Jul 10 16:13:20 devstack sudo[106786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:13:21 devstack sudo[106786]: pam_unix(sudo:session): session closed for user root Jul 10 16:13:21 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-673c835b-9d4e-4116-a306-5ae83280a3ee tempest-ProjectReaderTests-19712737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5f3fb44-606e-4a82-b65a-c031c073afd8 -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d5f3fb44-606e-4a82-b65a-c031c073afd8.39430c1b-0334-42ed-a340-881bc8a44687" returned: 0 in 0.671s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:13:21 devstack cinder-volume[87420]: WARNING cinder.volume.drivers.remotefs [None req-673c835b-9d4e-4116-a306-5ae83280a3ee tempest-ProjectReaderTests-19712737 None] /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d5f3fb44-606e-4a82-b65a-c031c073afd8.39430c1b-0334-42ed-a340-881bc8a44687 is being set with open permissions: ugo+rw Jul 10 16:13:21 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-673c835b-9d4e-4116-a306-5ae83280a3ee tempest-ProjectReaderTests-19712737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d5f3fb44-606e-4a82-b65a-c031c073afd8.39430c1b-0334-42ed-a340-881bc8a44687 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:13:21 devstack sudo[106793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d5f3fb44-606e-4a82-b65a-c031c073afd8.39430c1b-0334-42ed-a340-881bc8a44687 Jul 10 16:13:21 devstack sudo[106793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:13:21 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-0a48ed07-c93c-483b-90a4-9e247b070a68 tempest-ProjectMemberTests-968602289 None] Acquiring lock "cinder-77157962-ae2f-477d-afda-b230635283a0-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:13:21 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-0a48ed07-c93c-483b-90a4-9e247b070a68 tempest-ProjectMemberTests-968602289 None] Lock "cinder-77157962-ae2f-477d-afda-b230635283a0-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:13:21 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-0a48ed07-c93c-483b-90a4-9e247b070a68 tempest-ProjectMemberTests-968602289 None] Acquiring lock "cinder-quobyte-77157962-ae2f-477d-afda-b230635283a0" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:13:21 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-0a48ed07-c93c-483b-90a4-9e247b070a68 tempest-ProjectMemberTests-968602289 None] Lock "cinder-quobyte-77157962-ae2f-477d-afda-b230635283a0" acquired by "delete_volume" :: waited 0.017s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:13:21 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b605c2c-c2b7-471c-951a-5817fb141f3c]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:13:21 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-0a48ed07-c93c-483b-90a4-9e247b070a68 tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-77157962-ae2f-477d-afda-b230635283a0 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:13:21 devstack sudo[106795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-77157962-ae2f-477d-afda-b230635283a0 Jul 10 16:13:21 devstack sudo[106795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:13:22 devstack sudo[106793]: pam_unix(sudo:session): session closed for user root Jul 10 16:13:22 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-673c835b-9d4e-4116-a306-5ae83280a3ee tempest-ProjectReaderTests-19712737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d5f3fb44-606e-4a82-b65a-c031c073afd8.39430c1b-0334-42ed-a340-881bc8a44687" returned: 0 in 0.674s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:13:22 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-673c835b-9d4e-4116-a306-5ae83280a3ee tempest-ProjectReaderTests-19712737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d5f3fb44-606e-4a82-b65a-c031c073afd8.info {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:13:22 devstack sudo[106799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d5f3fb44-606e-4a82-b65a-c031c073afd8.info Jul 10 16:13:22 devstack sudo[106799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:13:22 devstack sudo[106795]: pam_unix(sudo:session): session closed for user root Jul 10 16:13:22 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-0a48ed07-c93c-483b-90a4-9e247b070a68 tempest-ProjectMemberTests-968602289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-77157962-ae2f-477d-afda-b230635283a0" returned: 0 in 0.768s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:13:22 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-0a48ed07-c93c-483b-90a4-9e247b070a68 tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-77157962-ae2f-477d-afda-b230635283a0 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:13:22 devstack sudo[106804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-77157962-ae2f-477d-afda-b230635283a0 Jul 10 16:13:22 devstack sudo[106804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:13:22 devstack sudo[106799]: pam_unix(sudo:session): session closed for user root Jul 10 16:13:22 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-673c835b-9d4e-4116-a306-5ae83280a3ee tempest-ProjectReaderTests-19712737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d5f3fb44-606e-4a82-b65a-c031c073afd8.info" returned: 0 in 0.661s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:13:22 devstack cinder-volume[87420]: WARNING cinder.volume.drivers.remotefs [None req-673c835b-9d4e-4116-a306-5ae83280a3ee tempest-ProjectReaderTests-19712737 None] /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d5f3fb44-606e-4a82-b65a-c031c073afd8.info is being set with open permissions: ugo+rw Jul 10 16:13:22 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-673c835b-9d4e-4116-a306-5ae83280a3ee tempest-ProjectReaderTests-19712737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d5f3fb44-606e-4a82-b65a-c031c073afd8.info {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:13:22 devstack sudo[106807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d5f3fb44-606e-4a82-b65a-c031c073afd8.info Jul 10 16:13:22 devstack sudo[106807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:13:23 devstack sudo[106804]: pam_unix(sudo:session): session closed for user root Jul 10 16:13:23 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-0a48ed07-c93c-483b-90a4-9e247b070a68 tempest-ProjectMemberTests-968602289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-77157962-ae2f-477d-afda-b230635283a0" returned: 0 in 0.647s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:13:23 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-0a48ed07-c93c-483b-90a4-9e247b070a68 tempest-ProjectMemberTests-968602289 None] Lock "cinder-quobyte-77157962-ae2f-477d-afda-b230635283a0" released by "delete_volume" :: held 1.480s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:13:23 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-0a48ed07-c93c-483b-90a4-9e247b070a68 tempest-ProjectMemberTests-968602289 None] Created reservations ['c2147bbf-92cb-45f7-9aa3-7c4dbd2fbea6', 'ba729881-2eca-409c-802e-842e34945364', 'c2613128-85cf-40de-939e-c373e62adbcc', 'd803f86b-78a6-4fa4-8f6a-678716a350aa'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:13:23 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-0a48ed07-c93c-483b-90a4-9e247b070a68 tempest-ProjectMemberTests-968602289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:13:23 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-0a48ed07-c93c-483b-90a4-9e247b070a68 tempest-ProjectMemberTests-968602289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:13:23 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-0a48ed07-c93c-483b-90a4-9e247b070a68 tempest-ProjectMemberTests-968602289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:13:23 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-0a48ed07-c93c-483b-90a4-9e247b070a68 tempest-ProjectMemberTests-968602289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:13:23 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-0a48ed07-c93c-483b-90a4-9e247b070a68 tempest-ProjectMemberTests-968602289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:13:23 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-0a48ed07-c93c-483b-90a4-9e247b070a68 tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:13:23 devstack sudo[106810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:13:23 devstack sudo[106810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:13:23 devstack sudo[106807]: pam_unix(sudo:session): session closed for user root Jul 10 16:13:23 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-673c835b-9d4e-4116-a306-5ae83280a3ee tempest-ProjectReaderTests-19712737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d5f3fb44-606e-4a82-b65a-c031c073afd8.info" returned: 0 in 0.674s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:13:23 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-673c835b-9d4e-4116-a306-5ae83280a3ee tempest-ProjectReaderTests-19712737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.353s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:13:23 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-673c835b-9d4e-4116-a306-5ae83280a3ee tempest-ProjectReaderTests-19712737 None] Create snapshot completed successfully Jul 10 16:13:23 devstack sudo[106810]: pam_unix(sudo:session): session closed for user root Jul 10 16:13:23 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-0a48ed07-c93c-483b-90a4-9e247b070a68 tempest-ProjectMemberTests-968602289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.670s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:13:23 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-0a48ed07-c93c-483b-90a4-9e247b070a68 tempest-ProjectMemberTests-968602289 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:13:23 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-0a48ed07-c93c-483b-90a4-9e247b070a68 tempest-ProjectMemberTests-968602289 None] Deleted volume successfully. Jul 10 16:13:23 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-0a48ed07-c93c-483b-90a4-9e247b070a68 tempest-ProjectMemberTests-968602289 None] Lock "cinder-77157962-ae2f-477d-afda-b230635283a0-delete_volume" released by "delete_volume" :: held 2.359s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:13:24 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac15dff0-7a06-49df-a66a-3f26b71c7f6e tempest-ProjectMemberTests-968602289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 16:13:24 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ac15dff0-7a06-49df-a66a-3f26b71c7f6e tempest-ProjectMemberTests-968602289 None] Flow 'volume_create_manager' (7a0d47aa-ffe0-45a9-9627-36b220b64790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:13:24 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ac15dff0-7a06-49df-a66a-3f26b71c7f6e tempest-ProjectMemberTests-968602289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46250d3b-ee44-448d-bf51-f7e908312920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:13:24 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ac15dff0-7a06-49df-a66a-3f26b71c7f6e tempest-ProjectMemberTests-968602289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46250d3b-ee44-448d-bf51-f7e908312920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:13:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1914923726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c790384-f3d7-466b-b062-faa853824dfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a62b0a8c6e6a4e9a9b6772e9c7ee6af3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:13:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:13:24Z,use_quota=True,user_id='1a439b56b94841c39eb4e94d953ccde8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:13:24 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ac15dff0-7a06-49df-a66a-3f26b71c7f6e tempest-ProjectMemberTests-968602289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9fa1ca4-0aa9-4bf7-a83b-cf8055f3f7bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:13:24 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ac15dff0-7a06-49df-a66a-3f26b71c7f6e tempest-ProjectMemberTests-968602289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9fa1ca4-0aa9-4bf7-a83b-cf8055f3f7bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:13:24 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ac15dff0-7a06-49df-a66a-3f26b71c7f6e tempest-ProjectMemberTests-968602289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acd301cb-6a20-4fbe-8e46-b776b57b9e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:13:24 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ac15dff0-7a06-49df-a66a-3f26b71c7f6e tempest-ProjectMemberTests-968602289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acd301cb-6a20-4fbe-8e46-b776b57b9e95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c790384-f3d7-466b-b062-faa853824dfc', 'volume_name': 'volume-3c790384-f3d7-466b-b062-faa853824dfc', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:13:24 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ac15dff0-7a06-49df-a66a-3f26b71c7f6e tempest-ProjectMemberTests-968602289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (727839f7-1066-4283-9372-b35f3d033d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:13:24 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ac15dff0-7a06-49df-a66a-3f26b71c7f6e tempest-ProjectMemberTests-968602289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (727839f7-1066-4283-9372-b35f3d033d71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:13:24 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ac15dff0-7a06-49df-a66a-3f26b71c7f6e tempest-ProjectMemberTests-968602289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fed3d643-4b04-4017-9776-a3f71479f2a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:13:24 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-ac15dff0-7a06-49df-a66a-3f26b71c7f6e tempest-ProjectMemberTests-968602289 None] Volume 3c790384-f3d7-466b-b062-faa853824dfc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c790384-f3d7-466b-b062-faa853824dfc', 'volume_size': 1} Jul 10 16:13:24 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-ac15dff0-7a06-49df-a66a-3f26b71c7f6e tempest-ProjectMemberTests-968602289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:13:24 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-ac15dff0-7a06-49df-a66a-3f26b71c7f6e tempest-ProjectMemberTests-968602289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:13:24 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-ac15dff0-7a06-49df-a66a-3f26b71c7f6e tempest-ProjectMemberTests-968602289 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:13:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1914923726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c790384-f3d7-466b-b062-faa853824dfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a62b0a8c6e6a4e9a9b6772e9c7ee6af3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:13:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:13:24Z,use_quota=True,user_id='1a439b56b94841c39eb4e94d953ccde8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 16:13:24 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-ac15dff0-7a06-49df-a66a-3f26b71c7f6e tempest-ProjectMemberTests-968602289 None] Creating volume 3c790384-f3d7-466b-b062-faa853824dfc {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 16:13:24 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-ac15dff0-7a06-49df-a66a-3f26b71c7f6e tempest-ProjectMemberTests-968602289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:13:24 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-ac15dff0-7a06-49df-a66a-3f26b71c7f6e tempest-ProjectMemberTests-968602289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:13:24 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-ac15dff0-7a06-49df-a66a-3f26b71c7f6e tempest-ProjectMemberTests-968602289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:13:24 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-ac15dff0-7a06-49df-a66a-3f26b71c7f6e tempest-ProjectMemberTests-968602289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:13:24 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-ac15dff0-7a06-49df-a66a-3f26b71c7f6e tempest-ProjectMemberTests-968602289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:13:24 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-ac15dff0-7a06-49df-a66a-3f26b71c7f6e tempest-ProjectMemberTests-968602289 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 16:13:24 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-ac15dff0-7a06-49df-a66a-3f26b71c7f6e tempest-ProjectMemberTests-968602289 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 16:13:24 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ac15dff0-7a06-49df-a66a-3f26b71c7f6e tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3c790384-f3d7-466b-b062-faa853824dfc 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:13:24 devstack sudo[106815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3c790384-f3d7-466b-b062-faa853824dfc 1073741824 Jul 10 16:13:24 devstack sudo[106815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:13:24 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-551ac9e9-5ed1-407f-9d1e-f817f2ded268 tempest-ProjectReaderTests-19712737 None] Acquiring lock "cinder-39430c1b-0334-42ed-a340-881bc8a44687-delete_snapshot" by "delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:13:24 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-551ac9e9-5ed1-407f-9d1e-f817f2ded268 tempest-ProjectReaderTests-19712737 None] Lock "cinder-39430c1b-0334-42ed-a340-881bc8a44687-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:13:24 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-551ac9e9-5ed1-407f-9d1e-f817f2ded268 tempest-ProjectReaderTests-19712737 None] Acquiring lock "cinder-quobyte-d5f3fb44-606e-4a82-b65a-c031c073afd8" by "delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:13:24 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-551ac9e9-5ed1-407f-9d1e-f817f2ded268 tempest-ProjectReaderTests-19712737 None] Lock "cinder-quobyte-d5f3fb44-606e-4a82-b65a-c031c073afd8" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:13:24 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-551ac9e9-5ed1-407f-9d1e-f817f2ded268 tempest-ProjectReaderTests-19712737 None] Acquiring lock "cinder-quobyte-39430c1b-0334-42ed-a340-881bc8a44687" by "_delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:13:24 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-551ac9e9-5ed1-407f-9d1e-f817f2ded268 tempest-ProjectReaderTests-19712737 None] Lock "cinder-quobyte-39430c1b-0334-42ed-a340-881bc8a44687" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:13:24 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-551ac9e9-5ed1-407f-9d1e-f817f2ded268 tempest-ProjectReaderTests-19712737 None] Deleting offline snapshot 39430c1b-0334-42ed-a340-881bc8a44687 of volume d5f3fb44-606e-4a82-b65a-c031c073afd8 {{(pid=87420) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 16:13:24 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-551ac9e9-5ed1-407f-9d1e-f817f2ded268 tempest-ProjectReaderTests-19712737 None] snapshot_file for this snap is: volume-d5f3fb44-606e-4a82-b65a-c031c073afd8.39430c1b-0334-42ed-a340-881bc8a44687 {{(pid=87420) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 16:13:24 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc8a353d-2313-466b-a5b8-9c741a1feb9b]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:13:24 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-551ac9e9-5ed1-407f-9d1e-f817f2ded268 tempest-ProjectReaderTests-19712737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d5f3fb44-606e-4a82-b65a-c031c073afd8.39430c1b-0334-42ed-a340-881bc8a44687 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:13:24 devstack sudo[106819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d5f3fb44-606e-4a82-b65a-c031c073afd8.39430c1b-0334-42ed-a340-881bc8a44687 Jul 10 16:13:24 devstack sudo[106819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:13:25 devstack sudo[106815]: pam_unix(sudo:session): session closed for user root Jul 10 16:13:25 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ac15dff0-7a06-49df-a66a-3f26b71c7f6e tempest-ProjectMemberTests-968602289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3c790384-f3d7-466b-b062-faa853824dfc 1073741824" returned: 0 in 0.842s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:13:25 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ac15dff0-7a06-49df-a66a-3f26b71c7f6e tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3c790384-f3d7-466b-b062-faa853824dfc {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:13:25 devstack sudo[106827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3c790384-f3d7-466b-b062-faa853824dfc Jul 10 16:13:25 devstack sudo[106827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:13:25 devstack sudo[106819]: pam_unix(sudo:session): session closed for user root Jul 10 16:13:25 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-551ac9e9-5ed1-407f-9d1e-f817f2ded268 tempest-ProjectReaderTests-19712737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d5f3fb44-606e-4a82-b65a-c031c073afd8.39430c1b-0334-42ed-a340-881bc8a44687" returned: 0 in 0.790s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:13:25 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-551ac9e9-5ed1-407f-9d1e-f817f2ded268 tempest-ProjectReaderTests-19712737 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d5f3fb44-606e-4a82-b65a-c031c073afd8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87420) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 16:13:25 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[34ffdb75-086b-4c89-8dcf-23de641ab764]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:13:25 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-551ac9e9-5ed1-407f-9d1e-f817f2ded268 tempest-ProjectReaderTests-19712737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d5f3fb44-606e-4a82-b65a-c031c073afd8 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:13:25 devstack sudo[106829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d5f3fb44-606e-4a82-b65a-c031c073afd8 Jul 10 16:13:25 devstack sudo[106829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:13:25 devstack sudo[106827]: pam_unix(sudo:session): session closed for user root Jul 10 16:13:25 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ac15dff0-7a06-49df-a66a-3f26b71c7f6e tempest-ProjectMemberTests-968602289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3c790384-f3d7-466b-b062-faa853824dfc" returned: 0 in 0.638s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:13:25 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-ac15dff0-7a06-49df-a66a-3f26b71c7f6e tempest-ProjectMemberTests-968602289 None] <== create_volume: return (1524ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 16:13:25 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-ac15dff0-7a06-49df-a66a-3f26b71c7f6e tempest-ProjectMemberTests-968602289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.527s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:13:25 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ac15dff0-7a06-49df-a66a-3f26b71c7f6e tempest-ProjectMemberTests-968602289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fed3d643-4b04-4017-9776-a3f71479f2a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c790384-f3d7-466b-b062-faa853824dfc', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:13:25 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ac15dff0-7a06-49df-a66a-3f26b71c7f6e tempest-ProjectMemberTests-968602289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (849c4c06-eb53-45aa-975b-2f95f7c0500e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:13:25 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-ac15dff0-7a06-49df-a66a-3f26b71c7f6e tempest-ProjectMemberTests-968602289 None] Volume volume-3c790384-f3d7-466b-b062-faa853824dfc (3c790384-f3d7-466b-b062-faa853824dfc): created successfully Jul 10 16:13:25 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ac15dff0-7a06-49df-a66a-3f26b71c7f6e tempest-ProjectMemberTests-968602289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (849c4c06-eb53-45aa-975b-2f95f7c0500e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:13:25 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ac15dff0-7a06-49df-a66a-3f26b71c7f6e tempest-ProjectMemberTests-968602289 None] Flow 'volume_create_manager' (7a0d47aa-ffe0-45a9-9627-36b220b64790) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:13:25 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-ac15dff0-7a06-49df-a66a-3f26b71c7f6e tempest-ProjectMemberTests-968602289 None] Created volume successfully. Jul 10 16:13:26 devstack sudo[106829]: pam_unix(sudo:session): session closed for user root Jul 10 16:13:26 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-551ac9e9-5ed1-407f-9d1e-f817f2ded268 tempest-ProjectReaderTests-19712737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d5f3fb44-606e-4a82-b65a-c031c073afd8" returned: 0 in 0.762s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:13:26 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-551ac9e9-5ed1-407f-9d1e-f817f2ded268 tempest-ProjectReaderTests-19712737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d5f3fb44-606e-4a82-b65a-c031c073afd8.39430c1b-0334-42ed-a340-881bc8a44687 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:13:26 devstack sudo[106835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d5f3fb44-606e-4a82-b65a-c031c073afd8.39430c1b-0334-42ed-a340-881bc8a44687 Jul 10 16:13:26 devstack sudo[106835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:13:26 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-838935e1-b9a8-42f9-89b4-0702ac048889 tempest-ProjectMemberTests-968602289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:13:26 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-838935e1-b9a8-42f9-89b4-0702ac048889 tempest-ProjectMemberTests-968602289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:13:26 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-838935e1-b9a8-42f9-89b4-0702ac048889 tempest-ProjectMemberTests-968602289 None] Creating offline snapshot 94786679-6dc9-4151-a646-0010b9ff45af of volume 3c790384-f3d7-466b-b062-faa853824dfc {{(pid=87420) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 16:13:26 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf9c8838-f96b-4b32-a06d-e0b4d2ae182d]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:13:26 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-838935e1-b9a8-42f9-89b4-0702ac048889 tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3c790384-f3d7-466b-b062-faa853824dfc {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:13:26 devstack sudo[106837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3c790384-f3d7-466b-b062-faa853824dfc Jul 10 16:13:26 devstack sudo[106837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:13:26 devstack sudo[106835]: pam_unix(sudo:session): session closed for user root Jul 10 16:13:26 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-551ac9e9-5ed1-407f-9d1e-f817f2ded268 tempest-ProjectReaderTests-19712737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d5f3fb44-606e-4a82-b65a-c031c073afd8.39430c1b-0334-42ed-a340-881bc8a44687" returned: 0 in 0.747s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:13:26 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-551ac9e9-5ed1-407f-9d1e-f817f2ded268 tempest-ProjectReaderTests-19712737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d5f3fb44-606e-4a82-b65a-c031c073afd8.39430c1b-0334-42ed-a340-881bc8a44687 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:13:26 devstack sudo[106842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d5f3fb44-606e-4a82-b65a-c031c073afd8.39430c1b-0334-42ed-a340-881bc8a44687 Jul 10 16:13:26 devstack sudo[106842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:13:27 devstack sudo[106837]: pam_unix(sudo:session): session closed for user root Jul 10 16:13:27 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-838935e1-b9a8-42f9-89b4-0702ac048889 tempest-ProjectMemberTests-968602289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3c790384-f3d7-466b-b062-faa853824dfc" returned: 0 in 0.785s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:13:27 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-838935e1-b9a8-42f9-89b4-0702ac048889 tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3c790384-f3d7-466b-b062-faa853824dfc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3c790384-f3d7-466b-b062-faa853824dfc.94786679-6dc9-4151-a646-0010b9ff45af 1G {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:13:27 devstack sudo[106847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3c790384-f3d7-466b-b062-faa853824dfc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3c790384-f3d7-466b-b062-faa853824dfc.94786679-6dc9-4151-a646-0010b9ff45af 1G Jul 10 16:13:27 devstack sudo[106847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:13:27 devstack sudo[106842]: pam_unix(sudo:session): session closed for user root Jul 10 16:13:27 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-551ac9e9-5ed1-407f-9d1e-f817f2ded268 tempest-ProjectReaderTests-19712737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d5f3fb44-606e-4a82-b65a-c031c073afd8.39430c1b-0334-42ed-a340-881bc8a44687" returned: 0 in 0.692s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:13:27 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-551ac9e9-5ed1-407f-9d1e-f817f2ded268 tempest-ProjectReaderTests-19712737 None] Lock "cinder-quobyte-39430c1b-0334-42ed-a340-881bc8a44687" released by "_delete_snapshot" :: held 3.096s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:13:27 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-551ac9e9-5ed1-407f-9d1e-f817f2ded268 tempest-ProjectReaderTests-19712737 None] Lock "cinder-quobyte-d5f3fb44-606e-4a82-b65a-c031c073afd8" released by "delete_snapshot" :: held 3.121s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:13:27 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-551ac9e9-5ed1-407f-9d1e-f817f2ded268 tempest-ProjectReaderTests-19712737 None] Created reservations ['e5e0d07b-c9ec-4134-ae4a-f1f9fb87d9c8', 'a7ef453f-5073-484a-8459-d8a2feb7f994', 'bda6961d-9cbc-41fb-9c8b-0d4740b17221', 'efaf7a04-e47b-4360-8317-47c06bf875fb'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:13:27 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-551ac9e9-5ed1-407f-9d1e-f817f2ded268 tempest-ProjectReaderTests-19712737 None] Delete snapshot completed successfully. Jul 10 16:13:27 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-551ac9e9-5ed1-407f-9d1e-f817f2ded268 tempest-ProjectReaderTests-19712737 None] Lock "cinder-39430c1b-0334-42ed-a340-881bc8a44687-delete_snapshot" released by "delete_snapshot" :: held 3.264s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:13:28 devstack sudo[106847]: pam_unix(sudo:session): session closed for user root Jul 10 16:13:28 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-838935e1-b9a8-42f9-89b4-0702ac048889 tempest-ProjectMemberTests-968602289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3c790384-f3d7-466b-b062-faa853824dfc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3c790384-f3d7-466b-b062-faa853824dfc.94786679-6dc9-4151-a646-0010b9ff45af 1G" returned: 0 in 0.825s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:13:28 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-838935e1-b9a8-42f9-89b4-0702ac048889 tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c790384-f3d7-466b-b062-faa853824dfc -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3c790384-f3d7-466b-b062-faa853824dfc.94786679-6dc9-4151-a646-0010b9ff45af {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:13:28 devstack sudo[106853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c790384-f3d7-466b-b062-faa853824dfc -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3c790384-f3d7-466b-b062-faa853824dfc.94786679-6dc9-4151-a646-0010b9ff45af Jul 10 16:13:28 devstack sudo[106853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:13:28 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-2f0050d8-2674-40e2-a7f2-d637e1b095c5 tempest-ProjectReaderTests-19712737 None] Acquiring lock "cinder-d5f3fb44-606e-4a82-b65a-c031c073afd8-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:13:28 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-2f0050d8-2674-40e2-a7f2-d637e1b095c5 tempest-ProjectReaderTests-19712737 None] Lock "cinder-d5f3fb44-606e-4a82-b65a-c031c073afd8-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:13:28 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-2f0050d8-2674-40e2-a7f2-d637e1b095c5 tempest-ProjectReaderTests-19712737 None] Acquiring lock "cinder-quobyte-d5f3fb44-606e-4a82-b65a-c031c073afd8" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:13:28 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-2f0050d8-2674-40e2-a7f2-d637e1b095c5 tempest-ProjectReaderTests-19712737 None] Lock "cinder-quobyte-d5f3fb44-606e-4a82-b65a-c031c073afd8" acquired by "delete_volume" :: waited 0.022s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:13:28 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fd0a173-004c-44c8-9b8c-d4f171fbbcbc]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:13:28 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-2f0050d8-2674-40e2-a7f2-d637e1b095c5 tempest-ProjectReaderTests-19712737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d5f3fb44-606e-4a82-b65a-c031c073afd8 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:13:28 devstack sudo[106853]: pam_unix(sudo:session): session closed for user root Jul 10 16:13:28 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-838935e1-b9a8-42f9-89b4-0702ac048889 tempest-ProjectMemberTests-968602289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c790384-f3d7-466b-b062-faa853824dfc -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3c790384-f3d7-466b-b062-faa853824dfc.94786679-6dc9-4151-a646-0010b9ff45af" returned: 0 in 0.725s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:13:28 devstack cinder-volume[87420]: WARNING cinder.volume.drivers.remotefs [None req-838935e1-b9a8-42f9-89b4-0702ac048889 tempest-ProjectMemberTests-968602289 None] /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3c790384-f3d7-466b-b062-faa853824dfc.94786679-6dc9-4151-a646-0010b9ff45af is being set with open permissions: ugo+rw Jul 10 16:13:28 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-838935e1-b9a8-42f9-89b4-0702ac048889 tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3c790384-f3d7-466b-b062-faa853824dfc.94786679-6dc9-4151-a646-0010b9ff45af {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:13:28 devstack sudo[106860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3c790384-f3d7-466b-b062-faa853824dfc.94786679-6dc9-4151-a646-0010b9ff45af Jul 10 16:13:28 devstack sudo[106860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:13:28 devstack sudo[106859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d5f3fb44-606e-4a82-b65a-c031c073afd8 Jul 10 16:13:28 devstack sudo[106859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:13:29 devstack sudo[106860]: pam_unix(sudo:session): session closed for user root Jul 10 16:13:29 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-838935e1-b9a8-42f9-89b4-0702ac048889 tempest-ProjectMemberTests-968602289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3c790384-f3d7-466b-b062-faa853824dfc.94786679-6dc9-4151-a646-0010b9ff45af" returned: 0 in 0.662s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:13:29 devstack sudo[106859]: pam_unix(sudo:session): session closed for user root Jul 10 16:13:29 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-2f0050d8-2674-40e2-a7f2-d637e1b095c5 tempest-ProjectReaderTests-19712737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d5f3fb44-606e-4a82-b65a-c031c073afd8" returned: 0 in 0.737s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:13:29 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-2f0050d8-2674-40e2-a7f2-d637e1b095c5 tempest-ProjectReaderTests-19712737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d5f3fb44-606e-4a82-b65a-c031c073afd8 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:13:29 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-838935e1-b9a8-42f9-89b4-0702ac048889 tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3c790384-f3d7-466b-b062-faa853824dfc.info {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:13:29 devstack sudo[106867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d5f3fb44-606e-4a82-b65a-c031c073afd8 Jul 10 16:13:29 devstack sudo[106867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:13:29 devstack sudo[106868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3c790384-f3d7-466b-b062-faa853824dfc.info Jul 10 16:13:29 devstack sudo[106868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:13:30 devstack sudo[106867]: pam_unix(sudo:session): session closed for user root Jul 10 16:13:30 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-2f0050d8-2674-40e2-a7f2-d637e1b095c5 tempest-ProjectReaderTests-19712737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-d5f3fb44-606e-4a82-b65a-c031c073afd8" returned: 0 in 0.660s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:13:30 devstack sudo[106868]: pam_unix(sudo:session): session closed for user root Jul 10 16:13:30 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-2f0050d8-2674-40e2-a7f2-d637e1b095c5 tempest-ProjectReaderTests-19712737 None] Lock "cinder-quobyte-d5f3fb44-606e-4a82-b65a-c031c073afd8" released by "delete_volume" :: held 1.460s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:13:30 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-838935e1-b9a8-42f9-89b4-0702ac048889 tempest-ProjectMemberTests-968602289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3c790384-f3d7-466b-b062-faa853824dfc.info" returned: 0 in 0.665s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:13:30 devstack cinder-volume[87420]: WARNING cinder.volume.drivers.remotefs [None req-838935e1-b9a8-42f9-89b4-0702ac048889 tempest-ProjectMemberTests-968602289 None] /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3c790384-f3d7-466b-b062-faa853824dfc.info is being set with open permissions: ugo+rw Jul 10 16:13:30 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-838935e1-b9a8-42f9-89b4-0702ac048889 tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3c790384-f3d7-466b-b062-faa853824dfc.info {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:13:30 devstack sudo[106873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3c790384-f3d7-466b-b062-faa853824dfc.info Jul 10 16:13:30 devstack sudo[106873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:13:30 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-2f0050d8-2674-40e2-a7f2-d637e1b095c5 tempest-ProjectReaderTests-19712737 None] Created reservations ['c0a4980a-abbd-4796-b81c-4f3e4f16f8e3', 'd3f8bc08-7d9c-49e2-a04b-8478cd96abe1', '950b8d3d-237e-4ab1-b68e-8b41c73ca11f', '7296f1f4-bcda-4eb1-85ba-7f100be397a0'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:13:30 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-2f0050d8-2674-40e2-a7f2-d637e1b095c5 tempest-ProjectReaderTests-19712737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:13:30 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-2f0050d8-2674-40e2-a7f2-d637e1b095c5 tempest-ProjectReaderTests-19712737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:13:30 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-2f0050d8-2674-40e2-a7f2-d637e1b095c5 tempest-ProjectReaderTests-19712737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:13:30 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-2f0050d8-2674-40e2-a7f2-d637e1b095c5 tempest-ProjectReaderTests-19712737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:13:30 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-2f0050d8-2674-40e2-a7f2-d637e1b095c5 tempest-ProjectReaderTests-19712737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:13:30 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-2f0050d8-2674-40e2-a7f2-d637e1b095c5 tempest-ProjectReaderTests-19712737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:13:30 devstack sudo[106875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:13:30 devstack sudo[106875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:13:30 devstack sudo[106873]: pam_unix(sudo:session): session closed for user root Jul 10 16:13:30 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-838935e1-b9a8-42f9-89b4-0702ac048889 tempest-ProjectMemberTests-968602289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3c790384-f3d7-466b-b062-faa853824dfc.info" returned: 0 in 0.704s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:13:30 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-838935e1-b9a8-42f9-89b4-0702ac048889 tempest-ProjectMemberTests-968602289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.461s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:13:30 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-838935e1-b9a8-42f9-89b4-0702ac048889 tempest-ProjectMemberTests-968602289 None] Create snapshot completed successfully Jul 10 16:13:31 devstack sudo[106875]: pam_unix(sudo:session): session closed for user root Jul 10 16:13:31 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-2f0050d8-2674-40e2-a7f2-d637e1b095c5 tempest-ProjectReaderTests-19712737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.703s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:13:31 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-2f0050d8-2674-40e2-a7f2-d637e1b095c5 tempest-ProjectReaderTests-19712737 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:13:31 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-2f0050d8-2674-40e2-a7f2-d637e1b095c5 tempest-ProjectReaderTests-19712737 None] Deleted volume successfully. Jul 10 16:13:31 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-2f0050d8-2674-40e2-a7f2-d637e1b095c5 tempest-ProjectReaderTests-19712737 None] Lock "cinder-d5f3fb44-606e-4a82-b65a-c031c073afd8-delete_volume" released by "delete_volume" :: held 2.384s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:13:31 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2a27e29-ab66-471c-9975-1b5d181b1cc4 tempest-ProjectReaderTests-19712737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 16:13:31 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b2a27e29-ab66-471c-9975-1b5d181b1cc4 tempest-ProjectReaderTests-19712737 None] Flow 'volume_create_manager' (e9858d46-0098-41b5-95fc-5df8e78cf716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:13:31 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b2a27e29-ab66-471c-9975-1b5d181b1cc4 tempest-ProjectReaderTests-19712737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b9d4b7c-cb55-4c3f-ad58-3539fe342fa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:13:31 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b2a27e29-ab66-471c-9975-1b5d181b1cc4 tempest-ProjectReaderTests-19712737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b9d4b7c-cb55-4c3f-ad58-3539fe342fa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:13:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1492728403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dee54790-da57-457d-bc39-152dba3c3ff8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3216e7ae39094a2295e8ea00806db82b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:13:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:13:31Z,use_quota=True,user_id='52679baac65041bb9ce548ee3dd7269c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:13:31 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b2a27e29-ab66-471c-9975-1b5d181b1cc4 tempest-ProjectReaderTests-19712737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (459e2758-4f1e-425e-a1e4-00c34b1ae59d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:13:31 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b2a27e29-ab66-471c-9975-1b5d181b1cc4 tempest-ProjectReaderTests-19712737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (459e2758-4f1e-425e-a1e4-00c34b1ae59d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:13:31 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b2a27e29-ab66-471c-9975-1b5d181b1cc4 tempest-ProjectReaderTests-19712737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (441a93b2-2f14-4b4e-ae62-ddec81bff587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:13:31 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b2a27e29-ab66-471c-9975-1b5d181b1cc4 tempest-ProjectReaderTests-19712737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (441a93b2-2f14-4b4e-ae62-ddec81bff587) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dee54790-da57-457d-bc39-152dba3c3ff8', 'volume_name': 'volume-dee54790-da57-457d-bc39-152dba3c3ff8', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:13:31 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b2a27e29-ab66-471c-9975-1b5d181b1cc4 tempest-ProjectReaderTests-19712737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86b98a78-1fc9-428c-85c0-aa196239f1d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:13:31 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b2a27e29-ab66-471c-9975-1b5d181b1cc4 tempest-ProjectReaderTests-19712737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86b98a78-1fc9-428c-85c0-aa196239f1d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:13:31 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b2a27e29-ab66-471c-9975-1b5d181b1cc4 tempest-ProjectReaderTests-19712737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5005179-3a58-4e45-a35d-a3e80f62c8a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:13:31 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-b2a27e29-ab66-471c-9975-1b5d181b1cc4 tempest-ProjectReaderTests-19712737 None] Volume dee54790-da57-457d-bc39-152dba3c3ff8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dee54790-da57-457d-bc39-152dba3c3ff8', 'volume_size': 1} Jul 10 16:13:31 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-b2a27e29-ab66-471c-9975-1b5d181b1cc4 tempest-ProjectReaderTests-19712737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:13:31 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-b2a27e29-ab66-471c-9975-1b5d181b1cc4 tempest-ProjectReaderTests-19712737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:13:31 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-b2a27e29-ab66-471c-9975-1b5d181b1cc4 tempest-ProjectReaderTests-19712737 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:13:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1492728403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dee54790-da57-457d-bc39-152dba3c3ff8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3216e7ae39094a2295e8ea00806db82b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:13:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:13:31Z,use_quota=True,user_id='52679baac65041bb9ce548ee3dd7269c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 16:13:31 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-b2a27e29-ab66-471c-9975-1b5d181b1cc4 tempest-ProjectReaderTests-19712737 None] Creating volume dee54790-da57-457d-bc39-152dba3c3ff8 {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 16:13:31 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-b2a27e29-ab66-471c-9975-1b5d181b1cc4 tempest-ProjectReaderTests-19712737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:13:31 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-b2a27e29-ab66-471c-9975-1b5d181b1cc4 tempest-ProjectReaderTests-19712737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:13:31 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-b2a27e29-ab66-471c-9975-1b5d181b1cc4 tempest-ProjectReaderTests-19712737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:13:31 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-b2a27e29-ab66-471c-9975-1b5d181b1cc4 tempest-ProjectReaderTests-19712737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:13:31 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-b2a27e29-ab66-471c-9975-1b5d181b1cc4 tempest-ProjectReaderTests-19712737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:13:31 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-b2a27e29-ab66-471c-9975-1b5d181b1cc4 tempest-ProjectReaderTests-19712737 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 16:13:31 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-b2a27e29-ab66-471c-9975-1b5d181b1cc4 tempest-ProjectReaderTests-19712737 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 16:13:31 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-b2a27e29-ab66-471c-9975-1b5d181b1cc4 tempest-ProjectReaderTests-19712737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-dee54790-da57-457d-bc39-152dba3c3ff8 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:13:31 devstack sudo[106879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-dee54790-da57-457d-bc39-152dba3c3ff8 1073741824 Jul 10 16:13:31 devstack sudo[106879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:13:31 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-a3e2614e-ab46-47be-a45b-2f129bed9da8 tempest-ProjectMemberTests-968602289 None] Acquiring lock "cinder-94786679-6dc9-4151-a646-0010b9ff45af-delete_snapshot" by "delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:13:31 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-a3e2614e-ab46-47be-a45b-2f129bed9da8 tempest-ProjectMemberTests-968602289 None] Lock "cinder-94786679-6dc9-4151-a646-0010b9ff45af-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:13:31 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-a3e2614e-ab46-47be-a45b-2f129bed9da8 tempest-ProjectMemberTests-968602289 None] Acquiring lock "cinder-quobyte-3c790384-f3d7-466b-b062-faa853824dfc" by "delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:13:31 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-a3e2614e-ab46-47be-a45b-2f129bed9da8 tempest-ProjectMemberTests-968602289 None] Lock "cinder-quobyte-3c790384-f3d7-466b-b062-faa853824dfc" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:13:31 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-a3e2614e-ab46-47be-a45b-2f129bed9da8 tempest-ProjectMemberTests-968602289 None] Acquiring lock "cinder-quobyte-94786679-6dc9-4151-a646-0010b9ff45af" by "_delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:13:31 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-a3e2614e-ab46-47be-a45b-2f129bed9da8 tempest-ProjectMemberTests-968602289 None] Lock "cinder-quobyte-94786679-6dc9-4151-a646-0010b9ff45af" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:13:31 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-a3e2614e-ab46-47be-a45b-2f129bed9da8 tempest-ProjectMemberTests-968602289 None] Deleting offline snapshot 94786679-6dc9-4151-a646-0010b9ff45af of volume 3c790384-f3d7-466b-b062-faa853824dfc {{(pid=87420) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 16:13:31 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-a3e2614e-ab46-47be-a45b-2f129bed9da8 tempest-ProjectMemberTests-968602289 None] snapshot_file for this snap is: volume-3c790384-f3d7-466b-b062-faa853824dfc.94786679-6dc9-4151-a646-0010b9ff45af {{(pid=87420) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 16:13:31 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[9733c862-4e22-40c4-b235-de8d3286b019]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:13:31 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a3e2614e-ab46-47be-a45b-2f129bed9da8 tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3c790384-f3d7-466b-b062-faa853824dfc.94786679-6dc9-4151-a646-0010b9ff45af {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:13:31 devstack sudo[106881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3c790384-f3d7-466b-b062-faa853824dfc.94786679-6dc9-4151-a646-0010b9ff45af Jul 10 16:13:31 devstack sudo[106881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:13:32 devstack sudo[106879]: pam_unix(sudo:session): session closed for user root Jul 10 16:13:32 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-b2a27e29-ab66-471c-9975-1b5d181b1cc4 tempest-ProjectReaderTests-19712737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-dee54790-da57-457d-bc39-152dba3c3ff8 1073741824" returned: 0 in 0.860s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:13:32 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-b2a27e29-ab66-471c-9975-1b5d181b1cc4 tempest-ProjectReaderTests-19712737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-dee54790-da57-457d-bc39-152dba3c3ff8 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:13:32 devstack sudo[106886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-dee54790-da57-457d-bc39-152dba3c3ff8 Jul 10 16:13:32 devstack sudo[106886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:13:32 devstack sudo[106881]: pam_unix(sudo:session): session closed for user root Jul 10 16:13:32 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a3e2614e-ab46-47be-a45b-2f129bed9da8 tempest-ProjectMemberTests-968602289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3c790384-f3d7-466b-b062-faa853824dfc.94786679-6dc9-4151-a646-0010b9ff45af" returned: 0 in 0.817s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:13:32 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-a3e2614e-ab46-47be-a45b-2f129bed9da8 tempest-ProjectMemberTests-968602289 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3c790384-f3d7-466b-b062-faa853824dfc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87420) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 16:13:32 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce4a8da4-82c3-4a5d-9eb1-27639054be2a]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:13:32 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a3e2614e-ab46-47be-a45b-2f129bed9da8 tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3c790384-f3d7-466b-b062-faa853824dfc {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:13:32 devstack sudo[106891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3c790384-f3d7-466b-b062-faa853824dfc Jul 10 16:13:32 devstack sudo[106891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:13:32 devstack sudo[106886]: pam_unix(sudo:session): session closed for user root Jul 10 16:13:32 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-b2a27e29-ab66-471c-9975-1b5d181b1cc4 tempest-ProjectReaderTests-19712737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-dee54790-da57-457d-bc39-152dba3c3ff8" returned: 0 in 0.692s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:13:32 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-b2a27e29-ab66-471c-9975-1b5d181b1cc4 tempest-ProjectReaderTests-19712737 None] <== create_volume: return (1595ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 16:13:32 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-b2a27e29-ab66-471c-9975-1b5d181b1cc4 tempest-ProjectReaderTests-19712737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.598s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:13:33 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b2a27e29-ab66-471c-9975-1b5d181b1cc4 tempest-ProjectReaderTests-19712737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5005179-3a58-4e45-a35d-a3e80f62c8a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dee54790-da57-457d-bc39-152dba3c3ff8', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:13:33 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b2a27e29-ab66-471c-9975-1b5d181b1cc4 tempest-ProjectReaderTests-19712737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44b01b48-9ec5-471b-8afd-944d2f1fb251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:13:33 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-b2a27e29-ab66-471c-9975-1b5d181b1cc4 tempest-ProjectReaderTests-19712737 None] Volume volume-dee54790-da57-457d-bc39-152dba3c3ff8 (dee54790-da57-457d-bc39-152dba3c3ff8): created successfully Jul 10 16:13:33 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b2a27e29-ab66-471c-9975-1b5d181b1cc4 tempest-ProjectReaderTests-19712737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44b01b48-9ec5-471b-8afd-944d2f1fb251) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:13:33 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b2a27e29-ab66-471c-9975-1b5d181b1cc4 tempest-ProjectReaderTests-19712737 None] Flow 'volume_create_manager' (e9858d46-0098-41b5-95fc-5df8e78cf716) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:13:33 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-b2a27e29-ab66-471c-9975-1b5d181b1cc4 tempest-ProjectReaderTests-19712737 None] Created volume successfully. Jul 10 16:13:33 devstack sudo[106891]: pam_unix(sudo:session): session closed for user root Jul 10 16:13:33 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a3e2614e-ab46-47be-a45b-2f129bed9da8 tempest-ProjectMemberTests-968602289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3c790384-f3d7-466b-b062-faa853824dfc" returned: 0 in 0.775s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:13:33 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a3e2614e-ab46-47be-a45b-2f129bed9da8 tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3c790384-f3d7-466b-b062-faa853824dfc.94786679-6dc9-4151-a646-0010b9ff45af {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:13:33 devstack sudo[106897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3c790384-f3d7-466b-b062-faa853824dfc.94786679-6dc9-4151-a646-0010b9ff45af Jul 10 16:13:33 devstack sudo[106897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:13:33 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-7866285a-80ad-44b0-ae6b-77d7fec54392 tempest-ProjectReaderTests-19712737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:13:33 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-7866285a-80ad-44b0-ae6b-77d7fec54392 tempest-ProjectReaderTests-19712737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:13:33 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-7866285a-80ad-44b0-ae6b-77d7fec54392 tempest-ProjectReaderTests-19712737 None] Creating offline snapshot c988c97d-6fc8-4768-b63c-b20eef932c6c of volume dee54790-da57-457d-bc39-152dba3c3ff8 {{(pid=87420) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 16:13:33 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f0d4be1-a351-4a59-9d17-698f123e9ce9]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:13:33 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-7866285a-80ad-44b0-ae6b-77d7fec54392 tempest-ProjectReaderTests-19712737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-dee54790-da57-457d-bc39-152dba3c3ff8 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:13:33 devstack sudo[106899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-dee54790-da57-457d-bc39-152dba3c3ff8 Jul 10 16:13:33 devstack sudo[106899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:13:34 devstack sudo[106897]: pam_unix(sudo:session): session closed for user root Jul 10 16:13:34 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a3e2614e-ab46-47be-a45b-2f129bed9da8 tempest-ProjectMemberTests-968602289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3c790384-f3d7-466b-b062-faa853824dfc.94786679-6dc9-4151-a646-0010b9ff45af" returned: 0 in 0.724s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:13:34 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a3e2614e-ab46-47be-a45b-2f129bed9da8 tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3c790384-f3d7-466b-b062-faa853824dfc.94786679-6dc9-4151-a646-0010b9ff45af {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:13:34 devstack sudo[106905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3c790384-f3d7-466b-b062-faa853824dfc.94786679-6dc9-4151-a646-0010b9ff45af Jul 10 16:13:34 devstack sudo[106905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:13:34 devstack sudo[106899]: pam_unix(sudo:session): session closed for user root Jul 10 16:13:34 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-7866285a-80ad-44b0-ae6b-77d7fec54392 tempest-ProjectReaderTests-19712737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-dee54790-da57-457d-bc39-152dba3c3ff8" returned: 0 in 0.806s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:13:34 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-7866285a-80ad-44b0-ae6b-77d7fec54392 tempest-ProjectReaderTests-19712737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-dee54790-da57-457d-bc39-152dba3c3ff8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-dee54790-da57-457d-bc39-152dba3c3ff8.c988c97d-6fc8-4768-b63c-b20eef932c6c 1G {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:13:34 devstack sudo[106910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-dee54790-da57-457d-bc39-152dba3c3ff8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-dee54790-da57-457d-bc39-152dba3c3ff8.c988c97d-6fc8-4768-b63c-b20eef932c6c 1G Jul 10 16:13:34 devstack sudo[106910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:13:34 devstack sudo[106905]: pam_unix(sudo:session): session closed for user root Jul 10 16:13:34 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a3e2614e-ab46-47be-a45b-2f129bed9da8 tempest-ProjectMemberTests-968602289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3c790384-f3d7-466b-b062-faa853824dfc.94786679-6dc9-4151-a646-0010b9ff45af" returned: 0 in 0.654s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:13:34 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-a3e2614e-ab46-47be-a45b-2f129bed9da8 tempest-ProjectMemberTests-968602289 None] Lock "cinder-quobyte-94786679-6dc9-4151-a646-0010b9ff45af" released by "_delete_snapshot" :: held 3.093s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:13:34 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-a3e2614e-ab46-47be-a45b-2f129bed9da8 tempest-ProjectMemberTests-968602289 None] Lock "cinder-quobyte-3c790384-f3d7-466b-b062-faa853824dfc" released by "delete_snapshot" :: held 3.116s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:13:34 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-a3e2614e-ab46-47be-a45b-2f129bed9da8 tempest-ProjectMemberTests-968602289 None] Created reservations ['8faab7b6-92a7-4d06-ace5-f80cd9f1880d', 'bde810cb-aa3d-4dd2-ba32-f3cb75c7a68d', 'd8682fe4-ffe6-477c-b1d2-c106a50eaa0d', '19e9649e-f4e1-49f7-82a9-1b70cb0f99e5'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:13:35 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-a3e2614e-ab46-47be-a45b-2f129bed9da8 tempest-ProjectMemberTests-968602289 None] Delete snapshot completed successfully. Jul 10 16:13:35 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-a3e2614e-ab46-47be-a45b-2f129bed9da8 tempest-ProjectMemberTests-968602289 None] Lock "cinder-94786679-6dc9-4151-a646-0010b9ff45af-delete_snapshot" released by "delete_snapshot" :: held 3.267s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:13:35 devstack sudo[106910]: pam_unix(sudo:session): session closed for user root Jul 10 16:13:35 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-7866285a-80ad-44b0-ae6b-77d7fec54392 tempest-ProjectReaderTests-19712737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-dee54790-da57-457d-bc39-152dba3c3ff8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-dee54790-da57-457d-bc39-152dba3c3ff8.c988c97d-6fc8-4768-b63c-b20eef932c6c 1G" returned: 0 in 0.812s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:13:35 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-7866285a-80ad-44b0-ae6b-77d7fec54392 tempest-ProjectReaderTests-19712737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dee54790-da57-457d-bc39-152dba3c3ff8 -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-dee54790-da57-457d-bc39-152dba3c3ff8.c988c97d-6fc8-4768-b63c-b20eef932c6c {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:13:35 devstack sudo[106916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dee54790-da57-457d-bc39-152dba3c3ff8 -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-dee54790-da57-457d-bc39-152dba3c3ff8.c988c97d-6fc8-4768-b63c-b20eef932c6c Jul 10 16:13:35 devstack sudo[106916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:13:35 devstack sudo[106916]: pam_unix(sudo:session): session closed for user root Jul 10 16:13:35 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-7866285a-80ad-44b0-ae6b-77d7fec54392 tempest-ProjectReaderTests-19712737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dee54790-da57-457d-bc39-152dba3c3ff8 -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-dee54790-da57-457d-bc39-152dba3c3ff8.c988c97d-6fc8-4768-b63c-b20eef932c6c" returned: 0 in 0.722s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:13:35 devstack cinder-volume[87420]: WARNING cinder.volume.drivers.remotefs [None req-7866285a-80ad-44b0-ae6b-77d7fec54392 tempest-ProjectReaderTests-19712737 None] /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-dee54790-da57-457d-bc39-152dba3c3ff8.c988c97d-6fc8-4768-b63c-b20eef932c6c is being set with open permissions: ugo+rw Jul 10 16:13:35 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-7866285a-80ad-44b0-ae6b-77d7fec54392 tempest-ProjectReaderTests-19712737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-dee54790-da57-457d-bc39-152dba3c3ff8.c988c97d-6fc8-4768-b63c-b20eef932c6c {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:13:35 devstack sudo[106921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-dee54790-da57-457d-bc39-152dba3c3ff8.c988c97d-6fc8-4768-b63c-b20eef932c6c Jul 10 16:13:35 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-907157d2-63cc-45d3-b82f-b7f61dda947e tempest-ProjectMemberTests-968602289 None] Acquiring lock "cinder-3c790384-f3d7-466b-b062-faa853824dfc-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:13:35 devstack sudo[106921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:13:35 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-907157d2-63cc-45d3-b82f-b7f61dda947e tempest-ProjectMemberTests-968602289 None] Lock "cinder-3c790384-f3d7-466b-b062-faa853824dfc-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:13:36 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-907157d2-63cc-45d3-b82f-b7f61dda947e tempest-ProjectMemberTests-968602289 None] Acquiring lock "cinder-quobyte-3c790384-f3d7-466b-b062-faa853824dfc" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:13:36 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-907157d2-63cc-45d3-b82f-b7f61dda947e tempest-ProjectMemberTests-968602289 None] Lock "cinder-quobyte-3c790384-f3d7-466b-b062-faa853824dfc" acquired by "delete_volume" :: waited 0.017s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:13:36 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e3d653f-3574-4f92-942f-4a6a0b79540b]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:13:36 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-907157d2-63cc-45d3-b82f-b7f61dda947e tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3c790384-f3d7-466b-b062-faa853824dfc {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:13:36 devstack sudo[106923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3c790384-f3d7-466b-b062-faa853824dfc Jul 10 16:13:36 devstack sudo[106923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:13:36 devstack sudo[106921]: pam_unix(sudo:session): session closed for user root Jul 10 16:13:36 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-7866285a-80ad-44b0-ae6b-77d7fec54392 tempest-ProjectReaderTests-19712737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-dee54790-da57-457d-bc39-152dba3c3ff8.c988c97d-6fc8-4768-b63c-b20eef932c6c" returned: 0 in 0.679s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:13:36 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-7866285a-80ad-44b0-ae6b-77d7fec54392 tempest-ProjectReaderTests-19712737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-dee54790-da57-457d-bc39-152dba3c3ff8.info {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:13:36 devstack sudo[106926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-dee54790-da57-457d-bc39-152dba3c3ff8.info Jul 10 16:13:36 devstack sudo[106926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:13:36 devstack sudo[106923]: pam_unix(sudo:session): session closed for user root Jul 10 16:13:36 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-907157d2-63cc-45d3-b82f-b7f61dda947e tempest-ProjectMemberTests-968602289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3c790384-f3d7-466b-b062-faa853824dfc" returned: 0 in 0.754s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:13:36 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-907157d2-63cc-45d3-b82f-b7f61dda947e tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3c790384-f3d7-466b-b062-faa853824dfc {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:13:36 devstack sudo[106931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3c790384-f3d7-466b-b062-faa853824dfc Jul 10 16:13:36 devstack sudo[106931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:13:37 devstack sudo[106926]: pam_unix(sudo:session): session closed for user root Jul 10 16:13:37 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-7866285a-80ad-44b0-ae6b-77d7fec54392 tempest-ProjectReaderTests-19712737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-dee54790-da57-457d-bc39-152dba3c3ff8.info" returned: 0 in 0.661s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:13:37 devstack cinder-volume[87420]: WARNING cinder.volume.drivers.remotefs [None req-7866285a-80ad-44b0-ae6b-77d7fec54392 tempest-ProjectReaderTests-19712737 None] /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-dee54790-da57-457d-bc39-152dba3c3ff8.info is being set with open permissions: ugo+rw Jul 10 16:13:37 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-7866285a-80ad-44b0-ae6b-77d7fec54392 tempest-ProjectReaderTests-19712737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-dee54790-da57-457d-bc39-152dba3c3ff8.info {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:13:37 devstack sudo[106934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-dee54790-da57-457d-bc39-152dba3c3ff8.info Jul 10 16:13:37 devstack sudo[106934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:13:37 devstack sudo[106931]: pam_unix(sudo:session): session closed for user root Jul 10 16:13:37 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-907157d2-63cc-45d3-b82f-b7f61dda947e tempest-ProjectMemberTests-968602289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-3c790384-f3d7-466b-b062-faa853824dfc" returned: 0 in 0.644s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:13:37 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-907157d2-63cc-45d3-b82f-b7f61dda947e tempest-ProjectMemberTests-968602289 None] Lock "cinder-quobyte-3c790384-f3d7-466b-b062-faa853824dfc" released by "delete_volume" :: held 1.462s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:13:37 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-907157d2-63cc-45d3-b82f-b7f61dda947e tempest-ProjectMemberTests-968602289 None] Created reservations ['7e2878ff-0956-47b1-ac21-5d43370abfa8', '794fa4b2-8542-40e4-905c-175645a80642', 'e3765a11-775d-4f74-8042-4667b464f824', 'f64f3600-a3de-4c10-b0f3-08098931830f'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:13:37 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-907157d2-63cc-45d3-b82f-b7f61dda947e tempest-ProjectMemberTests-968602289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:13:37 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-907157d2-63cc-45d3-b82f-b7f61dda947e tempest-ProjectMemberTests-968602289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:13:37 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-907157d2-63cc-45d3-b82f-b7f61dda947e tempest-ProjectMemberTests-968602289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:13:37 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-907157d2-63cc-45d3-b82f-b7f61dda947e tempest-ProjectMemberTests-968602289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:13:37 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-907157d2-63cc-45d3-b82f-b7f61dda947e tempest-ProjectMemberTests-968602289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:13:37 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-907157d2-63cc-45d3-b82f-b7f61dda947e tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:13:37 devstack sudo[106937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:13:37 devstack sudo[106937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:13:37 devstack sudo[106934]: pam_unix(sudo:session): session closed for user root Jul 10 16:13:37 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-7866285a-80ad-44b0-ae6b-77d7fec54392 tempest-ProjectReaderTests-19712737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-dee54790-da57-457d-bc39-152dba3c3ff8.info" returned: 0 in 0.650s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:13:37 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-7866285a-80ad-44b0-ae6b-77d7fec54392 tempest-ProjectReaderTests-19712737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.428s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:13:38 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-7866285a-80ad-44b0-ae6b-77d7fec54392 tempest-ProjectReaderTests-19712737 None] Create snapshot completed successfully Jul 10 16:13:38 devstack sudo[106937]: pam_unix(sudo:session): session closed for user root Jul 10 16:13:38 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-907157d2-63cc-45d3-b82f-b7f61dda947e tempest-ProjectMemberTests-968602289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.661s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:13:38 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-907157d2-63cc-45d3-b82f-b7f61dda947e tempest-ProjectMemberTests-968602289 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:13:38 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-907157d2-63cc-45d3-b82f-b7f61dda947e tempest-ProjectMemberTests-968602289 None] Deleted volume successfully. Jul 10 16:13:38 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-907157d2-63cc-45d3-b82f-b7f61dda947e tempest-ProjectMemberTests-968602289 None] Lock "cinder-3c790384-f3d7-466b-b062-faa853824dfc-delete_volume" released by "delete_volume" :: held 2.322s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:13:38 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffc72b20-d3fb-4d63-8f0b-1d32cbb0fee4 tempest-ProjectMemberTests-968602289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 16:13:38 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ffc72b20-d3fb-4d63-8f0b-1d32cbb0fee4 tempest-ProjectMemberTests-968602289 None] Flow 'volume_create_manager' (59cb5a0c-37dd-48fc-b88c-c56b69612a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:13:38 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ffc72b20-d3fb-4d63-8f0b-1d32cbb0fee4 tempest-ProjectMemberTests-968602289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f63d6d4e-4231-4f4d-96a3-42ab52c2b3db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:13:38 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ffc72b20-d3fb-4d63-8f0b-1d32cbb0fee4 tempest-ProjectMemberTests-968602289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f63d6d4e-4231-4f4d-96a3-42ab52c2b3db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:13:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-457782442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13226b21-5b32-4f0b-85ff-b99835800913,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a62b0a8c6e6a4e9a9b6772e9c7ee6af3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:13:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:13:39Z,use_quota=True,user_id='1a439b56b94841c39eb4e94d953ccde8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:13:38 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ffc72b20-d3fb-4d63-8f0b-1d32cbb0fee4 tempest-ProjectMemberTests-968602289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23054ec0-d4bb-4b50-b5b5-4ee3054cd9fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:13:38 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ffc72b20-d3fb-4d63-8f0b-1d32cbb0fee4 tempest-ProjectMemberTests-968602289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23054ec0-d4bb-4b50-b5b5-4ee3054cd9fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:13:38 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ffc72b20-d3fb-4d63-8f0b-1d32cbb0fee4 tempest-ProjectMemberTests-968602289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (763ad8fb-a821-45b0-8852-cf443b03c960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:13:38 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ffc72b20-d3fb-4d63-8f0b-1d32cbb0fee4 tempest-ProjectMemberTests-968602289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (763ad8fb-a821-45b0-8852-cf443b03c960) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13226b21-5b32-4f0b-85ff-b99835800913', 'volume_name': 'volume-13226b21-5b32-4f0b-85ff-b99835800913', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:13:38 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ffc72b20-d3fb-4d63-8f0b-1d32cbb0fee4 tempest-ProjectMemberTests-968602289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de008416-a9c7-4789-9cf9-28a76bcd285c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:13:38 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ffc72b20-d3fb-4d63-8f0b-1d32cbb0fee4 tempest-ProjectMemberTests-968602289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de008416-a9c7-4789-9cf9-28a76bcd285c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:13:38 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ffc72b20-d3fb-4d63-8f0b-1d32cbb0fee4 tempest-ProjectMemberTests-968602289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc6fa943-6dd9-4319-b878-367146be53be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:13:38 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-ffc72b20-d3fb-4d63-8f0b-1d32cbb0fee4 tempest-ProjectMemberTests-968602289 None] Volume 13226b21-5b32-4f0b-85ff-b99835800913: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13226b21-5b32-4f0b-85ff-b99835800913', 'volume_size': 1} Jul 10 16:13:38 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-ffc72b20-d3fb-4d63-8f0b-1d32cbb0fee4 tempest-ProjectMemberTests-968602289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:13:38 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-ffc72b20-d3fb-4d63-8f0b-1d32cbb0fee4 tempest-ProjectMemberTests-968602289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:13:38 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-ffc72b20-d3fb-4d63-8f0b-1d32cbb0fee4 tempest-ProjectMemberTests-968602289 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:13:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-457782442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13226b21-5b32-4f0b-85ff-b99835800913,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a62b0a8c6e6a4e9a9b6772e9c7ee6af3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:13:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:13:39Z,use_quota=True,user_id='1a439b56b94841c39eb4e94d953ccde8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 16:13:38 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-ffc72b20-d3fb-4d63-8f0b-1d32cbb0fee4 tempest-ProjectMemberTests-968602289 None] Creating volume 13226b21-5b32-4f0b-85ff-b99835800913 {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 16:13:38 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-ffc72b20-d3fb-4d63-8f0b-1d32cbb0fee4 tempest-ProjectMemberTests-968602289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:13:38 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-ffc72b20-d3fb-4d63-8f0b-1d32cbb0fee4 tempest-ProjectMemberTests-968602289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:13:38 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-ffc72b20-d3fb-4d63-8f0b-1d32cbb0fee4 tempest-ProjectMemberTests-968602289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:13:38 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-ffc72b20-d3fb-4d63-8f0b-1d32cbb0fee4 tempest-ProjectMemberTests-968602289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:13:38 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-ffc72b20-d3fb-4d63-8f0b-1d32cbb0fee4 tempest-ProjectMemberTests-968602289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:13:38 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-ffc72b20-d3fb-4d63-8f0b-1d32cbb0fee4 tempest-ProjectMemberTests-968602289 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 16:13:38 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-ffc72b20-d3fb-4d63-8f0b-1d32cbb0fee4 tempest-ProjectMemberTests-968602289 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 16:13:38 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ffc72b20-d3fb-4d63-8f0b-1d32cbb0fee4 tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-13226b21-5b32-4f0b-85ff-b99835800913 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:13:38 devstack sudo[106941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-13226b21-5b32-4f0b-85ff-b99835800913 1073741824 Jul 10 16:13:38 devstack sudo[106941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:13:38 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-ec517d26-336d-480b-978a-036039d86239 tempest-ProjectReaderTests-19712737 None] Acquiring lock "cinder-c988c97d-6fc8-4768-b63c-b20eef932c6c-delete_snapshot" by "delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:13:38 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-ec517d26-336d-480b-978a-036039d86239 tempest-ProjectReaderTests-19712737 None] Lock "cinder-c988c97d-6fc8-4768-b63c-b20eef932c6c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:13:38 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-ec517d26-336d-480b-978a-036039d86239 tempest-ProjectReaderTests-19712737 None] Acquiring lock "cinder-quobyte-dee54790-da57-457d-bc39-152dba3c3ff8" by "delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:13:38 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-ec517d26-336d-480b-978a-036039d86239 tempest-ProjectReaderTests-19712737 None] Lock "cinder-quobyte-dee54790-da57-457d-bc39-152dba3c3ff8" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:13:38 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-ec517d26-336d-480b-978a-036039d86239 tempest-ProjectReaderTests-19712737 None] Acquiring lock "cinder-quobyte-c988c97d-6fc8-4768-b63c-b20eef932c6c" by "_delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:13:38 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-ec517d26-336d-480b-978a-036039d86239 tempest-ProjectReaderTests-19712737 None] Lock "cinder-quobyte-c988c97d-6fc8-4768-b63c-b20eef932c6c" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:13:38 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-ec517d26-336d-480b-978a-036039d86239 tempest-ProjectReaderTests-19712737 None] Deleting offline snapshot c988c97d-6fc8-4768-b63c-b20eef932c6c of volume dee54790-da57-457d-bc39-152dba3c3ff8 {{(pid=87420) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 16:13:38 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-ec517d26-336d-480b-978a-036039d86239 tempest-ProjectReaderTests-19712737 None] snapshot_file for this snap is: volume-dee54790-da57-457d-bc39-152dba3c3ff8.c988c97d-6fc8-4768-b63c-b20eef932c6c {{(pid=87420) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 16:13:38 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f83a2e5-6e72-459a-bde7-694e5aea0b74]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:13:38 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ec517d26-336d-480b-978a-036039d86239 tempest-ProjectReaderTests-19712737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-dee54790-da57-457d-bc39-152dba3c3ff8.c988c97d-6fc8-4768-b63c-b20eef932c6c {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:13:39 devstack sudo[106943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-dee54790-da57-457d-bc39-152dba3c3ff8.c988c97d-6fc8-4768-b63c-b20eef932c6c Jul 10 16:13:39 devstack sudo[106943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:13:39 devstack sudo[106941]: pam_unix(sudo:session): session closed for user root Jul 10 16:13:39 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ffc72b20-d3fb-4d63-8f0b-1d32cbb0fee4 tempest-ProjectMemberTests-968602289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-13226b21-5b32-4f0b-85ff-b99835800913 1073741824" returned: 0 in 0.840s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:13:39 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ffc72b20-d3fb-4d63-8f0b-1d32cbb0fee4 tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-13226b21-5b32-4f0b-85ff-b99835800913 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:13:39 devstack sudo[106951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-13226b21-5b32-4f0b-85ff-b99835800913 Jul 10 16:13:39 devstack sudo[106951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:13:39 devstack sudo[106943]: pam_unix(sudo:session): session closed for user root Jul 10 16:13:39 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ec517d26-336d-480b-978a-036039d86239 tempest-ProjectReaderTests-19712737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-dee54790-da57-457d-bc39-152dba3c3ff8.c988c97d-6fc8-4768-b63c-b20eef932c6c" returned: 0 in 0.782s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:13:39 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-ec517d26-336d-480b-978a-036039d86239 tempest-ProjectReaderTests-19712737 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dee54790-da57-457d-bc39-152dba3c3ff8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87420) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 16:13:39 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[c31ed917-7c22-47b3-a8c0-ac6bf76180e2]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:13:39 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ec517d26-336d-480b-978a-036039d86239 tempest-ProjectReaderTests-19712737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-dee54790-da57-457d-bc39-152dba3c3ff8 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:13:39 devstack sudo[106955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-dee54790-da57-457d-bc39-152dba3c3ff8 Jul 10 16:13:39 devstack sudo[106955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:13:40 devstack sudo[106951]: pam_unix(sudo:session): session closed for user root Jul 10 16:13:40 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ffc72b20-d3fb-4d63-8f0b-1d32cbb0fee4 tempest-ProjectMemberTests-968602289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-13226b21-5b32-4f0b-85ff-b99835800913" returned: 0 in 0.687s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:13:40 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-ffc72b20-d3fb-4d63-8f0b-1d32cbb0fee4 tempest-ProjectMemberTests-968602289 None] <== create_volume: return (1568ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 16:13:40 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-ffc72b20-d3fb-4d63-8f0b-1d32cbb0fee4 tempest-ProjectMemberTests-968602289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.570s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:13:40 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ffc72b20-d3fb-4d63-8f0b-1d32cbb0fee4 tempest-ProjectMemberTests-968602289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc6fa943-6dd9-4319-b878-367146be53be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13226b21-5b32-4f0b-85ff-b99835800913', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:13:40 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ffc72b20-d3fb-4d63-8f0b-1d32cbb0fee4 tempest-ProjectMemberTests-968602289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (994c9acb-e4a6-48e1-a184-18d8ee66f67f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:13:40 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-ffc72b20-d3fb-4d63-8f0b-1d32cbb0fee4 tempest-ProjectMemberTests-968602289 None] Volume volume-13226b21-5b32-4f0b-85ff-b99835800913 (13226b21-5b32-4f0b-85ff-b99835800913): created successfully Jul 10 16:13:40 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ffc72b20-d3fb-4d63-8f0b-1d32cbb0fee4 tempest-ProjectMemberTests-968602289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (994c9acb-e4a6-48e1-a184-18d8ee66f67f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:13:40 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-ffc72b20-d3fb-4d63-8f0b-1d32cbb0fee4 tempest-ProjectMemberTests-968602289 None] Flow 'volume_create_manager' (59cb5a0c-37dd-48fc-b88c-c56b69612a43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:13:40 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-ffc72b20-d3fb-4d63-8f0b-1d32cbb0fee4 tempest-ProjectMemberTests-968602289 None] Created volume successfully. Jul 10 16:13:40 devstack sudo[106955]: pam_unix(sudo:session): session closed for user root Jul 10 16:13:40 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ec517d26-336d-480b-978a-036039d86239 tempest-ProjectReaderTests-19712737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-dee54790-da57-457d-bc39-152dba3c3ff8" returned: 0 in 0.791s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:13:40 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ec517d26-336d-480b-978a-036039d86239 tempest-ProjectReaderTests-19712737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-dee54790-da57-457d-bc39-152dba3c3ff8.c988c97d-6fc8-4768-b63c-b20eef932c6c {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:13:40 devstack sudo[106961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-dee54790-da57-457d-bc39-152dba3c3ff8.c988c97d-6fc8-4768-b63c-b20eef932c6c Jul 10 16:13:40 devstack sudo[106961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:13:40 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-427c720a-67bc-4676-821d-3841a0949c7d tempest-ProjectMemberTests-968602289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:13:40 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-427c720a-67bc-4676-821d-3841a0949c7d tempest-ProjectMemberTests-968602289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:13:40 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-427c720a-67bc-4676-821d-3841a0949c7d tempest-ProjectMemberTests-968602289 None] Creating offline snapshot 0b01ebbf-8bec-40c4-a2e3-d78163c01a02 of volume 13226b21-5b32-4f0b-85ff-b99835800913 {{(pid=87420) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 16:13:40 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[10c0cdb4-e78f-4101-b861-f1d3df289596]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:13:40 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-427c720a-67bc-4676-821d-3841a0949c7d tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-13226b21-5b32-4f0b-85ff-b99835800913 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:13:40 devstack sudo[106981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-13226b21-5b32-4f0b-85ff-b99835800913 Jul 10 16:13:40 devstack sudo[106981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:13:41 devstack sudo[106961]: pam_unix(sudo:session): session closed for user root Jul 10 16:13:41 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ec517d26-336d-480b-978a-036039d86239 tempest-ProjectReaderTests-19712737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-dee54790-da57-457d-bc39-152dba3c3ff8.c988c97d-6fc8-4768-b63c-b20eef932c6c" returned: 0 in 0.801s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:13:41 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ec517d26-336d-480b-978a-036039d86239 tempest-ProjectReaderTests-19712737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-dee54790-da57-457d-bc39-152dba3c3ff8.c988c97d-6fc8-4768-b63c-b20eef932c6c {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:13:41 devstack sudo[107005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-dee54790-da57-457d-bc39-152dba3c3ff8.c988c97d-6fc8-4768-b63c-b20eef932c6c Jul 10 16:13:41 devstack sudo[107005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:13:41 devstack sudo[106981]: pam_unix(sudo:session): session closed for user root Jul 10 16:13:41 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-427c720a-67bc-4676-821d-3841a0949c7d tempest-ProjectMemberTests-968602289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-13226b21-5b32-4f0b-85ff-b99835800913" returned: 0 in 0.784s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:13:41 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-427c720a-67bc-4676-821d-3841a0949c7d tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-13226b21-5b32-4f0b-85ff-b99835800913,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-13226b21-5b32-4f0b-85ff-b99835800913.0b01ebbf-8bec-40c4-a2e3-d78163c01a02 1G {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:13:41 devstack sudo[107010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-13226b21-5b32-4f0b-85ff-b99835800913,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-13226b21-5b32-4f0b-85ff-b99835800913.0b01ebbf-8bec-40c4-a2e3-d78163c01a02 1G Jul 10 16:13:41 devstack sudo[107010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:13:41 devstack sudo[107005]: pam_unix(sudo:session): session closed for user root Jul 10 16:13:41 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ec517d26-336d-480b-978a-036039d86239 tempest-ProjectReaderTests-19712737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-dee54790-da57-457d-bc39-152dba3c3ff8.c988c97d-6fc8-4768-b63c-b20eef932c6c" returned: 0 in 0.669s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:13:42 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-ec517d26-336d-480b-978a-036039d86239 tempest-ProjectReaderTests-19712737 None] Lock "cinder-quobyte-c988c97d-6fc8-4768-b63c-b20eef932c6c" released by "_delete_snapshot" :: held 3.149s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:13:42 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-ec517d26-336d-480b-978a-036039d86239 tempest-ProjectReaderTests-19712737 None] Lock "cinder-quobyte-dee54790-da57-457d-bc39-152dba3c3ff8" released by "delete_snapshot" :: held 3.180s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:13:42 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-ec517d26-336d-480b-978a-036039d86239 tempest-ProjectReaderTests-19712737 None] Created reservations ['d0f4879f-95b2-4906-9a00-5e27761933fc', '14776658-fedc-4843-9d57-f7e58eaf577d', '497e623c-cad7-458d-9d18-d119aa31ca5a', 'af9d6d20-8cd7-421f-b8d3-91df69e57e69'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:13:42 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-ec517d26-336d-480b-978a-036039d86239 tempest-ProjectReaderTests-19712737 None] Delete snapshot completed successfully. Jul 10 16:13:42 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-ec517d26-336d-480b-978a-036039d86239 tempest-ProjectReaderTests-19712737 None] Lock "cinder-c988c97d-6fc8-4768-b63c-b20eef932c6c-delete_snapshot" released by "delete_snapshot" :: held 3.317s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:13:42 devstack sudo[107010]: pam_unix(sudo:session): session closed for user root Jul 10 16:13:42 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-427c720a-67bc-4676-821d-3841a0949c7d tempest-ProjectMemberTests-968602289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-13226b21-5b32-4f0b-85ff-b99835800913,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-13226b21-5b32-4f0b-85ff-b99835800913.0b01ebbf-8bec-40c4-a2e3-d78163c01a02 1G" returned: 0 in 0.786s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:13:42 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-427c720a-67bc-4676-821d-3841a0949c7d tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13226b21-5b32-4f0b-85ff-b99835800913 -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-13226b21-5b32-4f0b-85ff-b99835800913.0b01ebbf-8bec-40c4-a2e3-d78163c01a02 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:13:42 devstack sudo[107016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13226b21-5b32-4f0b-85ff-b99835800913 -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-13226b21-5b32-4f0b-85ff-b99835800913.0b01ebbf-8bec-40c4-a2e3-d78163c01a02 Jul 10 16:13:42 devstack sudo[107016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:13:43 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-6fe749ae-00b7-49e5-9296-18293b0e0e36 tempest-ProjectReaderTests-19712737 None] Acquiring lock "cinder-dee54790-da57-457d-bc39-152dba3c3ff8-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:13:43 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-6fe749ae-00b7-49e5-9296-18293b0e0e36 tempest-ProjectReaderTests-19712737 None] Lock "cinder-dee54790-da57-457d-bc39-152dba3c3ff8-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:13:43 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-6fe749ae-00b7-49e5-9296-18293b0e0e36 tempest-ProjectReaderTests-19712737 None] Acquiring lock "cinder-quobyte-dee54790-da57-457d-bc39-152dba3c3ff8" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:13:43 devstack sudo[107016]: pam_unix(sudo:session): session closed for user root Jul 10 16:13:43 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-427c720a-67bc-4676-821d-3841a0949c7d tempest-ProjectMemberTests-968602289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13226b21-5b32-4f0b-85ff-b99835800913 -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-13226b21-5b32-4f0b-85ff-b99835800913.0b01ebbf-8bec-40c4-a2e3-d78163c01a02" returned: 0 in 0.699s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:13:43 devstack cinder-volume[87420]: WARNING cinder.volume.drivers.remotefs [None req-427c720a-67bc-4676-821d-3841a0949c7d tempest-ProjectMemberTests-968602289 None] /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-13226b21-5b32-4f0b-85ff-b99835800913.0b01ebbf-8bec-40c4-a2e3-d78163c01a02 is being set with open permissions: ugo+rw Jul 10 16:13:43 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-427c720a-67bc-4676-821d-3841a0949c7d tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-13226b21-5b32-4f0b-85ff-b99835800913.0b01ebbf-8bec-40c4-a2e3-d78163c01a02 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:13:43 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-6fe749ae-00b7-49e5-9296-18293b0e0e36 tempest-ProjectReaderTests-19712737 None] Lock "cinder-quobyte-dee54790-da57-457d-bc39-152dba3c3ff8" acquired by "delete_volume" :: waited 0.031s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:13:43 devstack sudo[107021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-13226b21-5b32-4f0b-85ff-b99835800913.0b01ebbf-8bec-40c4-a2e3-d78163c01a02 Jul 10 16:13:43 devstack sudo[107021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:13:43 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[617e69b2-1cd8-4d06-a824-78e9cb6e98dc]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:13:43 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6fe749ae-00b7-49e5-9296-18293b0e0e36 tempest-ProjectReaderTests-19712737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-dee54790-da57-457d-bc39-152dba3c3ff8 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:13:43 devstack sudo[107023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-dee54790-da57-457d-bc39-152dba3c3ff8 Jul 10 16:13:43 devstack sudo[107023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:13:43 devstack sudo[107021]: pam_unix(sudo:session): session closed for user root Jul 10 16:13:43 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-427c720a-67bc-4676-821d-3841a0949c7d tempest-ProjectMemberTests-968602289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-13226b21-5b32-4f0b-85ff-b99835800913.0b01ebbf-8bec-40c4-a2e3-d78163c01a02" returned: 0 in 0.657s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:13:43 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-427c720a-67bc-4676-821d-3841a0949c7d tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-13226b21-5b32-4f0b-85ff-b99835800913.info {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:13:43 devstack sudo[107028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-13226b21-5b32-4f0b-85ff-b99835800913.info Jul 10 16:13:43 devstack sudo[107028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:13:43 devstack sudo[107023]: pam_unix(sudo:session): session closed for user root Jul 10 16:13:43 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6fe749ae-00b7-49e5-9296-18293b0e0e36 tempest-ProjectReaderTests-19712737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-dee54790-da57-457d-bc39-152dba3c3ff8" returned: 0 in 0.769s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:13:43 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6fe749ae-00b7-49e5-9296-18293b0e0e36 tempest-ProjectReaderTests-19712737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-dee54790-da57-457d-bc39-152dba3c3ff8 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:13:44 devstack sudo[107032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-dee54790-da57-457d-bc39-152dba3c3ff8 Jul 10 16:13:44 devstack sudo[107032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:13:44 devstack sudo[107028]: pam_unix(sudo:session): session closed for user root Jul 10 16:13:44 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-427c720a-67bc-4676-821d-3841a0949c7d tempest-ProjectMemberTests-968602289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-13226b21-5b32-4f0b-85ff-b99835800913.info" returned: 0 in 0.658s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:13:44 devstack cinder-volume[87420]: WARNING cinder.volume.drivers.remotefs [None req-427c720a-67bc-4676-821d-3841a0949c7d tempest-ProjectMemberTests-968602289 None] /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-13226b21-5b32-4f0b-85ff-b99835800913.info is being set with open permissions: ugo+rw Jul 10 16:13:44 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-427c720a-67bc-4676-821d-3841a0949c7d tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-13226b21-5b32-4f0b-85ff-b99835800913.info {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:13:44 devstack sudo[107035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-13226b21-5b32-4f0b-85ff-b99835800913.info Jul 10 16:13:44 devstack sudo[107035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:13:44 devstack sudo[107032]: pam_unix(sudo:session): session closed for user root Jul 10 16:13:44 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6fe749ae-00b7-49e5-9296-18293b0e0e36 tempest-ProjectReaderTests-19712737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-dee54790-da57-457d-bc39-152dba3c3ff8" returned: 0 in 0.647s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:13:44 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-6fe749ae-00b7-49e5-9296-18293b0e0e36 tempest-ProjectReaderTests-19712737 None] Lock "cinder-quobyte-dee54790-da57-457d-bc39-152dba3c3ff8" released by "delete_volume" :: held 1.477s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:13:44 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-6fe749ae-00b7-49e5-9296-18293b0e0e36 tempest-ProjectReaderTests-19712737 None] Created reservations ['f4be0ccf-56e8-4e85-98eb-585c00aa2d97', 'edbc3f1b-f569-498a-8be0-fe143ea4630e', 'bb56c478-7b51-4194-b311-aea71ded914e', 'df06817a-15bb-4a7c-bb33-c897bf6cef0c'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:13:44 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-6fe749ae-00b7-49e5-9296-18293b0e0e36 tempest-ProjectReaderTests-19712737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:13:44 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-6fe749ae-00b7-49e5-9296-18293b0e0e36 tempest-ProjectReaderTests-19712737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:13:44 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-6fe749ae-00b7-49e5-9296-18293b0e0e36 tempest-ProjectReaderTests-19712737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:13:44 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-6fe749ae-00b7-49e5-9296-18293b0e0e36 tempest-ProjectReaderTests-19712737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:13:44 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-6fe749ae-00b7-49e5-9296-18293b0e0e36 tempest-ProjectReaderTests-19712737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:13:44 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6fe749ae-00b7-49e5-9296-18293b0e0e36 tempest-ProjectReaderTests-19712737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:13:44 devstack sudo[107038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:13:44 devstack sudo[107038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:13:45 devstack sudo[107035]: pam_unix(sudo:session): session closed for user root Jul 10 16:13:45 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-427c720a-67bc-4676-821d-3841a0949c7d tempest-ProjectMemberTests-968602289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-13226b21-5b32-4f0b-85ff-b99835800913.info" returned: 0 in 0.644s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:13:45 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-427c720a-67bc-4676-821d-3841a0949c7d tempest-ProjectMemberTests-968602289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.310s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:13:45 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-427c720a-67bc-4676-821d-3841a0949c7d tempest-ProjectMemberTests-968602289 None] Create snapshot completed successfully Jul 10 16:13:45 devstack sudo[107038]: pam_unix(sudo:session): session closed for user root Jul 10 16:13:45 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6fe749ae-00b7-49e5-9296-18293b0e0e36 tempest-ProjectReaderTests-19712737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.647s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:13:45 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-6fe749ae-00b7-49e5-9296-18293b0e0e36 tempest-ProjectReaderTests-19712737 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:13:45 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-6fe749ae-00b7-49e5-9296-18293b0e0e36 tempest-ProjectReaderTests-19712737 None] Deleted volume successfully. Jul 10 16:13:45 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-6fe749ae-00b7-49e5-9296-18293b0e0e36 tempest-ProjectReaderTests-19712737 None] Lock "cinder-dee54790-da57-457d-bc39-152dba3c3ff8-delete_volume" released by "delete_volume" :: held 2.349s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:13:46 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-1e32cdaf-3a36-47cf-926b-cc6326e4edd3 tempest-ProjectMemberTests-968602289 None] Acquiring lock "cinder-0b01ebbf-8bec-40c4-a2e3-d78163c01a02-delete_snapshot" by "delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:13:46 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-1e32cdaf-3a36-47cf-926b-cc6326e4edd3 tempest-ProjectMemberTests-968602289 None] Lock "cinder-0b01ebbf-8bec-40c4-a2e3-d78163c01a02-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:13:46 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-1e32cdaf-3a36-47cf-926b-cc6326e4edd3 tempest-ProjectMemberTests-968602289 None] Acquiring lock "cinder-quobyte-13226b21-5b32-4f0b-85ff-b99835800913" by "delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:13:46 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-1e32cdaf-3a36-47cf-926b-cc6326e4edd3 tempest-ProjectMemberTests-968602289 None] Lock "cinder-quobyte-13226b21-5b32-4f0b-85ff-b99835800913" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:13:46 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-1e32cdaf-3a36-47cf-926b-cc6326e4edd3 tempest-ProjectMemberTests-968602289 None] Acquiring lock "cinder-quobyte-0b01ebbf-8bec-40c4-a2e3-d78163c01a02" by "_delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:13:46 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-1e32cdaf-3a36-47cf-926b-cc6326e4edd3 tempest-ProjectMemberTests-968602289 None] Lock "cinder-quobyte-0b01ebbf-8bec-40c4-a2e3-d78163c01a02" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:13:46 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-1e32cdaf-3a36-47cf-926b-cc6326e4edd3 tempest-ProjectMemberTests-968602289 None] Deleting offline snapshot 0b01ebbf-8bec-40c4-a2e3-d78163c01a02 of volume 13226b21-5b32-4f0b-85ff-b99835800913 {{(pid=87420) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 16:13:46 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-1e32cdaf-3a36-47cf-926b-cc6326e4edd3 tempest-ProjectMemberTests-968602289 None] snapshot_file for this snap is: volume-13226b21-5b32-4f0b-85ff-b99835800913.0b01ebbf-8bec-40c4-a2e3-d78163c01a02 {{(pid=87420) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 16:13:46 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d587573-2186-475f-9866-489e92506dc8]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:13:46 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-1e32cdaf-3a36-47cf-926b-cc6326e4edd3 tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-13226b21-5b32-4f0b-85ff-b99835800913.0b01ebbf-8bec-40c4-a2e3-d78163c01a02 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:13:46 devstack sudo[107042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-13226b21-5b32-4f0b-85ff-b99835800913.0b01ebbf-8bec-40c4-a2e3-d78163c01a02 Jul 10 16:13:46 devstack sudo[107042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:13:46 devstack sudo[107042]: pam_unix(sudo:session): session closed for user root Jul 10 16:13:46 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-1e32cdaf-3a36-47cf-926b-cc6326e4edd3 tempest-ProjectMemberTests-968602289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-13226b21-5b32-4f0b-85ff-b99835800913.0b01ebbf-8bec-40c4-a2e3-d78163c01a02" returned: 0 in 0.783s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:13:46 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-1e32cdaf-3a36-47cf-926b-cc6326e4edd3 tempest-ProjectMemberTests-968602289 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-13226b21-5b32-4f0b-85ff-b99835800913(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87420) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 16:13:46 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[68f33dd9-5452-4701-bd83-a83e5f6e86ae]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:13:46 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-1e32cdaf-3a36-47cf-926b-cc6326e4edd3 tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-13226b21-5b32-4f0b-85ff-b99835800913 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:13:47 devstack sudo[107054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-13226b21-5b32-4f0b-85ff-b99835800913 Jul 10 16:13:47 devstack sudo[107054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:13:47 devstack sudo[107054]: pam_unix(sudo:session): session closed for user root Jul 10 16:13:47 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-1e32cdaf-3a36-47cf-926b-cc6326e4edd3 tempest-ProjectMemberTests-968602289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-13226b21-5b32-4f0b-85ff-b99835800913" returned: 0 in 0.811s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:13:47 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-1e32cdaf-3a36-47cf-926b-cc6326e4edd3 tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-13226b21-5b32-4f0b-85ff-b99835800913.0b01ebbf-8bec-40c4-a2e3-d78163c01a02 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:13:47 devstack sudo[107059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-13226b21-5b32-4f0b-85ff-b99835800913.0b01ebbf-8bec-40c4-a2e3-d78163c01a02 Jul 10 16:13:47 devstack sudo[107059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:13:48 devstack sudo[107059]: pam_unix(sudo:session): session closed for user root Jul 10 16:13:48 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-1e32cdaf-3a36-47cf-926b-cc6326e4edd3 tempest-ProjectMemberTests-968602289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-13226b21-5b32-4f0b-85ff-b99835800913.0b01ebbf-8bec-40c4-a2e3-d78163c01a02" returned: 0 in 0.800s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:13:48 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-1e32cdaf-3a36-47cf-926b-cc6326e4edd3 tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-13226b21-5b32-4f0b-85ff-b99835800913.0b01ebbf-8bec-40c4-a2e3-d78163c01a02 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:13:48 devstack sudo[107064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-13226b21-5b32-4f0b-85ff-b99835800913.0b01ebbf-8bec-40c4-a2e3-d78163c01a02 Jul 10 16:13:48 devstack sudo[107064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:13:49 devstack sudo[107064]: pam_unix(sudo:session): session closed for user root Jul 10 16:13:49 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-1e32cdaf-3a36-47cf-926b-cc6326e4edd3 tempest-ProjectMemberTests-968602289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-13226b21-5b32-4f0b-85ff-b99835800913.0b01ebbf-8bec-40c4-a2e3-d78163c01a02" returned: 0 in 0.643s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:13:49 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-1e32cdaf-3a36-47cf-926b-cc6326e4edd3 tempest-ProjectMemberTests-968602289 None] Lock "cinder-quobyte-0b01ebbf-8bec-40c4-a2e3-d78163c01a02" released by "_delete_snapshot" :: held 3.131s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:13:49 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-1e32cdaf-3a36-47cf-926b-cc6326e4edd3 tempest-ProjectMemberTests-968602289 None] Lock "cinder-quobyte-13226b21-5b32-4f0b-85ff-b99835800913" released by "delete_snapshot" :: held 3.155s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:13:49 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-1e32cdaf-3a36-47cf-926b-cc6326e4edd3 tempest-ProjectMemberTests-968602289 None] Created reservations ['788b3d6b-9926-4da0-b125-57befa0cd67b', 'c19ebcc8-8f5b-4c10-9821-5f8c5f5099e8', '6780fe55-dc46-44cc-b7b6-2830607d58b4', '4019c98f-15b9-40bf-96cc-f8ac16702f8d'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:13:49 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-1e32cdaf-3a36-47cf-926b-cc6326e4edd3 tempest-ProjectMemberTests-968602289 None] Delete snapshot completed successfully. Jul 10 16:13:49 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-1e32cdaf-3a36-47cf-926b-cc6326e4edd3 tempest-ProjectMemberTests-968602289 None] Lock "cinder-0b01ebbf-8bec-40c4-a2e3-d78163c01a02-delete_snapshot" released by "delete_snapshot" :: held 3.283s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:13:50 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-cd7b9f17-cbcc-4a76-bafb-c86463013a10 tempest-ProjectMemberTests-968602289 None] Acquiring lock "cinder-13226b21-5b32-4f0b-85ff-b99835800913-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:13:50 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-cd7b9f17-cbcc-4a76-bafb-c86463013a10 tempest-ProjectMemberTests-968602289 None] Lock "cinder-13226b21-5b32-4f0b-85ff-b99835800913-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:13:50 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-cd7b9f17-cbcc-4a76-bafb-c86463013a10 tempest-ProjectMemberTests-968602289 None] Acquiring lock "cinder-quobyte-13226b21-5b32-4f0b-85ff-b99835800913" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:13:50 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-cd7b9f17-cbcc-4a76-bafb-c86463013a10 tempest-ProjectMemberTests-968602289 None] Lock "cinder-quobyte-13226b21-5b32-4f0b-85ff-b99835800913" acquired by "delete_volume" :: waited 0.018s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:13:50 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[46d60b17-f282-4f8b-8f7a-5bcc4d420543]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:13:50 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-cd7b9f17-cbcc-4a76-bafb-c86463013a10 tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-13226b21-5b32-4f0b-85ff-b99835800913 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:13:50 devstack sudo[107067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-13226b21-5b32-4f0b-85ff-b99835800913 Jul 10 16:13:50 devstack sudo[107067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:13:51 devstack sudo[107067]: pam_unix(sudo:session): session closed for user root Jul 10 16:13:51 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-cd7b9f17-cbcc-4a76-bafb-c86463013a10 tempest-ProjectMemberTests-968602289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-13226b21-5b32-4f0b-85ff-b99835800913" returned: 0 in 0.745s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:13:51 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-cd7b9f17-cbcc-4a76-bafb-c86463013a10 tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-13226b21-5b32-4f0b-85ff-b99835800913 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:13:51 devstack sudo[107072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-13226b21-5b32-4f0b-85ff-b99835800913 Jul 10 16:13:51 devstack sudo[107072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:13:51 devstack sudo[107072]: pam_unix(sudo:session): session closed for user root Jul 10 16:13:51 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-cd7b9f17-cbcc-4a76-bafb-c86463013a10 tempest-ProjectMemberTests-968602289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-13226b21-5b32-4f0b-85ff-b99835800913" returned: 0 in 0.671s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:13:51 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-cd7b9f17-cbcc-4a76-bafb-c86463013a10 tempest-ProjectMemberTests-968602289 None] Lock "cinder-quobyte-13226b21-5b32-4f0b-85ff-b99835800913" released by "delete_volume" :: held 1.496s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:13:51 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-cd7b9f17-cbcc-4a76-bafb-c86463013a10 tempest-ProjectMemberTests-968602289 None] Created reservations ['aa00db18-e32d-4225-b352-c155e01c4f53', '679f6f9e-cd99-40c9-9c11-b51dfc99c916', '235898f4-b4e1-4078-8273-cdcc37dc8e81', '98877599-3c3c-49f6-b9cb-d99e98d6c795'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:13:51 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-cd7b9f17-cbcc-4a76-bafb-c86463013a10 tempest-ProjectMemberTests-968602289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:13:51 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-cd7b9f17-cbcc-4a76-bafb-c86463013a10 tempest-ProjectMemberTests-968602289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:13:51 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-cd7b9f17-cbcc-4a76-bafb-c86463013a10 tempest-ProjectMemberTests-968602289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:13:51 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-cd7b9f17-cbcc-4a76-bafb-c86463013a10 tempest-ProjectMemberTests-968602289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:13:51 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-cd7b9f17-cbcc-4a76-bafb-c86463013a10 tempest-ProjectMemberTests-968602289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:13:51 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-cd7b9f17-cbcc-4a76-bafb-c86463013a10 tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:13:52 devstack sudo[107075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:13:52 devstack sudo[107075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:13:52 devstack sudo[107075]: pam_unix(sudo:session): session closed for user root Jul 10 16:13:52 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-cd7b9f17-cbcc-4a76-bafb-c86463013a10 tempest-ProjectMemberTests-968602289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.662s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:13:52 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-cd7b9f17-cbcc-4a76-bafb-c86463013a10 tempest-ProjectMemberTests-968602289 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:13:52 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-cd7b9f17-cbcc-4a76-bafb-c86463013a10 tempest-ProjectMemberTests-968602289 None] Deleted volume successfully. Jul 10 16:13:52 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-cd7b9f17-cbcc-4a76-bafb-c86463013a10 tempest-ProjectMemberTests-968602289 None] Lock "cinder-13226b21-5b32-4f0b-85ff-b99835800913-delete_volume" released by "delete_volume" :: held 2.372s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:13:52 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa377324-3112-4abb-8003-97b38735ad43 tempest-ProjectMemberTests-968602289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 16:13:52 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-fa377324-3112-4abb-8003-97b38735ad43 tempest-ProjectMemberTests-968602289 None] Flow 'volume_create_manager' (06a0b1eb-a7fe-4bf9-9f07-9ca811b56164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:13:52 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-fa377324-3112-4abb-8003-97b38735ad43 tempest-ProjectMemberTests-968602289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7a46dde-7162-4acb-a3aa-201d93e88dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:13:52 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-fa377324-3112-4abb-8003-97b38735ad43 tempest-ProjectMemberTests-968602289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7a46dde-7162-4acb-a3aa-201d93e88dce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:13:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1014870706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a27724e1-9afe-49bf-82de-418b21dfd6ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a62b0a8c6e6a4e9a9b6772e9c7ee6af3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:13:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:13:53Z,use_quota=True,user_id='1a439b56b94841c39eb4e94d953ccde8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:13:52 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-fa377324-3112-4abb-8003-97b38735ad43 tempest-ProjectMemberTests-968602289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c71fc483-325d-42d4-9c11-494cb8a824d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:13:52 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-fa377324-3112-4abb-8003-97b38735ad43 tempest-ProjectMemberTests-968602289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c71fc483-325d-42d4-9c11-494cb8a824d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:13:52 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-fa377324-3112-4abb-8003-97b38735ad43 tempest-ProjectMemberTests-968602289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41134006-63c8-416f-aeb1-b4ac0fe54e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:13:52 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-fa377324-3112-4abb-8003-97b38735ad43 tempest-ProjectMemberTests-968602289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41134006-63c8-416f-aeb1-b4ac0fe54e24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a27724e1-9afe-49bf-82de-418b21dfd6ae', 'volume_name': 'volume-a27724e1-9afe-49bf-82de-418b21dfd6ae', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:13:53 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-fa377324-3112-4abb-8003-97b38735ad43 tempest-ProjectMemberTests-968602289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac76f7e7-f7f1-40f2-b573-40fd594cc2a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:13:53 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-fa377324-3112-4abb-8003-97b38735ad43 tempest-ProjectMemberTests-968602289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac76f7e7-f7f1-40f2-b573-40fd594cc2a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:13:53 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-fa377324-3112-4abb-8003-97b38735ad43 tempest-ProjectMemberTests-968602289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a0db296-61ae-4e14-8ca6-e2d3c21b098e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:13:53 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-fa377324-3112-4abb-8003-97b38735ad43 tempest-ProjectMemberTests-968602289 None] Volume a27724e1-9afe-49bf-82de-418b21dfd6ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a27724e1-9afe-49bf-82de-418b21dfd6ae', 'volume_size': 1} Jul 10 16:13:53 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-fa377324-3112-4abb-8003-97b38735ad43 tempest-ProjectMemberTests-968602289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:13:53 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-fa377324-3112-4abb-8003-97b38735ad43 tempest-ProjectMemberTests-968602289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:13:53 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-fa377324-3112-4abb-8003-97b38735ad43 tempest-ProjectMemberTests-968602289 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:13:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1014870706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a27724e1-9afe-49bf-82de-418b21dfd6ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a62b0a8c6e6a4e9a9b6772e9c7ee6af3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:13:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:13:53Z,use_quota=True,user_id='1a439b56b94841c39eb4e94d953ccde8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 16:13:53 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-fa377324-3112-4abb-8003-97b38735ad43 tempest-ProjectMemberTests-968602289 None] Creating volume a27724e1-9afe-49bf-82de-418b21dfd6ae {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 16:13:53 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-fa377324-3112-4abb-8003-97b38735ad43 tempest-ProjectMemberTests-968602289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:13:53 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-fa377324-3112-4abb-8003-97b38735ad43 tempest-ProjectMemberTests-968602289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:13:53 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-fa377324-3112-4abb-8003-97b38735ad43 tempest-ProjectMemberTests-968602289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:13:53 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-fa377324-3112-4abb-8003-97b38735ad43 tempest-ProjectMemberTests-968602289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:13:53 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-fa377324-3112-4abb-8003-97b38735ad43 tempest-ProjectMemberTests-968602289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:13:53 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-fa377324-3112-4abb-8003-97b38735ad43 tempest-ProjectMemberTests-968602289 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 16:13:53 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-fa377324-3112-4abb-8003-97b38735ad43 tempest-ProjectMemberTests-968602289 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 16:13:53 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-fa377324-3112-4abb-8003-97b38735ad43 tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a27724e1-9afe-49bf-82de-418b21dfd6ae 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:13:53 devstack sudo[107078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a27724e1-9afe-49bf-82de-418b21dfd6ae 1073741824 Jul 10 16:13:53 devstack sudo[107078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:13:53 devstack sudo[107078]: pam_unix(sudo:session): session closed for user root Jul 10 16:13:53 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-fa377324-3112-4abb-8003-97b38735ad43 tempest-ProjectMemberTests-968602289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a27724e1-9afe-49bf-82de-418b21dfd6ae 1073741824" returned: 0 in 0.863s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:13:53 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-fa377324-3112-4abb-8003-97b38735ad43 tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a27724e1-9afe-49bf-82de-418b21dfd6ae {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:13:53 devstack sudo[107085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a27724e1-9afe-49bf-82de-418b21dfd6ae Jul 10 16:13:53 devstack sudo[107085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:13:54 devstack sudo[107085]: pam_unix(sudo:session): session closed for user root Jul 10 16:13:54 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-fa377324-3112-4abb-8003-97b38735ad43 tempest-ProjectMemberTests-968602289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a27724e1-9afe-49bf-82de-418b21dfd6ae" returned: 0 in 0.653s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:13:54 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-fa377324-3112-4abb-8003-97b38735ad43 tempest-ProjectMemberTests-968602289 None] <== create_volume: return (1562ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 16:13:54 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-fa377324-3112-4abb-8003-97b38735ad43 tempest-ProjectMemberTests-968602289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.565s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:13:54 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-fa377324-3112-4abb-8003-97b38735ad43 tempest-ProjectMemberTests-968602289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a0db296-61ae-4e14-8ca6-e2d3c21b098e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a27724e1-9afe-49bf-82de-418b21dfd6ae', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:13:54 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-fa377324-3112-4abb-8003-97b38735ad43 tempest-ProjectMemberTests-968602289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1111b93-f0e0-459b-8873-33c90e6115d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:13:54 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-fa377324-3112-4abb-8003-97b38735ad43 tempest-ProjectMemberTests-968602289 None] Volume volume-a27724e1-9afe-49bf-82de-418b21dfd6ae (a27724e1-9afe-49bf-82de-418b21dfd6ae): created successfully Jul 10 16:13:54 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-fa377324-3112-4abb-8003-97b38735ad43 tempest-ProjectMemberTests-968602289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1111b93-f0e0-459b-8873-33c90e6115d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:13:54 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-fa377324-3112-4abb-8003-97b38735ad43 tempest-ProjectMemberTests-968602289 None] Flow 'volume_create_manager' (06a0b1eb-a7fe-4bf9-9f07-9ca811b56164) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:13:54 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-fa377324-3112-4abb-8003-97b38735ad43 tempest-ProjectMemberTests-968602289 None] Created volume successfully. Jul 10 16:13:55 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-11509e57-e554-41bf-96eb-e3010c8abbeb tempest-ProjectMemberTests-968602289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:13:55 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-11509e57-e554-41bf-96eb-e3010c8abbeb tempest-ProjectMemberTests-968602289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:13:55 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-11509e57-e554-41bf-96eb-e3010c8abbeb tempest-ProjectMemberTests-968602289 None] Creating offline snapshot b71042fc-6a1f-48c4-8c59-833aa402e1ef of volume a27724e1-9afe-49bf-82de-418b21dfd6ae {{(pid=87420) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 16:13:55 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fc6dce3-4752-4106-a35b-1c84aa52e46e]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:13:55 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-11509e57-e554-41bf-96eb-e3010c8abbeb tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a27724e1-9afe-49bf-82de-418b21dfd6ae {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:13:55 devstack sudo[107088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a27724e1-9afe-49bf-82de-418b21dfd6ae Jul 10 16:13:55 devstack sudo[107088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:13:56 devstack sudo[107088]: pam_unix(sudo:session): session closed for user root Jul 10 16:13:56 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-11509e57-e554-41bf-96eb-e3010c8abbeb tempest-ProjectMemberTests-968602289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a27724e1-9afe-49bf-82de-418b21dfd6ae" returned: 0 in 0.841s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:13:56 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-11509e57-e554-41bf-96eb-e3010c8abbeb tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a27724e1-9afe-49bf-82de-418b21dfd6ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a27724e1-9afe-49bf-82de-418b21dfd6ae.b71042fc-6a1f-48c4-8c59-833aa402e1ef 1G {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:13:56 devstack sudo[107093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a27724e1-9afe-49bf-82de-418b21dfd6ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a27724e1-9afe-49bf-82de-418b21dfd6ae.b71042fc-6a1f-48c4-8c59-833aa402e1ef 1G Jul 10 16:13:56 devstack sudo[107093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:13:57 devstack sudo[107093]: pam_unix(sudo:session): session closed for user root Jul 10 16:13:57 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-11509e57-e554-41bf-96eb-e3010c8abbeb tempest-ProjectMemberTests-968602289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a27724e1-9afe-49bf-82de-418b21dfd6ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a27724e1-9afe-49bf-82de-418b21dfd6ae.b71042fc-6a1f-48c4-8c59-833aa402e1ef 1G" returned: 0 in 0.945s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:13:57 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-11509e57-e554-41bf-96eb-e3010c8abbeb tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a27724e1-9afe-49bf-82de-418b21dfd6ae -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a27724e1-9afe-49bf-82de-418b21dfd6ae.b71042fc-6a1f-48c4-8c59-833aa402e1ef {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:13:57 devstack sudo[107101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a27724e1-9afe-49bf-82de-418b21dfd6ae -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a27724e1-9afe-49bf-82de-418b21dfd6ae.b71042fc-6a1f-48c4-8c59-833aa402e1ef Jul 10 16:13:57 devstack sudo[107101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:13:57 devstack sudo[107101]: pam_unix(sudo:session): session closed for user root Jul 10 16:13:57 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-11509e57-e554-41bf-96eb-e3010c8abbeb tempest-ProjectMemberTests-968602289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a27724e1-9afe-49bf-82de-418b21dfd6ae -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a27724e1-9afe-49bf-82de-418b21dfd6ae.b71042fc-6a1f-48c4-8c59-833aa402e1ef" returned: 0 in 0.733s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:13:57 devstack cinder-volume[87420]: WARNING cinder.volume.drivers.remotefs [None req-11509e57-e554-41bf-96eb-e3010c8abbeb tempest-ProjectMemberTests-968602289 None] /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a27724e1-9afe-49bf-82de-418b21dfd6ae.b71042fc-6a1f-48c4-8c59-833aa402e1ef is being set with open permissions: ugo+rw Jul 10 16:13:57 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-11509e57-e554-41bf-96eb-e3010c8abbeb tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a27724e1-9afe-49bf-82de-418b21dfd6ae.b71042fc-6a1f-48c4-8c59-833aa402e1ef {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:13:57 devstack sudo[107106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a27724e1-9afe-49bf-82de-418b21dfd6ae.b71042fc-6a1f-48c4-8c59-833aa402e1ef Jul 10 16:13:57 devstack sudo[107106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:13:58 devstack sudo[107106]: pam_unix(sudo:session): session closed for user root Jul 10 16:13:58 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-11509e57-e554-41bf-96eb-e3010c8abbeb tempest-ProjectMemberTests-968602289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a27724e1-9afe-49bf-82de-418b21dfd6ae.b71042fc-6a1f-48c4-8c59-833aa402e1ef" returned: 0 in 0.688s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:13:58 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-11509e57-e554-41bf-96eb-e3010c8abbeb tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a27724e1-9afe-49bf-82de-418b21dfd6ae.info {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:13:58 devstack sudo[107109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a27724e1-9afe-49bf-82de-418b21dfd6ae.info Jul 10 16:13:58 devstack sudo[107109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:13:59 devstack sudo[107109]: pam_unix(sudo:session): session closed for user root Jul 10 16:13:59 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-11509e57-e554-41bf-96eb-e3010c8abbeb tempest-ProjectMemberTests-968602289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a27724e1-9afe-49bf-82de-418b21dfd6ae.info" returned: 0 in 0.711s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:13:59 devstack cinder-volume[87420]: WARNING cinder.volume.drivers.remotefs [None req-11509e57-e554-41bf-96eb-e3010c8abbeb tempest-ProjectMemberTests-968602289 None] /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a27724e1-9afe-49bf-82de-418b21dfd6ae.info is being set with open permissions: ugo+rw Jul 10 16:13:59 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-11509e57-e554-41bf-96eb-e3010c8abbeb tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a27724e1-9afe-49bf-82de-418b21dfd6ae.info {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:13:59 devstack sudo[107112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a27724e1-9afe-49bf-82de-418b21dfd6ae.info Jul 10 16:13:59 devstack sudo[107112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:13:59 devstack sudo[107112]: pam_unix(sudo:session): session closed for user root Jul 10 16:13:59 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-11509e57-e554-41bf-96eb-e3010c8abbeb tempest-ProjectMemberTests-968602289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a27724e1-9afe-49bf-82de-418b21dfd6ae.info" returned: 0 in 0.650s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:13:59 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-11509e57-e554-41bf-96eb-e3010c8abbeb tempest-ProjectMemberTests-968602289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.659s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:13:59 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-11509e57-e554-41bf-96eb-e3010c8abbeb tempest-ProjectMemberTests-968602289 None] Create snapshot completed successfully Jul 10 16:14:00 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-6cbadfb5-77ba-4939-88de-135d8de68cce tempest-ProjectMemberTests-968602289 None] Acquiring lock "cinder-b71042fc-6a1f-48c4-8c59-833aa402e1ef-delete_snapshot" by "delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:14:00 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-6cbadfb5-77ba-4939-88de-135d8de68cce tempest-ProjectMemberTests-968602289 None] Lock "cinder-b71042fc-6a1f-48c4-8c59-833aa402e1ef-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:14:00 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-6cbadfb5-77ba-4939-88de-135d8de68cce tempest-ProjectMemberTests-968602289 None] Acquiring lock "cinder-quobyte-a27724e1-9afe-49bf-82de-418b21dfd6ae" by "delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:14:00 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-6cbadfb5-77ba-4939-88de-135d8de68cce tempest-ProjectMemberTests-968602289 None] Lock "cinder-quobyte-a27724e1-9afe-49bf-82de-418b21dfd6ae" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:14:00 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-6cbadfb5-77ba-4939-88de-135d8de68cce tempest-ProjectMemberTests-968602289 None] Acquiring lock "cinder-quobyte-b71042fc-6a1f-48c4-8c59-833aa402e1ef" by "_delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:14:00 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-6cbadfb5-77ba-4939-88de-135d8de68cce tempest-ProjectMemberTests-968602289 None] Lock "cinder-quobyte-b71042fc-6a1f-48c4-8c59-833aa402e1ef" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:14:00 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-6cbadfb5-77ba-4939-88de-135d8de68cce tempest-ProjectMemberTests-968602289 None] Deleting offline snapshot b71042fc-6a1f-48c4-8c59-833aa402e1ef of volume a27724e1-9afe-49bf-82de-418b21dfd6ae {{(pid=87420) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 16:14:00 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-6cbadfb5-77ba-4939-88de-135d8de68cce tempest-ProjectMemberTests-968602289 None] snapshot_file for this snap is: volume-a27724e1-9afe-49bf-82de-418b21dfd6ae.b71042fc-6a1f-48c4-8c59-833aa402e1ef {{(pid=87420) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 16:14:00 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8c82a46-2f0b-4c30-bb69-e23866102f97]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:14:00 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6cbadfb5-77ba-4939-88de-135d8de68cce tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a27724e1-9afe-49bf-82de-418b21dfd6ae.b71042fc-6a1f-48c4-8c59-833aa402e1ef {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:14:00 devstack sudo[107115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a27724e1-9afe-49bf-82de-418b21dfd6ae.b71042fc-6a1f-48c4-8c59-833aa402e1ef Jul 10 16:14:00 devstack sudo[107115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:14:01 devstack sudo[107115]: pam_unix(sudo:session): session closed for user root Jul 10 16:14:01 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6cbadfb5-77ba-4939-88de-135d8de68cce tempest-ProjectMemberTests-968602289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a27724e1-9afe-49bf-82de-418b21dfd6ae.b71042fc-6a1f-48c4-8c59-833aa402e1ef" returned: 0 in 0.837s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:14:01 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-6cbadfb5-77ba-4939-88de-135d8de68cce tempest-ProjectMemberTests-968602289 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a27724e1-9afe-49bf-82de-418b21dfd6ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87420) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 16:14:01 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[031cc1fa-f3ea-45c8-9157-b9348fd2b76c]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:14:01 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6cbadfb5-77ba-4939-88de-135d8de68cce tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a27724e1-9afe-49bf-82de-418b21dfd6ae {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:14:01 devstack sudo[107120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a27724e1-9afe-49bf-82de-418b21dfd6ae Jul 10 16:14:01 devstack sudo[107120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:14:02 devstack sudo[107120]: pam_unix(sudo:session): session closed for user root Jul 10 16:14:02 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6cbadfb5-77ba-4939-88de-135d8de68cce tempest-ProjectMemberTests-968602289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a27724e1-9afe-49bf-82de-418b21dfd6ae" returned: 0 in 0.849s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:14:02 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6cbadfb5-77ba-4939-88de-135d8de68cce tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a27724e1-9afe-49bf-82de-418b21dfd6ae.b71042fc-6a1f-48c4-8c59-833aa402e1ef {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:14:02 devstack sudo[107125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a27724e1-9afe-49bf-82de-418b21dfd6ae.b71042fc-6a1f-48c4-8c59-833aa402e1ef Jul 10 16:14:02 devstack sudo[107125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:14:03 devstack sudo[107125]: pam_unix(sudo:session): session closed for user root Jul 10 16:14:03 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6cbadfb5-77ba-4939-88de-135d8de68cce tempest-ProjectMemberTests-968602289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a27724e1-9afe-49bf-82de-418b21dfd6ae.b71042fc-6a1f-48c4-8c59-833aa402e1ef" returned: 0 in 0.763s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:14:03 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6cbadfb5-77ba-4939-88de-135d8de68cce tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a27724e1-9afe-49bf-82de-418b21dfd6ae.b71042fc-6a1f-48c4-8c59-833aa402e1ef {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:14:03 devstack sudo[107131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a27724e1-9afe-49bf-82de-418b21dfd6ae.b71042fc-6a1f-48c4-8c59-833aa402e1ef Jul 10 16:14:03 devstack sudo[107131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:14:03 devstack sudo[107131]: pam_unix(sudo:session): session closed for user root Jul 10 16:14:03 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6cbadfb5-77ba-4939-88de-135d8de68cce tempest-ProjectMemberTests-968602289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a27724e1-9afe-49bf-82de-418b21dfd6ae.b71042fc-6a1f-48c4-8c59-833aa402e1ef" returned: 0 in 0.656s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:14:03 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-6cbadfb5-77ba-4939-88de-135d8de68cce tempest-ProjectMemberTests-968602289 None] Lock "cinder-quobyte-b71042fc-6a1f-48c4-8c59-833aa402e1ef" released by "_delete_snapshot" :: held 3.213s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:14:03 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-6cbadfb5-77ba-4939-88de-135d8de68cce tempest-ProjectMemberTests-968602289 None] Lock "cinder-quobyte-a27724e1-9afe-49bf-82de-418b21dfd6ae" released by "delete_snapshot" :: held 3.240s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:14:03 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-6cbadfb5-77ba-4939-88de-135d8de68cce tempest-ProjectMemberTests-968602289 None] Created reservations ['8fc417c0-cb39-4adc-b22f-b169c3b96437', 'cb156e82-77aa-4530-baf8-904bdb65a042', '35dc2273-53f4-481b-bf7b-ac508a3ede55', '732d61fd-cc97-4433-9ad6-53bf1ed04b86'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:14:03 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-6cbadfb5-77ba-4939-88de-135d8de68cce tempest-ProjectMemberTests-968602289 None] Delete snapshot completed successfully. Jul 10 16:14:03 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-6cbadfb5-77ba-4939-88de-135d8de68cce tempest-ProjectMemberTests-968602289 None] Lock "cinder-b71042fc-6a1f-48c4-8c59-833aa402e1ef-delete_snapshot" released by "delete_snapshot" :: held 3.430s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:14:04 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-7d12047e-bf32-4ada-9b81-e7d3f1c34417 tempest-ProjectMemberTests-968602289 None] Acquiring lock "cinder-a27724e1-9afe-49bf-82de-418b21dfd6ae-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:14:04 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-7d12047e-bf32-4ada-9b81-e7d3f1c34417 tempest-ProjectMemberTests-968602289 None] Lock "cinder-a27724e1-9afe-49bf-82de-418b21dfd6ae-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:14:04 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-7d12047e-bf32-4ada-9b81-e7d3f1c34417 tempest-ProjectMemberTests-968602289 None] Acquiring lock "cinder-quobyte-a27724e1-9afe-49bf-82de-418b21dfd6ae" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:14:04 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-7d12047e-bf32-4ada-9b81-e7d3f1c34417 tempest-ProjectMemberTests-968602289 None] Lock "cinder-quobyte-a27724e1-9afe-49bf-82de-418b21dfd6ae" acquired by "delete_volume" :: waited 0.020s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:14:04 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[71193adf-13ee-4e0c-b0bf-c89da807e787]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:14:04 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-7d12047e-bf32-4ada-9b81-e7d3f1c34417 tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a27724e1-9afe-49bf-82de-418b21dfd6ae {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:14:04 devstack sudo[107135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a27724e1-9afe-49bf-82de-418b21dfd6ae Jul 10 16:14:04 devstack sudo[107135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:14:05 devstack sudo[107135]: pam_unix(sudo:session): session closed for user root Jul 10 16:14:05 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-7d12047e-bf32-4ada-9b81-e7d3f1c34417 tempest-ProjectMemberTests-968602289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a27724e1-9afe-49bf-82de-418b21dfd6ae" returned: 0 in 0.780s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:14:05 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-7d12047e-bf32-4ada-9b81-e7d3f1c34417 tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a27724e1-9afe-49bf-82de-418b21dfd6ae {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:14:05 devstack sudo[107140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a27724e1-9afe-49bf-82de-418b21dfd6ae Jul 10 16:14:05 devstack sudo[107140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:14:06 devstack sudo[107140]: pam_unix(sudo:session): session closed for user root Jul 10 16:14:06 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-7d12047e-bf32-4ada-9b81-e7d3f1c34417 tempest-ProjectMemberTests-968602289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-a27724e1-9afe-49bf-82de-418b21dfd6ae" returned: 0 in 0.779s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:14:06 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-7d12047e-bf32-4ada-9b81-e7d3f1c34417 tempest-ProjectMemberTests-968602289 None] Lock "cinder-quobyte-a27724e1-9afe-49bf-82de-418b21dfd6ae" released by "delete_volume" :: held 1.630s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:14:06 devstack cinder-volume[87420]: DEBUG dbcounter [-] [87420] Writing DB stats cinder:SELECT=94,cinder:INSERT=32,cinder:UPDATE=128,cinder:DELETE=15 {{(pid=87420) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 16:14:06 devstack cinder-volume[87420]: DEBUG dbcounter [-] [87420] Writing DB stats cinder:SELECT=107,cinder:INSERT=41,cinder:UPDATE=129,cinder:DELETE=5 {{(pid=87420) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 16:14:06 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-7d12047e-bf32-4ada-9b81-e7d3f1c34417 tempest-ProjectMemberTests-968602289 None] Created reservations ['bc618965-30f4-47e8-8081-015f83a3d2ad', '715be4d9-88e4-4240-a531-865f2103f9c2', '49e36035-3909-4435-87e2-3780f0855fc3', 'd8f3cee0-a693-4885-a5c1-32740c7e948a'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:14:06 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-7d12047e-bf32-4ada-9b81-e7d3f1c34417 tempest-ProjectMemberTests-968602289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:14:06 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-7d12047e-bf32-4ada-9b81-e7d3f1c34417 tempest-ProjectMemberTests-968602289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:14:06 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-7d12047e-bf32-4ada-9b81-e7d3f1c34417 tempest-ProjectMemberTests-968602289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:14:06 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-7d12047e-bf32-4ada-9b81-e7d3f1c34417 tempest-ProjectMemberTests-968602289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:14:06 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-7d12047e-bf32-4ada-9b81-e7d3f1c34417 tempest-ProjectMemberTests-968602289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:14:06 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-7d12047e-bf32-4ada-9b81-e7d3f1c34417 tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:14:06 devstack sudo[107143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:14:06 devstack sudo[107143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:14:07 devstack sudo[107143]: pam_unix(sudo:session): session closed for user root Jul 10 16:14:07 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-7d12047e-bf32-4ada-9b81-e7d3f1c34417 tempest-ProjectMemberTests-968602289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.696s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:14:07 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-7d12047e-bf32-4ada-9b81-e7d3f1c34417 tempest-ProjectMemberTests-968602289 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:14:07 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-7d12047e-bf32-4ada-9b81-e7d3f1c34417 tempest-ProjectMemberTests-968602289 None] Deleted volume successfully. Jul 10 16:14:07 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-7d12047e-bf32-4ada-9b81-e7d3f1c34417 tempest-ProjectMemberTests-968602289 None] Lock "cinder-a27724e1-9afe-49bf-82de-418b21dfd6ae-delete_volume" released by "delete_volume" :: held 2.557s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:14:07 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9a19391-75f2-4a7a-9ff2-3976a101ccc6 tempest-ProjectMemberTests-968602289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 16:14:07 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b9a19391-75f2-4a7a-9ff2-3976a101ccc6 tempest-ProjectMemberTests-968602289 None] Flow 'volume_create_manager' (934e8bc6-0a91-4395-b7ed-3ef789649d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:14:07 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b9a19391-75f2-4a7a-9ff2-3976a101ccc6 tempest-ProjectMemberTests-968602289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (481694fe-90e3-48e1-a544-8c832f232e96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:14:07 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b9a19391-75f2-4a7a-9ff2-3976a101ccc6 tempest-ProjectMemberTests-968602289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (481694fe-90e3-48e1-a544-8c832f232e96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:14:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-891622428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea9da0c3-c60b-4138-a70e-331b332ee719,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a62b0a8c6e6a4e9a9b6772e9c7ee6af3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:14:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:14:07Z,use_quota=True,user_id='1a439b56b94841c39eb4e94d953ccde8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:14:07 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b9a19391-75f2-4a7a-9ff2-3976a101ccc6 tempest-ProjectMemberTests-968602289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dacdb6a1-a0af-4202-b216-dcfd828ec849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:14:07 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b9a19391-75f2-4a7a-9ff2-3976a101ccc6 tempest-ProjectMemberTests-968602289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dacdb6a1-a0af-4202-b216-dcfd828ec849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:14:07 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b9a19391-75f2-4a7a-9ff2-3976a101ccc6 tempest-ProjectMemberTests-968602289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0fcec72-9ba0-45b0-989a-c227c1d93ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:14:07 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b9a19391-75f2-4a7a-9ff2-3976a101ccc6 tempest-ProjectMemberTests-968602289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0fcec72-9ba0-45b0-989a-c227c1d93ba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea9da0c3-c60b-4138-a70e-331b332ee719', 'volume_name': 'volume-ea9da0c3-c60b-4138-a70e-331b332ee719', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:14:07 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b9a19391-75f2-4a7a-9ff2-3976a101ccc6 tempest-ProjectMemberTests-968602289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e6e8aa1-ce0d-4fa6-86a1-70f5b6a21138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:14:07 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b9a19391-75f2-4a7a-9ff2-3976a101ccc6 tempest-ProjectMemberTests-968602289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e6e8aa1-ce0d-4fa6-86a1-70f5b6a21138) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:14:07 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b9a19391-75f2-4a7a-9ff2-3976a101ccc6 tempest-ProjectMemberTests-968602289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb9bd717-9dc3-4e49-8d97-e51f69cb5d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:14:07 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-b9a19391-75f2-4a7a-9ff2-3976a101ccc6 tempest-ProjectMemberTests-968602289 None] Volume ea9da0c3-c60b-4138-a70e-331b332ee719: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea9da0c3-c60b-4138-a70e-331b332ee719', 'volume_size': 1} Jul 10 16:14:07 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-b9a19391-75f2-4a7a-9ff2-3976a101ccc6 tempest-ProjectMemberTests-968602289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:14:07 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-b9a19391-75f2-4a7a-9ff2-3976a101ccc6 tempest-ProjectMemberTests-968602289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:14:07 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-b9a19391-75f2-4a7a-9ff2-3976a101ccc6 tempest-ProjectMemberTests-968602289 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:14:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-891622428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea9da0c3-c60b-4138-a70e-331b332ee719,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a62b0a8c6e6a4e9a9b6772e9c7ee6af3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:14:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:14:07Z,use_quota=True,user_id='1a439b56b94841c39eb4e94d953ccde8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 16:14:07 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-b9a19391-75f2-4a7a-9ff2-3976a101ccc6 tempest-ProjectMemberTests-968602289 None] Creating volume ea9da0c3-c60b-4138-a70e-331b332ee719 {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 16:14:07 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-b9a19391-75f2-4a7a-9ff2-3976a101ccc6 tempest-ProjectMemberTests-968602289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:14:07 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-b9a19391-75f2-4a7a-9ff2-3976a101ccc6 tempest-ProjectMemberTests-968602289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:14:07 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-b9a19391-75f2-4a7a-9ff2-3976a101ccc6 tempest-ProjectMemberTests-968602289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:14:07 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-b9a19391-75f2-4a7a-9ff2-3976a101ccc6 tempest-ProjectMemberTests-968602289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:14:07 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-b9a19391-75f2-4a7a-9ff2-3976a101ccc6 tempest-ProjectMemberTests-968602289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:14:07 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-b9a19391-75f2-4a7a-9ff2-3976a101ccc6 tempest-ProjectMemberTests-968602289 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 16:14:07 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-b9a19391-75f2-4a7a-9ff2-3976a101ccc6 tempest-ProjectMemberTests-968602289 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 16:14:07 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-b9a19391-75f2-4a7a-9ff2-3976a101ccc6 tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ea9da0c3-c60b-4138-a70e-331b332ee719 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:14:07 devstack sudo[107146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ea9da0c3-c60b-4138-a70e-331b332ee719 1073741824 Jul 10 16:14:07 devstack sudo[107146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:14:08 devstack sudo[107146]: pam_unix(sudo:session): session closed for user root Jul 10 16:14:08 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-b9a19391-75f2-4a7a-9ff2-3976a101ccc6 tempest-ProjectMemberTests-968602289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ea9da0c3-c60b-4138-a70e-331b332ee719 1073741824" returned: 0 in 0.908s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:14:08 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-b9a19391-75f2-4a7a-9ff2-3976a101ccc6 tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ea9da0c3-c60b-4138-a70e-331b332ee719 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:14:08 devstack sudo[107152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ea9da0c3-c60b-4138-a70e-331b332ee719 Jul 10 16:14:08 devstack sudo[107152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:14:09 devstack sudo[107152]: pam_unix(sudo:session): session closed for user root Jul 10 16:14:09 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-b9a19391-75f2-4a7a-9ff2-3976a101ccc6 tempest-ProjectMemberTests-968602289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ea9da0c3-c60b-4138-a70e-331b332ee719" returned: 0 in 0.676s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:14:09 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-b9a19391-75f2-4a7a-9ff2-3976a101ccc6 tempest-ProjectMemberTests-968602289 None] <== create_volume: return (1634ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 16:14:09 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-b9a19391-75f2-4a7a-9ff2-3976a101ccc6 tempest-ProjectMemberTests-968602289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.637s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:14:09 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b9a19391-75f2-4a7a-9ff2-3976a101ccc6 tempest-ProjectMemberTests-968602289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb9bd717-9dc3-4e49-8d97-e51f69cb5d9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea9da0c3-c60b-4138-a70e-331b332ee719', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:14:09 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b9a19391-75f2-4a7a-9ff2-3976a101ccc6 tempest-ProjectMemberTests-968602289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cea3b607-3570-4560-90a4-48382b662e52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:14:09 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-b9a19391-75f2-4a7a-9ff2-3976a101ccc6 tempest-ProjectMemberTests-968602289 None] Volume volume-ea9da0c3-c60b-4138-a70e-331b332ee719 (ea9da0c3-c60b-4138-a70e-331b332ee719): created successfully Jul 10 16:14:09 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b9a19391-75f2-4a7a-9ff2-3976a101ccc6 tempest-ProjectMemberTests-968602289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cea3b607-3570-4560-90a4-48382b662e52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:14:09 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b9a19391-75f2-4a7a-9ff2-3976a101ccc6 tempest-ProjectMemberTests-968602289 None] Flow 'volume_create_manager' (934e8bc6-0a91-4395-b7ed-3ef789649d9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:14:09 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-b9a19391-75f2-4a7a-9ff2-3976a101ccc6 tempest-ProjectMemberTests-968602289 None] Created volume successfully. Jul 10 16:14:09 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-5a098a76-3915-4139-b606-5fb7a9992e1e tempest-ProjectMemberTests-968602289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:14:09 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-5a098a76-3915-4139-b606-5fb7a9992e1e tempest-ProjectMemberTests-968602289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:14:09 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-5a098a76-3915-4139-b606-5fb7a9992e1e tempest-ProjectMemberTests-968602289 None] Creating offline snapshot 184194a9-41e6-4b28-9858-488fe244ad1f of volume ea9da0c3-c60b-4138-a70e-331b332ee719 {{(pid=87420) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 16:14:09 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb8ca39-94c5-4cf5-a131-ef36acbab2e3]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:14:09 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-5a098a76-3915-4139-b606-5fb7a9992e1e tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ea9da0c3-c60b-4138-a70e-331b332ee719 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:14:09 devstack sudo[107156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ea9da0c3-c60b-4138-a70e-331b332ee719 Jul 10 16:14:09 devstack sudo[107156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:14:10 devstack sudo[107156]: pam_unix(sudo:session): session closed for user root Jul 10 16:14:10 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-5a098a76-3915-4139-b606-5fb7a9992e1e tempest-ProjectMemberTests-968602289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ea9da0c3-c60b-4138-a70e-331b332ee719" returned: 0 in 0.812s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:14:10 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-5a098a76-3915-4139-b606-5fb7a9992e1e tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ea9da0c3-c60b-4138-a70e-331b332ee719,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ea9da0c3-c60b-4138-a70e-331b332ee719.184194a9-41e6-4b28-9858-488fe244ad1f 1G {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:14:10 devstack sudo[107161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ea9da0c3-c60b-4138-a70e-331b332ee719,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ea9da0c3-c60b-4138-a70e-331b332ee719.184194a9-41e6-4b28-9858-488fe244ad1f 1G Jul 10 16:14:10 devstack sudo[107161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:14:11 devstack sudo[107161]: pam_unix(sudo:session): session closed for user root Jul 10 16:14:11 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-5a098a76-3915-4139-b606-5fb7a9992e1e tempest-ProjectMemberTests-968602289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ea9da0c3-c60b-4138-a70e-331b332ee719,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ea9da0c3-c60b-4138-a70e-331b332ee719.184194a9-41e6-4b28-9858-488fe244ad1f 1G" returned: 0 in 0.918s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:14:11 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-5a098a76-3915-4139-b606-5fb7a9992e1e tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea9da0c3-c60b-4138-a70e-331b332ee719 -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ea9da0c3-c60b-4138-a70e-331b332ee719.184194a9-41e6-4b28-9858-488fe244ad1f {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:14:11 devstack sudo[107167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea9da0c3-c60b-4138-a70e-331b332ee719 -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ea9da0c3-c60b-4138-a70e-331b332ee719.184194a9-41e6-4b28-9858-488fe244ad1f Jul 10 16:14:11 devstack sudo[107167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:14:12 devstack sudo[107167]: pam_unix(sudo:session): session closed for user root Jul 10 16:14:12 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-5a098a76-3915-4139-b606-5fb7a9992e1e tempest-ProjectMemberTests-968602289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea9da0c3-c60b-4138-a70e-331b332ee719 -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ea9da0c3-c60b-4138-a70e-331b332ee719.184194a9-41e6-4b28-9858-488fe244ad1f" returned: 0 in 0.733s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:14:12 devstack cinder-volume[87420]: WARNING cinder.volume.drivers.remotefs [None req-5a098a76-3915-4139-b606-5fb7a9992e1e tempest-ProjectMemberTests-968602289 None] /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ea9da0c3-c60b-4138-a70e-331b332ee719.184194a9-41e6-4b28-9858-488fe244ad1f is being set with open permissions: ugo+rw Jul 10 16:14:12 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-5a098a76-3915-4139-b606-5fb7a9992e1e tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ea9da0c3-c60b-4138-a70e-331b332ee719.184194a9-41e6-4b28-9858-488fe244ad1f {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:14:12 devstack sudo[107172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ea9da0c3-c60b-4138-a70e-331b332ee719.184194a9-41e6-4b28-9858-488fe244ad1f Jul 10 16:14:12 devstack sudo[107172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:14:12 devstack sudo[107172]: pam_unix(sudo:session): session closed for user root Jul 10 16:14:12 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-5a098a76-3915-4139-b606-5fb7a9992e1e tempest-ProjectMemberTests-968602289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ea9da0c3-c60b-4138-a70e-331b332ee719.184194a9-41e6-4b28-9858-488fe244ad1f" returned: 0 in 0.692s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:14:12 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-5a098a76-3915-4139-b606-5fb7a9992e1e tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ea9da0c3-c60b-4138-a70e-331b332ee719.info {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:14:12 devstack sudo[107175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ea9da0c3-c60b-4138-a70e-331b332ee719.info Jul 10 16:14:12 devstack sudo[107175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:14:13 devstack sudo[107175]: pam_unix(sudo:session): session closed for user root Jul 10 16:14:13 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-5a098a76-3915-4139-b606-5fb7a9992e1e tempest-ProjectMemberTests-968602289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ea9da0c3-c60b-4138-a70e-331b332ee719.info" returned: 0 in 0.674s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:14:13 devstack cinder-volume[87420]: WARNING cinder.volume.drivers.remotefs [None req-5a098a76-3915-4139-b606-5fb7a9992e1e tempest-ProjectMemberTests-968602289 None] /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ea9da0c3-c60b-4138-a70e-331b332ee719.info is being set with open permissions: ugo+rw Jul 10 16:14:13 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-5a098a76-3915-4139-b606-5fb7a9992e1e tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ea9da0c3-c60b-4138-a70e-331b332ee719.info {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:14:13 devstack sudo[107178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ea9da0c3-c60b-4138-a70e-331b332ee719.info Jul 10 16:14:13 devstack sudo[107178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:14:14 devstack sudo[107178]: pam_unix(sudo:session): session closed for user root Jul 10 16:14:14 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-5a098a76-3915-4139-b606-5fb7a9992e1e tempest-ProjectMemberTests-968602289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ea9da0c3-c60b-4138-a70e-331b332ee719.info" returned: 0 in 0.678s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:14:14 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-5a098a76-3915-4139-b606-5fb7a9992e1e tempest-ProjectMemberTests-968602289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.604s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:14:14 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-5a098a76-3915-4139-b606-5fb7a9992e1e tempest-ProjectMemberTests-968602289 None] Create snapshot completed successfully Jul 10 16:14:15 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-cb342682-d590-4d42-a68e-2796a5c60d50 tempest-ProjectMemberTests-968602289 None] Acquiring lock "cinder-184194a9-41e6-4b28-9858-488fe244ad1f-delete_snapshot" by "delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:14:15 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-cb342682-d590-4d42-a68e-2796a5c60d50 tempest-ProjectMemberTests-968602289 None] Lock "cinder-184194a9-41e6-4b28-9858-488fe244ad1f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:14:15 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-cb342682-d590-4d42-a68e-2796a5c60d50 tempest-ProjectMemberTests-968602289 None] Acquiring lock "cinder-quobyte-ea9da0c3-c60b-4138-a70e-331b332ee719" by "delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:14:15 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-cb342682-d590-4d42-a68e-2796a5c60d50 tempest-ProjectMemberTests-968602289 None] Lock "cinder-quobyte-ea9da0c3-c60b-4138-a70e-331b332ee719" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:14:15 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-cb342682-d590-4d42-a68e-2796a5c60d50 tempest-ProjectMemberTests-968602289 None] Acquiring lock "cinder-quobyte-184194a9-41e6-4b28-9858-488fe244ad1f" by "_delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:14:15 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-cb342682-d590-4d42-a68e-2796a5c60d50 tempest-ProjectMemberTests-968602289 None] Lock "cinder-quobyte-184194a9-41e6-4b28-9858-488fe244ad1f" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:14:15 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-cb342682-d590-4d42-a68e-2796a5c60d50 tempest-ProjectMemberTests-968602289 None] Deleting offline snapshot 184194a9-41e6-4b28-9858-488fe244ad1f of volume ea9da0c3-c60b-4138-a70e-331b332ee719 {{(pid=87420) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 16:14:15 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-cb342682-d590-4d42-a68e-2796a5c60d50 tempest-ProjectMemberTests-968602289 None] snapshot_file for this snap is: volume-ea9da0c3-c60b-4138-a70e-331b332ee719.184194a9-41e6-4b28-9858-488fe244ad1f {{(pid=87420) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 16:14:15 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[55c8e25f-181e-47f3-b9bf-7233c54614d4]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:14:15 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-cb342682-d590-4d42-a68e-2796a5c60d50 tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ea9da0c3-c60b-4138-a70e-331b332ee719.184194a9-41e6-4b28-9858-488fe244ad1f {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:14:15 devstack sudo[107182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ea9da0c3-c60b-4138-a70e-331b332ee719.184194a9-41e6-4b28-9858-488fe244ad1f Jul 10 16:14:15 devstack sudo[107182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:14:15 devstack sudo[107182]: pam_unix(sudo:session): session closed for user root Jul 10 16:14:15 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-cb342682-d590-4d42-a68e-2796a5c60d50 tempest-ProjectMemberTests-968602289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ea9da0c3-c60b-4138-a70e-331b332ee719.184194a9-41e6-4b28-9858-488fe244ad1f" returned: 0 in 0.810s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:14:15 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-cb342682-d590-4d42-a68e-2796a5c60d50 tempest-ProjectMemberTests-968602289 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea9da0c3-c60b-4138-a70e-331b332ee719(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87420) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 16:14:15 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[49aeab2b-6dba-47e9-883b-be84414a0e85]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:14:15 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-cb342682-d590-4d42-a68e-2796a5c60d50 tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ea9da0c3-c60b-4138-a70e-331b332ee719 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:14:16 devstack sudo[107187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ea9da0c3-c60b-4138-a70e-331b332ee719 Jul 10 16:14:16 devstack sudo[107187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:14:16 devstack sudo[107187]: pam_unix(sudo:session): session closed for user root Jul 10 16:14:16 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-cb342682-d590-4d42-a68e-2796a5c60d50 tempest-ProjectMemberTests-968602289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ea9da0c3-c60b-4138-a70e-331b332ee719" returned: 0 in 0.803s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:14:16 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-cb342682-d590-4d42-a68e-2796a5c60d50 tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ea9da0c3-c60b-4138-a70e-331b332ee719.184194a9-41e6-4b28-9858-488fe244ad1f {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:14:16 devstack sudo[107192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ea9da0c3-c60b-4138-a70e-331b332ee719.184194a9-41e6-4b28-9858-488fe244ad1f Jul 10 16:14:16 devstack sudo[107192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:14:17 devstack cinder-volume[87420]: DEBUG oslo_service.periodic_task [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87420) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 16:14:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:14:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:14:17 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:14:17 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:14:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:14:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:14:17 devstack sudo[107197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:14:17 devstack sudo[107197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:14:17 devstack sudo[107192]: pam_unix(sudo:session): session closed for user root Jul 10 16:14:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-cb342682-d590-4d42-a68e-2796a5c60d50 tempest-ProjectMemberTests-968602289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ea9da0c3-c60b-4138-a70e-331b332ee719.184194a9-41e6-4b28-9858-488fe244ad1f" returned: 0 in 0.791s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:14:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-cb342682-d590-4d42-a68e-2796a5c60d50 tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ea9da0c3-c60b-4138-a70e-331b332ee719.184194a9-41e6-4b28-9858-488fe244ad1f {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:14:17 devstack sudo[107199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ea9da0c3-c60b-4138-a70e-331b332ee719.184194a9-41e6-4b28-9858-488fe244ad1f Jul 10 16:14:17 devstack sudo[107199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:14:17 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-739649f6-5b8f-4eb1-89da-81a788a295b5 tempest-SnapshotDependencyTests-714242607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 16:14:17 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-739649f6-5b8f-4eb1-89da-81a788a295b5 tempest-SnapshotDependencyTests-714242607 None] Flow 'volume_create_manager' (7fad2563-3230-43c1-9605-74672859db0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:14:17 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-739649f6-5b8f-4eb1-89da-81a788a295b5 tempest-SnapshotDependencyTests-714242607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8a75b9c-097b-4100-8ddd-d5a572558a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:14:17 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-739649f6-5b8f-4eb1-89da-81a788a295b5 tempest-SnapshotDependencyTests-714242607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8a75b9c-097b-4100-8ddd-d5a572558a0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:14:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1425343064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01dc0444-2789-4283-92f7-d151cc6ba14e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40668500c1c340218402d2e27f26a8fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:14:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:14:18Z,use_quota=True,user_id='43d579784b744388b9303f50d1d03aac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:14:17 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-739649f6-5b8f-4eb1-89da-81a788a295b5 tempest-SnapshotDependencyTests-714242607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0436adc2-6c57-4c6f-803d-64a93b886873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:14:17 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-739649f6-5b8f-4eb1-89da-81a788a295b5 tempest-SnapshotDependencyTests-714242607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0436adc2-6c57-4c6f-803d-64a93b886873) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:14:17 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-739649f6-5b8f-4eb1-89da-81a788a295b5 tempest-SnapshotDependencyTests-714242607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b1b6fee-5221-4014-96b4-10439ce332bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:14:17 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-739649f6-5b8f-4eb1-89da-81a788a295b5 tempest-SnapshotDependencyTests-714242607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b1b6fee-5221-4014-96b4-10439ce332bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01dc0444-2789-4283-92f7-d151cc6ba14e', 'volume_name': 'volume-01dc0444-2789-4283-92f7-d151cc6ba14e', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:14:17 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-739649f6-5b8f-4eb1-89da-81a788a295b5 tempest-SnapshotDependencyTests-714242607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c71fd33-6c62-41f9-9a2d-2805a5c270b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:14:17 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-739649f6-5b8f-4eb1-89da-81a788a295b5 tempest-SnapshotDependencyTests-714242607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c71fd33-6c62-41f9-9a2d-2805a5c270b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:14:17 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-739649f6-5b8f-4eb1-89da-81a788a295b5 tempest-SnapshotDependencyTests-714242607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4ed6aac-8a41-40ff-aff9-395efb78bf59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:14:17 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-739649f6-5b8f-4eb1-89da-81a788a295b5 tempest-SnapshotDependencyTests-714242607 None] Volume 01dc0444-2789-4283-92f7-d151cc6ba14e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01dc0444-2789-4283-92f7-d151cc6ba14e', 'volume_size': 1} Jul 10 16:14:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-739649f6-5b8f-4eb1-89da-81a788a295b5 tempest-SnapshotDependencyTests-714242607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:14:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-739649f6-5b8f-4eb1-89da-81a788a295b5 tempest-SnapshotDependencyTests-714242607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:14:17 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-739649f6-5b8f-4eb1-89da-81a788a295b5 tempest-SnapshotDependencyTests-714242607 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:14:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1425343064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01dc0444-2789-4283-92f7-d151cc6ba14e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40668500c1c340218402d2e27f26a8fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:14:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:14:18Z,use_quota=True,user_id='43d579784b744388b9303f50d1d03aac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 16:14:17 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-739649f6-5b8f-4eb1-89da-81a788a295b5 tempest-SnapshotDependencyTests-714242607 None] Creating volume 01dc0444-2789-4283-92f7-d151cc6ba14e {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 16:14:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-739649f6-5b8f-4eb1-89da-81a788a295b5 tempest-SnapshotDependencyTests-714242607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:14:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-739649f6-5b8f-4eb1-89da-81a788a295b5 tempest-SnapshotDependencyTests-714242607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:14:17 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-739649f6-5b8f-4eb1-89da-81a788a295b5 tempest-SnapshotDependencyTests-714242607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:14:17 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-739649f6-5b8f-4eb1-89da-81a788a295b5 tempest-SnapshotDependencyTests-714242607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:14:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-739649f6-5b8f-4eb1-89da-81a788a295b5 tempest-SnapshotDependencyTests-714242607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:14:17 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-739649f6-5b8f-4eb1-89da-81a788a295b5 tempest-SnapshotDependencyTests-714242607 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 16:14:17 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-739649f6-5b8f-4eb1-89da-81a788a295b5 tempest-SnapshotDependencyTests-714242607 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 16:14:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-739649f6-5b8f-4eb1-89da-81a788a295b5 tempest-SnapshotDependencyTests-714242607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-01dc0444-2789-4283-92f7-d151cc6ba14e 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:14:18 devstack sudo[107201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-01dc0444-2789-4283-92f7-d151cc6ba14e 1073741824 Jul 10 16:14:18 devstack sudo[107201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:14:18 devstack sudo[107197]: pam_unix(sudo:session): session closed for user root Jul 10 16:14:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.683s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:14:18 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:14:18 devstack cinder-volume[87420]: DEBUG oslo_service.periodic_task [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Running periodic task VolumeManager._thread_info {{(pid=87420) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 16:14:18 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] thread count: 29 {{(pid=87420) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 16:14:18 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] thread info: [<_MainThread(MainThread, started 133639250378880)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87420) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 16:14:18 devstack sudo[107199]: pam_unix(sudo:session): session closed for user root Jul 10 16:14:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-cb342682-d590-4d42-a68e-2796a5c60d50 tempest-ProjectMemberTests-968602289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ea9da0c3-c60b-4138-a70e-331b332ee719.184194a9-41e6-4b28-9858-488fe244ad1f" returned: 0 in 0.664s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:14:18 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-cb342682-d590-4d42-a68e-2796a5c60d50 tempest-ProjectMemberTests-968602289 None] Lock "cinder-quobyte-184194a9-41e6-4b28-9858-488fe244ad1f" released by "_delete_snapshot" :: held 3.174s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:14:18 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-cb342682-d590-4d42-a68e-2796a5c60d50 tempest-ProjectMemberTests-968602289 None] Lock "cinder-quobyte-ea9da0c3-c60b-4138-a70e-331b332ee719" released by "delete_snapshot" :: held 3.206s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:14:18 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-cb342682-d590-4d42-a68e-2796a5c60d50 tempest-ProjectMemberTests-968602289 None] Created reservations ['da80f570-53af-40ca-9129-335499e3fbca', '4599173c-bb27-4e84-98f1-693a92a01be7', '89cb15cf-9260-4eff-8a2e-28f0c2aed5af', '5008088e-b580-4abd-a7cc-c45eafa9bf01'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:14:18 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-cb342682-d590-4d42-a68e-2796a5c60d50 tempest-ProjectMemberTests-968602289 None] Delete snapshot completed successfully. Jul 10 16:14:18 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-cb342682-d590-4d42-a68e-2796a5c60d50 tempest-ProjectMemberTests-968602289 None] Lock "cinder-184194a9-41e6-4b28-9858-488fe244ad1f-delete_snapshot" released by "delete_snapshot" :: held 3.345s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:14:18 devstack sudo[107201]: pam_unix(sudo:session): session closed for user root Jul 10 16:14:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-739649f6-5b8f-4eb1-89da-81a788a295b5 tempest-SnapshotDependencyTests-714242607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-01dc0444-2789-4283-92f7-d151cc6ba14e 1073741824" returned: 0 in 0.844s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:14:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-739649f6-5b8f-4eb1-89da-81a788a295b5 tempest-SnapshotDependencyTests-714242607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-01dc0444-2789-4283-92f7-d151cc6ba14e {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:14:18 devstack sudo[107209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-01dc0444-2789-4283-92f7-d151cc6ba14e Jul 10 16:14:18 devstack sudo[107209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:14:19 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-4db68576-9fbc-4f50-9155-9485989f1a78 tempest-ProjectMemberTests-968602289 None] Acquiring lock "cinder-ea9da0c3-c60b-4138-a70e-331b332ee719-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:14:19 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-4db68576-9fbc-4f50-9155-9485989f1a78 tempest-ProjectMemberTests-968602289 None] Lock "cinder-ea9da0c3-c60b-4138-a70e-331b332ee719-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:14:19 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-4db68576-9fbc-4f50-9155-9485989f1a78 tempest-ProjectMemberTests-968602289 None] Acquiring lock "cinder-quobyte-ea9da0c3-c60b-4138-a70e-331b332ee719" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:14:19 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-4db68576-9fbc-4f50-9155-9485989f1a78 tempest-ProjectMemberTests-968602289 None] Lock "cinder-quobyte-ea9da0c3-c60b-4138-a70e-331b332ee719" acquired by "delete_volume" :: waited 0.015s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:14:19 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[f67c2eeb-cdf3-465c-9aae-48691c495dac]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:14:19 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4db68576-9fbc-4f50-9155-9485989f1a78 tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ea9da0c3-c60b-4138-a70e-331b332ee719 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:14:19 devstack sudo[107209]: pam_unix(sudo:session): session closed for user root Jul 10 16:14:19 devstack sudo[107212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ea9da0c3-c60b-4138-a70e-331b332ee719 Jul 10 16:14:19 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-739649f6-5b8f-4eb1-89da-81a788a295b5 tempest-SnapshotDependencyTests-714242607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-01dc0444-2789-4283-92f7-d151cc6ba14e" returned: 0 in 0.644s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:14:19 devstack sudo[107212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:14:19 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-739649f6-5b8f-4eb1-89da-81a788a295b5 tempest-SnapshotDependencyTests-714242607 None] <== create_volume: return (1528ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 16:14:19 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-739649f6-5b8f-4eb1-89da-81a788a295b5 tempest-SnapshotDependencyTests-714242607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.531s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:14:19 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-739649f6-5b8f-4eb1-89da-81a788a295b5 tempest-SnapshotDependencyTests-714242607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4ed6aac-8a41-40ff-aff9-395efb78bf59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01dc0444-2789-4283-92f7-d151cc6ba14e', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:14:19 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-739649f6-5b8f-4eb1-89da-81a788a295b5 tempest-SnapshotDependencyTests-714242607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96b3357f-4965-441d-8068-4888d8428ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:14:19 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-739649f6-5b8f-4eb1-89da-81a788a295b5 tempest-SnapshotDependencyTests-714242607 None] Volume volume-01dc0444-2789-4283-92f7-d151cc6ba14e (01dc0444-2789-4283-92f7-d151cc6ba14e): created successfully Jul 10 16:14:19 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-739649f6-5b8f-4eb1-89da-81a788a295b5 tempest-SnapshotDependencyTests-714242607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96b3357f-4965-441d-8068-4888d8428ddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:14:19 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-739649f6-5b8f-4eb1-89da-81a788a295b5 tempest-SnapshotDependencyTests-714242607 None] Flow 'volume_create_manager' (7fad2563-3230-43c1-9605-74672859db0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:14:19 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-739649f6-5b8f-4eb1-89da-81a788a295b5 tempest-SnapshotDependencyTests-714242607 None] Created volume successfully. Jul 10 16:14:20 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-9fc8bfed-7814-4548-a7a3-e0c1bd92e087 tempest-SnapshotDependencyTests-714242607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:14:20 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-9fc8bfed-7814-4548-a7a3-e0c1bd92e087 tempest-SnapshotDependencyTests-714242607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:14:20 devstack sudo[107212]: pam_unix(sudo:session): session closed for user root Jul 10 16:14:20 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4db68576-9fbc-4f50-9155-9485989f1a78 tempest-ProjectMemberTests-968602289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ea9da0c3-c60b-4138-a70e-331b332ee719" returned: 0 in 0.811s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:14:20 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4db68576-9fbc-4f50-9155-9485989f1a78 tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ea9da0c3-c60b-4138-a70e-331b332ee719 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:14:20 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-9fc8bfed-7814-4548-a7a3-e0c1bd92e087 tempest-SnapshotDependencyTests-714242607 None] Creating offline snapshot 57bcff9d-f04b-4630-b24b-3d4a364aca3c of volume 01dc0444-2789-4283-92f7-d151cc6ba14e {{(pid=87420) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 16:14:20 devstack sudo[107217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ea9da0c3-c60b-4138-a70e-331b332ee719 Jul 10 16:14:20 devstack sudo[107217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:14:20 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8a32d01-58c4-40f6-bf8d-70d5e7997cee]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:14:20 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-9fc8bfed-7814-4548-a7a3-e0c1bd92e087 tempest-SnapshotDependencyTests-714242607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-01dc0444-2789-4283-92f7-d151cc6ba14e {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:14:20 devstack sudo[107219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-01dc0444-2789-4283-92f7-d151cc6ba14e Jul 10 16:14:20 devstack sudo[107219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:14:20 devstack sudo[107217]: pam_unix(sudo:session): session closed for user root Jul 10 16:14:20 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4db68576-9fbc-4f50-9155-9485989f1a78 tempest-ProjectMemberTests-968602289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ea9da0c3-c60b-4138-a70e-331b332ee719" returned: 0 in 0.645s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:14:20 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-4db68576-9fbc-4f50-9155-9485989f1a78 tempest-ProjectMemberTests-968602289 None] Lock "cinder-quobyte-ea9da0c3-c60b-4138-a70e-331b332ee719" released by "delete_volume" :: held 1.523s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:14:20 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-4db68576-9fbc-4f50-9155-9485989f1a78 tempest-ProjectMemberTests-968602289 None] Created reservations ['1eac5e96-0c22-4152-a3a8-9e0ab4684187', '0b1f379a-a405-4542-9a60-0748758c9105', 'b99fe464-343f-489d-9f3d-484669199ef1', 'bf103540-3d77-4094-a24e-8c269251013e'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:14:21 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-4db68576-9fbc-4f50-9155-9485989f1a78 tempest-ProjectMemberTests-968602289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:14:21 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-4db68576-9fbc-4f50-9155-9485989f1a78 tempest-ProjectMemberTests-968602289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:14:21 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-4db68576-9fbc-4f50-9155-9485989f1a78 tempest-ProjectMemberTests-968602289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:14:21 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-4db68576-9fbc-4f50-9155-9485989f1a78 tempest-ProjectMemberTests-968602289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:14:21 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-4db68576-9fbc-4f50-9155-9485989f1a78 tempest-ProjectMemberTests-968602289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:14:21 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4db68576-9fbc-4f50-9155-9485989f1a78 tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:14:21 devstack sudo[107225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:14:21 devstack sudo[107225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:14:21 devstack sudo[107219]: pam_unix(sudo:session): session closed for user root Jul 10 16:14:21 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-9fc8bfed-7814-4548-a7a3-e0c1bd92e087 tempest-SnapshotDependencyTests-714242607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-01dc0444-2789-4283-92f7-d151cc6ba14e" returned: 0 in 0.804s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:14:21 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-9fc8bfed-7814-4548-a7a3-e0c1bd92e087 tempest-SnapshotDependencyTests-714242607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-01dc0444-2789-4283-92f7-d151cc6ba14e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-01dc0444-2789-4283-92f7-d151cc6ba14e.57bcff9d-f04b-4630-b24b-3d4a364aca3c 1G {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:14:21 devstack sudo[107227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-01dc0444-2789-4283-92f7-d151cc6ba14e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-01dc0444-2789-4283-92f7-d151cc6ba14e.57bcff9d-f04b-4630-b24b-3d4a364aca3c 1G Jul 10 16:14:21 devstack sudo[107227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:14:21 devstack sudo[107225]: pam_unix(sudo:session): session closed for user root Jul 10 16:14:21 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4db68576-9fbc-4f50-9155-9485989f1a78 tempest-ProjectMemberTests-968602289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.644s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:14:21 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-4db68576-9fbc-4f50-9155-9485989f1a78 tempest-ProjectMemberTests-968602289 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:14:21 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-4db68576-9fbc-4f50-9155-9485989f1a78 tempest-ProjectMemberTests-968602289 None] Deleted volume successfully. Jul 10 16:14:21 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-4db68576-9fbc-4f50-9155-9485989f1a78 tempest-ProjectMemberTests-968602289 None] Lock "cinder-ea9da0c3-c60b-4138-a70e-331b332ee719-delete_volume" released by "delete_volume" :: held 2.390s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:14:21 devstack sudo[107227]: pam_unix(sudo:session): session closed for user root Jul 10 16:14:21 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-9fc8bfed-7814-4548-a7a3-e0c1bd92e087 tempest-SnapshotDependencyTests-714242607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-01dc0444-2789-4283-92f7-d151cc6ba14e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-01dc0444-2789-4283-92f7-d151cc6ba14e.57bcff9d-f04b-4630-b24b-3d4a364aca3c 1G" returned: 0 in 0.889s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:14:21 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-9fc8bfed-7814-4548-a7a3-e0c1bd92e087 tempest-SnapshotDependencyTests-714242607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01dc0444-2789-4283-92f7-d151cc6ba14e -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-01dc0444-2789-4283-92f7-d151cc6ba14e.57bcff9d-f04b-4630-b24b-3d4a364aca3c {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:14:21 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-16df3c3b-9b53-4bee-88d3-409f412b3c5a tempest-ProjectMemberTests-968602289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 16:14:21 devstack sudo[107235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01dc0444-2789-4283-92f7-d151cc6ba14e -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-01dc0444-2789-4283-92f7-d151cc6ba14e.57bcff9d-f04b-4630-b24b-3d4a364aca3c Jul 10 16:14:21 devstack sudo[107235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:14:21 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-16df3c3b-9b53-4bee-88d3-409f412b3c5a tempest-ProjectMemberTests-968602289 None] Flow 'volume_create_manager' (907256fd-40ee-404b-b68c-d5391727b02d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:14:21 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-16df3c3b-9b53-4bee-88d3-409f412b3c5a tempest-ProjectMemberTests-968602289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83c7c1b1-8d0c-42e7-932e-bf8ca0e4eae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:14:22 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-16df3c3b-9b53-4bee-88d3-409f412b3c5a tempest-ProjectMemberTests-968602289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83c7c1b1-8d0c-42e7-932e-bf8ca0e4eae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:14:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-643685982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f97fd8f-ba69-4286-bbe8-aa3d0789e6d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a62b0a8c6e6a4e9a9b6772e9c7ee6af3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:14:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:14:22Z,use_quota=True,user_id='1a439b56b94841c39eb4e94d953ccde8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:14:22 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-16df3c3b-9b53-4bee-88d3-409f412b3c5a tempest-ProjectMemberTests-968602289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68b82713-17eb-45df-995d-15b185bea35b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:14:22 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-16df3c3b-9b53-4bee-88d3-409f412b3c5a tempest-ProjectMemberTests-968602289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68b82713-17eb-45df-995d-15b185bea35b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:14:22 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-16df3c3b-9b53-4bee-88d3-409f412b3c5a tempest-ProjectMemberTests-968602289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2634042b-cec8-49be-a4de-aa32af1fbafd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:14:22 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-16df3c3b-9b53-4bee-88d3-409f412b3c5a tempest-ProjectMemberTests-968602289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2634042b-cec8-49be-a4de-aa32af1fbafd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f97fd8f-ba69-4286-bbe8-aa3d0789e6d8', 'volume_name': 'volume-8f97fd8f-ba69-4286-bbe8-aa3d0789e6d8', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:14:22 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-16df3c3b-9b53-4bee-88d3-409f412b3c5a tempest-ProjectMemberTests-968602289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1385ac2-713a-47cb-999f-a334ca5fbe96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:14:22 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-16df3c3b-9b53-4bee-88d3-409f412b3c5a tempest-ProjectMemberTests-968602289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1385ac2-713a-47cb-999f-a334ca5fbe96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:14:22 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-16df3c3b-9b53-4bee-88d3-409f412b3c5a tempest-ProjectMemberTests-968602289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2c95d7b-15bf-4fac-9f3f-c703c18a232c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:14:22 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-16df3c3b-9b53-4bee-88d3-409f412b3c5a tempest-ProjectMemberTests-968602289 None] Volume 8f97fd8f-ba69-4286-bbe8-aa3d0789e6d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f97fd8f-ba69-4286-bbe8-aa3d0789e6d8', 'volume_size': 1} Jul 10 16:14:22 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-16df3c3b-9b53-4bee-88d3-409f412b3c5a tempest-ProjectMemberTests-968602289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:14:22 devstack sudo[107235]: pam_unix(sudo:session): session closed for user root Jul 10 16:14:22 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-9fc8bfed-7814-4548-a7a3-e0c1bd92e087 tempest-SnapshotDependencyTests-714242607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01dc0444-2789-4283-92f7-d151cc6ba14e -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-01dc0444-2789-4283-92f7-d151cc6ba14e.57bcff9d-f04b-4630-b24b-3d4a364aca3c" returned: 0 in 0.695s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:14:22 devstack cinder-volume[87420]: WARNING cinder.volume.drivers.remotefs [None req-9fc8bfed-7814-4548-a7a3-e0c1bd92e087 tempest-SnapshotDependencyTests-714242607 None] /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-01dc0444-2789-4283-92f7-d151cc6ba14e.57bcff9d-f04b-4630-b24b-3d4a364aca3c is being set with open permissions: ugo+rw Jul 10 16:14:22 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-9fc8bfed-7814-4548-a7a3-e0c1bd92e087 tempest-SnapshotDependencyTests-714242607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-01dc0444-2789-4283-92f7-d151cc6ba14e.57bcff9d-f04b-4630-b24b-3d4a364aca3c {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:14:22 devstack sudo[107241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-01dc0444-2789-4283-92f7-d151cc6ba14e.57bcff9d-f04b-4630-b24b-3d4a364aca3c Jul 10 16:14:22 devstack sudo[107241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:14:23 devstack sudo[107241]: pam_unix(sudo:session): session closed for user root Jul 10 16:14:23 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-9fc8bfed-7814-4548-a7a3-e0c1bd92e087 tempest-SnapshotDependencyTests-714242607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-01dc0444-2789-4283-92f7-d151cc6ba14e.57bcff9d-f04b-4630-b24b-3d4a364aca3c" returned: 0 in 0.632s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:14:23 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-9fc8bfed-7814-4548-a7a3-e0c1bd92e087 tempest-SnapshotDependencyTests-714242607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-01dc0444-2789-4283-92f7-d151cc6ba14e.info {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:14:23 devstack sudo[107244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-01dc0444-2789-4283-92f7-d151cc6ba14e.info Jul 10 16:14:23 devstack sudo[107244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:14:23 devstack sudo[107244]: pam_unix(sudo:session): session closed for user root Jul 10 16:14:23 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-9fc8bfed-7814-4548-a7a3-e0c1bd92e087 tempest-SnapshotDependencyTests-714242607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-01dc0444-2789-4283-92f7-d151cc6ba14e.info" returned: 0 in 0.642s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:14:23 devstack cinder-volume[87420]: WARNING cinder.volume.drivers.remotefs [None req-9fc8bfed-7814-4548-a7a3-e0c1bd92e087 tempest-SnapshotDependencyTests-714242607 None] /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-01dc0444-2789-4283-92f7-d151cc6ba14e.info is being set with open permissions: ugo+rw Jul 10 16:14:23 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-9fc8bfed-7814-4548-a7a3-e0c1bd92e087 tempest-SnapshotDependencyTests-714242607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-01dc0444-2789-4283-92f7-d151cc6ba14e.info {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:14:23 devstack sudo[107248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-01dc0444-2789-4283-92f7-d151cc6ba14e.info Jul 10 16:14:23 devstack sudo[107248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:14:24 devstack sudo[107248]: pam_unix(sudo:session): session closed for user root Jul 10 16:14:24 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-9fc8bfed-7814-4548-a7a3-e0c1bd92e087 tempest-SnapshotDependencyTests-714242607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-01dc0444-2789-4283-92f7-d151cc6ba14e.info" returned: 0 in 0.643s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:14:24 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-9fc8bfed-7814-4548-a7a3-e0c1bd92e087 tempest-SnapshotDependencyTests-714242607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.403s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:14:24 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-16df3c3b-9b53-4bee-88d3-409f412b3c5a tempest-ProjectMemberTests-968602289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.555s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:14:24 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-16df3c3b-9b53-4bee-88d3-409f412b3c5a tempest-ProjectMemberTests-968602289 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:14:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-643685982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f97fd8f-ba69-4286-bbe8-aa3d0789e6d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a62b0a8c6e6a4e9a9b6772e9c7ee6af3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:14:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:14:22Z,use_quota=True,user_id='1a439b56b94841c39eb4e94d953ccde8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 16:14:24 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-16df3c3b-9b53-4bee-88d3-409f412b3c5a tempest-ProjectMemberTests-968602289 None] Creating volume 8f97fd8f-ba69-4286-bbe8-aa3d0789e6d8 {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 16:14:24 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-16df3c3b-9b53-4bee-88d3-409f412b3c5a tempest-ProjectMemberTests-968602289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:14:24 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-16df3c3b-9b53-4bee-88d3-409f412b3c5a tempest-ProjectMemberTests-968602289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:14:24 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-16df3c3b-9b53-4bee-88d3-409f412b3c5a tempest-ProjectMemberTests-968602289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:14:24 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-16df3c3b-9b53-4bee-88d3-409f412b3c5a tempest-ProjectMemberTests-968602289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:14:24 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-16df3c3b-9b53-4bee-88d3-409f412b3c5a tempest-ProjectMemberTests-968602289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:14:24 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-16df3c3b-9b53-4bee-88d3-409f412b3c5a tempest-ProjectMemberTests-968602289 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 16:14:24 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-16df3c3b-9b53-4bee-88d3-409f412b3c5a tempest-ProjectMemberTests-968602289 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 16:14:24 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-16df3c3b-9b53-4bee-88d3-409f412b3c5a tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-8f97fd8f-ba69-4286-bbe8-aa3d0789e6d8 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:14:24 devstack sudo[107253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-8f97fd8f-ba69-4286-bbe8-aa3d0789e6d8 1073741824 Jul 10 16:14:24 devstack sudo[107253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:14:24 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-9fc8bfed-7814-4548-a7a3-e0c1bd92e087 tempest-SnapshotDependencyTests-714242607 None] Create snapshot completed successfully Jul 10 16:14:25 devstack sudo[107253]: pam_unix(sudo:session): session closed for user root Jul 10 16:14:25 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-16df3c3b-9b53-4bee-88d3-409f412b3c5a tempest-ProjectMemberTests-968602289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-8f97fd8f-ba69-4286-bbe8-aa3d0789e6d8 1073741824" returned: 0 in 0.801s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:14:25 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-16df3c3b-9b53-4bee-88d3-409f412b3c5a tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-8f97fd8f-ba69-4286-bbe8-aa3d0789e6d8 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:14:25 devstack sudo[107258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-8f97fd8f-ba69-4286-bbe8-aa3d0789e6d8 Jul 10 16:14:25 devstack sudo[107258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:14:25 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-95d40396-4ec7-4a8c-9945-63762774fa2b tempest-SnapshotDependencyTests-714242607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 16:14:25 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-95d40396-4ec7-4a8c-9945-63762774fa2b tempest-SnapshotDependencyTests-714242607 None] Flow 'volume_create_manager' (fb728d24-1b7b-4be7-ac61-f6a4d9aad4f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:14:25 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-95d40396-4ec7-4a8c-9945-63762774fa2b tempest-SnapshotDependencyTests-714242607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b84ec5b-7ad3-4bce-92af-64a331dfe2f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:14:25 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-95d40396-4ec7-4a8c-9945-63762774fa2b tempest-SnapshotDependencyTests-714242607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b84ec5b-7ad3-4bce-92af-64a331dfe2f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:14:26Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb360524-d346-438d-9364-12c5d13e3737,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40668500c1c340218402d2e27f26a8fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:14:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=57bcff9d-f04b-4630-b24b-3d4a364aca3c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:14:26Z,use_quota=True,user_id='43d579784b744388b9303f50d1d03aac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:14:26 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-95d40396-4ec7-4a8c-9945-63762774fa2b tempest-SnapshotDependencyTests-714242607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4616b15-02d0-47b2-9d99-228bab1502e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:14:26 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-95d40396-4ec7-4a8c-9945-63762774fa2b tempest-SnapshotDependencyTests-714242607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4616b15-02d0-47b2-9d99-228bab1502e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:14:26 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-95d40396-4ec7-4a8c-9945-63762774fa2b tempest-SnapshotDependencyTests-714242607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ab5cfdb-bb48-4398-8550-ba0b1f51c08e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:14:26 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-95d40396-4ec7-4a8c-9945-63762774fa2b tempest-SnapshotDependencyTests-714242607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ab5cfdb-bb48-4398-8550-ba0b1f51c08e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'fb360524-d346-438d-9364-12c5d13e3737', 'volume_name': 'volume-fb360524-d346-438d-9364-12c5d13e3737', 'volume_size': 1, 'snapshot_id': '57bcff9d-f04b-4630-b24b-3d4a364aca3c'}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:14:26 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-95d40396-4ec7-4a8c-9945-63762774fa2b tempest-SnapshotDependencyTests-714242607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b058990a-d934-4574-a05f-ad5d66d39b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:14:26 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-95d40396-4ec7-4a8c-9945-63762774fa2b tempest-SnapshotDependencyTests-714242607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b058990a-d934-4574-a05f-ad5d66d39b46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:14:26 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-95d40396-4ec7-4a8c-9945-63762774fa2b tempest-SnapshotDependencyTests-714242607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1a2ace6-c301-4ca3-9efb-6a1ae22bc4bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:14:26 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-95d40396-4ec7-4a8c-9945-63762774fa2b tempest-SnapshotDependencyTests-714242607 None] Volume fb360524-d346-438d-9364-12c5d13e3737: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-fb360524-d346-438d-9364-12c5d13e3737', 'volume_size': 1, 'snapshot_id': '57bcff9d-f04b-4630-b24b-3d4a364aca3c'} Jul 10 16:14:26 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-95d40396-4ec7-4a8c-9945-63762774fa2b tempest-SnapshotDependencyTests-714242607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:14:26 devstack sudo[107258]: pam_unix(sudo:session): session closed for user root Jul 10 16:14:26 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-16df3c3b-9b53-4bee-88d3-409f412b3c5a tempest-ProjectMemberTests-968602289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-8f97fd8f-ba69-4286-bbe8-aa3d0789e6d8" returned: 0 in 0.668s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:14:26 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-16df3c3b-9b53-4bee-88d3-409f412b3c5a tempest-ProjectMemberTests-968602289 None] <== create_volume: return (1510ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 16:14:26 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-16df3c3b-9b53-4bee-88d3-409f412b3c5a tempest-ProjectMemberTests-968602289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.513s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:14:26 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-95d40396-4ec7-4a8c-9945-63762774fa2b tempest-SnapshotDependencyTests-714242607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.070s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:14:26 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-95d40396-4ec7-4a8c-9945-63762774fa2b tempest-SnapshotDependencyTests-714242607 None] Acquiring lock "cinder-quobyte-57bcff9d-f04b-4630-b24b-3d4a364aca3c-fb360524-d346-438d-9364-12c5d13e3737" by "_create_volume_from_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:14:26 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-16df3c3b-9b53-4bee-88d3-409f412b3c5a tempest-ProjectMemberTests-968602289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2c95d7b-15bf-4fac-9f3f-c703c18a232c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f97fd8f-ba69-4286-bbe8-aa3d0789e6d8', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:14:26 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-16df3c3b-9b53-4bee-88d3-409f412b3c5a tempest-ProjectMemberTests-968602289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (154615f8-cd60-405b-803b-58dfc1e86dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:14:26 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-95d40396-4ec7-4a8c-9945-63762774fa2b tempest-SnapshotDependencyTests-714242607 None] Lock "cinder-quobyte-57bcff9d-f04b-4630-b24b-3d4a364aca3c-fb360524-d346-438d-9364-12c5d13e3737" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:14:26 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-95d40396-4ec7-4a8c-9945-63762774fa2b tempest-SnapshotDependencyTests-714242607 None] Creating volume fb360524-d346-438d-9364-12c5d13e3737 from snapshot 57bcff9d-f04b-4630-b24b-3d4a364aca3c {{(pid=87420) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 10 16:14:26 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-95d40396-4ec7-4a8c-9945-63762774fa2b tempest-SnapshotDependencyTests-714242607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:14:26 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-95d40396-4ec7-4a8c-9945-63762774fa2b tempest-SnapshotDependencyTests-714242607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:14:26 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-95d40396-4ec7-4a8c-9945-63762774fa2b tempest-SnapshotDependencyTests-714242607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:14:26 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-95d40396-4ec7-4a8c-9945-63762774fa2b tempest-SnapshotDependencyTests-714242607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:14:26 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-95d40396-4ec7-4a8c-9945-63762774fa2b tempest-SnapshotDependencyTests-714242607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:14:26 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-95d40396-4ec7-4a8c-9945-63762774fa2b tempest-SnapshotDependencyTests-714242607 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 16:14:26 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-95d40396-4ec7-4a8c-9945-63762774fa2b tempest-SnapshotDependencyTests-714242607 None] Acquiring lock "cinder-quobyte-fb360524-d346-438d-9364-12c5d13e3737" by "_copy_volume_from_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:14:26 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-95d40396-4ec7-4a8c-9945-63762774fa2b tempest-SnapshotDependencyTests-714242607 None] Lock "cinder-quobyte-fb360524-d346-438d-9364-12c5d13e3737" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:14:26 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-95d40396-4ec7-4a8c-9945-63762774fa2b tempest-SnapshotDependencyTests-714242607 None] snapshot: 57bcff9d-f04b-4630-b24b-3d4a364aca3c, volume: fb360524-d346-438d-9364-12c5d13e3737, {{(pid=87420) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 16:14:26 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-16df3c3b-9b53-4bee-88d3-409f412b3c5a tempest-ProjectMemberTests-968602289 None] Volume volume-8f97fd8f-ba69-4286-bbe8-aa3d0789e6d8 (8f97fd8f-ba69-4286-bbe8-aa3d0789e6d8): created successfully Jul 10 16:14:26 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-16df3c3b-9b53-4bee-88d3-409f412b3c5a tempest-ProjectMemberTests-968602289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (154615f8-cd60-405b-803b-58dfc1e86dfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:14:26 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-16df3c3b-9b53-4bee-88d3-409f412b3c5a tempest-ProjectMemberTests-968602289 None] Flow 'volume_create_manager' (907256fd-40ee-404b-b68c-d5391727b02d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:14:26 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-95d40396-4ec7-4a8c-9945-63762774fa2b tempest-SnapshotDependencyTests-714242607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:14:26 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-95d40396-4ec7-4a8c-9945-63762774fa2b tempest-SnapshotDependencyTests-714242607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:14:26 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-95d40396-4ec7-4a8c-9945-63762774fa2b tempest-SnapshotDependencyTests-714242607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:14:26 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-95d40396-4ec7-4a8c-9945-63762774fa2b tempest-SnapshotDependencyTests-714242607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:14:26 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-95d40396-4ec7-4a8c-9945-63762774fa2b tempest-SnapshotDependencyTests-714242607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:14:26 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-16df3c3b-9b53-4bee-88d3-409f412b3c5a tempest-ProjectMemberTests-968602289 None] Created volume successfully. Jul 10 16:14:26 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[76019c81-e7e5-4816-b878-4a8aae1b0c81]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:14:26 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-95d40396-4ec7-4a8c-9945-63762774fa2b tempest-SnapshotDependencyTests-714242607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-01dc0444-2789-4283-92f7-d151cc6ba14e.57bcff9d-f04b-4630-b24b-3d4a364aca3c {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:14:26 devstack sudo[107261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-01dc0444-2789-4283-92f7-d151cc6ba14e.57bcff9d-f04b-4630-b24b-3d4a364aca3c Jul 10 16:14:26 devstack sudo[107261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:14:26 devstack sudo[107261]: pam_unix(sudo:session): session closed for user root Jul 10 16:14:26 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-95d40396-4ec7-4a8c-9945-63762774fa2b tempest-SnapshotDependencyTests-714242607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-01dc0444-2789-4283-92f7-d151cc6ba14e.57bcff9d-f04b-4630-b24b-3d4a364aca3c" returned: 0 in 0.747s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:14:26 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-95d40396-4ec7-4a8c-9945-63762774fa2b tempest-SnapshotDependencyTests-714242607 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01dc0444-2789-4283-92f7-d151cc6ba14e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87420) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 16:14:26 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-95d40396-4ec7-4a8c-9945-63762774fa2b tempest-SnapshotDependencyTests-714242607 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-01dc0444-2789-4283-92f7-d151cc6ba14e {{(pid=87420) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 16:14:26 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-95d40396-4ec7-4a8c-9945-63762774fa2b tempest-SnapshotDependencyTests-714242607 None] Creating direct copy from snapshot {{(pid=87420) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 16:14:26 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe594b7c-fbcb-4145-98bc-d08ed0dcee73]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:14:26 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-95d40396-4ec7-4a8c-9945-63762774fa2b tempest-SnapshotDependencyTests-714242607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-01dc0444-2789-4283-92f7-d151cc6ba14e {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:14:27 devstack sudo[107266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-01dc0444-2789-4283-92f7-d151cc6ba14e Jul 10 16:14:27 devstack sudo[107266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:14:27 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-2e88d542-0393-4ce9-ae43-4b2bfe3b80e8 tempest-ProjectMemberTests-968602289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:14:27 devstack sudo[107266]: pam_unix(sudo:session): session closed for user root Jul 10 16:14:27 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-95d40396-4ec7-4a8c-9945-63762774fa2b tempest-SnapshotDependencyTests-714242607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-01dc0444-2789-4283-92f7-d151cc6ba14e" returned: 0 in 0.776s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:14:27 devstack cinder-volume[87420]: DEBUG cinder.utils [None req-95d40396-4ec7-4a8c-9945-63762774fa2b tempest-SnapshotDependencyTests-714242607 None] Path /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-fb360524-d346-438d-9364-12c5d13e3737 not found in is_blk_device check {{(pid=87420) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 16:14:27 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-95d40396-4ec7-4a8c-9945-63762774fa2b tempest-SnapshotDependencyTests-714242607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-01dc0444-2789-4283-92f7-d151cc6ba14e /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-fb360524-d346-438d-9364-12c5d13e3737 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:14:27 devstack sudo[107271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-01dc0444-2789-4283-92f7-d151cc6ba14e /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-fb360524-d346-438d-9364-12c5d13e3737 Jul 10 16:14:27 devstack sudo[107271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:14:32 devstack sudo[107271]: pam_unix(sudo:session): session closed for user root Jul 10 16:14:32 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-95d40396-4ec7-4a8c-9945-63762774fa2b tempest-SnapshotDependencyTests-714242607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-01dc0444-2789-4283-92f7-d151cc6ba14e /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-fb360524-d346-438d-9364-12c5d13e3737" returned: 0 in 4.469s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:14:32 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[03bfd227-97d2-4133-8eca-f3b35f66079e]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:14:32 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-95d40396-4ec7-4a8c-9945-63762774fa2b tempest-SnapshotDependencyTests-714242607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-01dc0444-2789-4283-92f7-d151cc6ba14e {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:14:32 devstack sudo[107284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-01dc0444-2789-4283-92f7-d151cc6ba14e Jul 10 16:14:32 devstack sudo[107284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:14:33 devstack sudo[107284]: pam_unix(sudo:session): session closed for user root Jul 10 16:14:33 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-95d40396-4ec7-4a8c-9945-63762774fa2b tempest-SnapshotDependencyTests-714242607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-01dc0444-2789-4283-92f7-d151cc6ba14e" returned: 0 in 0.902s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:14:33 devstack cinder-volume[87420]: DEBUG cinder.image.image_utils [None req-95d40396-4ec7-4a8c-9945-63762774fa2b tempest-SnapshotDependencyTests-714242607 None] Image conversion details: src /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-01dc0444-2789-4283-92f7-d151cc6ba14e, size 1024.00 MB, duration 4.47 sec, destination /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-fb360524-d346-438d-9364-12c5d13e3737 {{(pid=87420) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 16:14:33 devstack cinder-volume[87420]: INFO cinder.image.image_utils [None req-95d40396-4ec7-4a8c-9945-63762774fa2b tempest-SnapshotDependencyTests-714242607 None] Converted 1024.00 MB image at 229.08 MB/s Jul 10 16:14:33 devstack cinder-volume[87420]: WARNING cinder.volume.drivers.remotefs [None req-95d40396-4ec7-4a8c-9945-63762774fa2b tempest-SnapshotDependencyTests-714242607 None] /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-fb360524-d346-438d-9364-12c5d13e3737 is being set with open permissions: ugo+rw Jul 10 16:14:33 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-95d40396-4ec7-4a8c-9945-63762774fa2b tempest-SnapshotDependencyTests-714242607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-fb360524-d346-438d-9364-12c5d13e3737 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:14:33 devstack sudo[107289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-fb360524-d346-438d-9364-12c5d13e3737 Jul 10 16:14:33 devstack sudo[107289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:14:33 devstack sudo[107289]: pam_unix(sudo:session): session closed for user root Jul 10 16:14:33 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-95d40396-4ec7-4a8c-9945-63762774fa2b tempest-SnapshotDependencyTests-714242607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-fb360524-d346-438d-9364-12c5d13e3737" returned: 0 in 0.637s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:14:33 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-95d40396-4ec7-4a8c-9945-63762774fa2b tempest-SnapshotDependencyTests-714242607 None] Lock "cinder-quobyte-fb360524-d346-438d-9364-12c5d13e3737" released by "_copy_volume_from_snapshot" :: held 7.634s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:14:33 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-95d40396-4ec7-4a8c-9945-63762774fa2b tempest-SnapshotDependencyTests-714242607 None] Lock "cinder-quobyte-57bcff9d-f04b-4630-b24b-3d4a364aca3c-fb360524-d346-438d-9364-12c5d13e3737" released by "_create_volume_from_snapshot" :: held 7.665s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:14:33 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-95d40396-4ec7-4a8c-9945-63762774fa2b tempest-SnapshotDependencyTests-714242607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.692s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:14:33 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-2e88d542-0393-4ce9-ae43-4b2bfe3b80e8 tempest-ProjectMemberTests-968602289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.465s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:14:33 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-2e88d542-0393-4ce9-ae43-4b2bfe3b80e8 tempest-ProjectMemberTests-968602289 None] Creating offline snapshot 034556bd-88e9-41ea-a182-aca648fecd0c of volume 8f97fd8f-ba69-4286-bbe8-aa3d0789e6d8 {{(pid=87420) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 16:14:33 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-95d40396-4ec7-4a8c-9945-63762774fa2b tempest-SnapshotDependencyTests-714242607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1a2ace6-c301-4ca3-9efb-6a1ae22bc4bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb360524-d346-438d-9364-12c5d13e3737', 'volume_size': 1, 'snapshot_id': '57bcff9d-f04b-4630-b24b-3d4a364aca3c'}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:14:33 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-95d40396-4ec7-4a8c-9945-63762774fa2b tempest-SnapshotDependencyTests-714242607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (913c4313-a2ea-48e9-ba29-ddda93818807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:14:33 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5c7c746-4929-40d9-99e1-4451212dc1f1]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:14:33 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-2e88d542-0393-4ce9-ae43-4b2bfe3b80e8 tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-8f97fd8f-ba69-4286-bbe8-aa3d0789e6d8 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:14:33 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-95d40396-4ec7-4a8c-9945-63762774fa2b tempest-SnapshotDependencyTests-714242607 None] Volume volume-fb360524-d346-438d-9364-12c5d13e3737 (fb360524-d346-438d-9364-12c5d13e3737): created successfully Jul 10 16:14:33 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-95d40396-4ec7-4a8c-9945-63762774fa2b tempest-SnapshotDependencyTests-714242607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (913c4313-a2ea-48e9-ba29-ddda93818807) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:14:33 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-95d40396-4ec7-4a8c-9945-63762774fa2b tempest-SnapshotDependencyTests-714242607 None] Flow 'volume_create_manager' (fb728d24-1b7b-4be7-ac61-f6a4d9aad4f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:14:33 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-95d40396-4ec7-4a8c-9945-63762774fa2b tempest-SnapshotDependencyTests-714242607 None] Created volume successfully. Jul 10 16:14:33 devstack sudo[107293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-8f97fd8f-ba69-4286-bbe8-aa3d0789e6d8 Jul 10 16:14:33 devstack sudo[107293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:14:34 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-f1ad7a9e-3791-4577-8a3c-2f587dcee27a tempest-SnapshotDependencyTests-714242607 None] Acquiring lock "cinder-57bcff9d-f04b-4630-b24b-3d4a364aca3c-delete_snapshot" by "delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:14:34 devstack sudo[107293]: pam_unix(sudo:session): session closed for user root Jul 10 16:14:34 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-2e88d542-0393-4ce9-ae43-4b2bfe3b80e8 tempest-ProjectMemberTests-968602289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-8f97fd8f-ba69-4286-bbe8-aa3d0789e6d8" returned: 0 in 0.773s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:14:34 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-2e88d542-0393-4ce9-ae43-4b2bfe3b80e8 tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-8f97fd8f-ba69-4286-bbe8-aa3d0789e6d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-8f97fd8f-ba69-4286-bbe8-aa3d0789e6d8.034556bd-88e9-41ea-a182-aca648fecd0c 1G {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:14:34 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-f1ad7a9e-3791-4577-8a3c-2f587dcee27a tempest-SnapshotDependencyTests-714242607 None] Lock "cinder-57bcff9d-f04b-4630-b24b-3d4a364aca3c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:14:34 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-f1ad7a9e-3791-4577-8a3c-2f587dcee27a tempest-SnapshotDependencyTests-714242607 None] Acquiring lock "cinder-quobyte-01dc0444-2789-4283-92f7-d151cc6ba14e" by "delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:14:34 devstack sudo[107298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-8f97fd8f-ba69-4286-bbe8-aa3d0789e6d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-8f97fd8f-ba69-4286-bbe8-aa3d0789e6d8.034556bd-88e9-41ea-a182-aca648fecd0c 1G Jul 10 16:14:34 devstack sudo[107298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:14:34 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-f1ad7a9e-3791-4577-8a3c-2f587dcee27a tempest-SnapshotDependencyTests-714242607 None] Lock "cinder-quobyte-01dc0444-2789-4283-92f7-d151cc6ba14e" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:14:34 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-f1ad7a9e-3791-4577-8a3c-2f587dcee27a tempest-SnapshotDependencyTests-714242607 None] Acquiring lock "cinder-quobyte-57bcff9d-f04b-4630-b24b-3d4a364aca3c" by "_delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:14:34 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-f1ad7a9e-3791-4577-8a3c-2f587dcee27a tempest-SnapshotDependencyTests-714242607 None] Lock "cinder-quobyte-57bcff9d-f04b-4630-b24b-3d4a364aca3c" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:14:34 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-f1ad7a9e-3791-4577-8a3c-2f587dcee27a tempest-SnapshotDependencyTests-714242607 None] Deleting offline snapshot 57bcff9d-f04b-4630-b24b-3d4a364aca3c of volume 01dc0444-2789-4283-92f7-d151cc6ba14e {{(pid=87420) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 16:14:34 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-f1ad7a9e-3791-4577-8a3c-2f587dcee27a tempest-SnapshotDependencyTests-714242607 None] snapshot_file for this snap is: volume-01dc0444-2789-4283-92f7-d151cc6ba14e.57bcff9d-f04b-4630-b24b-3d4a364aca3c {{(pid=87420) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 16:14:34 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[18d5446d-693f-4a55-a70c-c5a65270f311]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:14:34 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f1ad7a9e-3791-4577-8a3c-2f587dcee27a tempest-SnapshotDependencyTests-714242607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-01dc0444-2789-4283-92f7-d151cc6ba14e.57bcff9d-f04b-4630-b24b-3d4a364aca3c {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:14:34 devstack sudo[107300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-01dc0444-2789-4283-92f7-d151cc6ba14e.57bcff9d-f04b-4630-b24b-3d4a364aca3c Jul 10 16:14:34 devstack sudo[107300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:14:35 devstack sudo[107298]: pam_unix(sudo:session): session closed for user root Jul 10 16:14:35 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-2e88d542-0393-4ce9-ae43-4b2bfe3b80e8 tempest-ProjectMemberTests-968602289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-8f97fd8f-ba69-4286-bbe8-aa3d0789e6d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-8f97fd8f-ba69-4286-bbe8-aa3d0789e6d8.034556bd-88e9-41ea-a182-aca648fecd0c 1G" returned: 0 in 0.788s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:14:35 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-2e88d542-0393-4ce9-ae43-4b2bfe3b80e8 tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f97fd8f-ba69-4286-bbe8-aa3d0789e6d8 -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-8f97fd8f-ba69-4286-bbe8-aa3d0789e6d8.034556bd-88e9-41ea-a182-aca648fecd0c {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:14:35 devstack sudo[107308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f97fd8f-ba69-4286-bbe8-aa3d0789e6d8 -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-8f97fd8f-ba69-4286-bbe8-aa3d0789e6d8.034556bd-88e9-41ea-a182-aca648fecd0c Jul 10 16:14:35 devstack sudo[107308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:14:35 devstack sudo[107300]: pam_unix(sudo:session): session closed for user root Jul 10 16:14:35 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f1ad7a9e-3791-4577-8a3c-2f587dcee27a tempest-SnapshotDependencyTests-714242607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-01dc0444-2789-4283-92f7-d151cc6ba14e.57bcff9d-f04b-4630-b24b-3d4a364aca3c" returned: 0 in 0.761s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:14:35 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-f1ad7a9e-3791-4577-8a3c-2f587dcee27a tempest-SnapshotDependencyTests-714242607 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01dc0444-2789-4283-92f7-d151cc6ba14e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87420) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 16:14:35 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[3128437f-036f-49ae-a0ce-1e95b123fc4d]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:14:35 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f1ad7a9e-3791-4577-8a3c-2f587dcee27a tempest-SnapshotDependencyTests-714242607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-01dc0444-2789-4283-92f7-d151cc6ba14e {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:14:35 devstack sudo[107310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-01dc0444-2789-4283-92f7-d151cc6ba14e Jul 10 16:14:35 devstack sudo[107310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:14:36 devstack sudo[107308]: pam_unix(sudo:session): session closed for user root Jul 10 16:14:36 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-2e88d542-0393-4ce9-ae43-4b2bfe3b80e8 tempest-ProjectMemberTests-968602289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f97fd8f-ba69-4286-bbe8-aa3d0789e6d8 -F qcow2 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-8f97fd8f-ba69-4286-bbe8-aa3d0789e6d8.034556bd-88e9-41ea-a182-aca648fecd0c" returned: 0 in 0.707s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:14:36 devstack cinder-volume[87420]: WARNING cinder.volume.drivers.remotefs [None req-2e88d542-0393-4ce9-ae43-4b2bfe3b80e8 tempest-ProjectMemberTests-968602289 None] /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-8f97fd8f-ba69-4286-bbe8-aa3d0789e6d8.034556bd-88e9-41ea-a182-aca648fecd0c is being set with open permissions: ugo+rw Jul 10 16:14:36 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-2e88d542-0393-4ce9-ae43-4b2bfe3b80e8 tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-8f97fd8f-ba69-4286-bbe8-aa3d0789e6d8.034556bd-88e9-41ea-a182-aca648fecd0c {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:14:36 devstack sudo[107315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-8f97fd8f-ba69-4286-bbe8-aa3d0789e6d8.034556bd-88e9-41ea-a182-aca648fecd0c Jul 10 16:14:36 devstack sudo[107315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:14:36 devstack sudo[107310]: pam_unix(sudo:session): session closed for user root Jul 10 16:14:36 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f1ad7a9e-3791-4577-8a3c-2f587dcee27a tempest-SnapshotDependencyTests-714242607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-01dc0444-2789-4283-92f7-d151cc6ba14e" returned: 0 in 0.783s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:14:36 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f1ad7a9e-3791-4577-8a3c-2f587dcee27a tempest-SnapshotDependencyTests-714242607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-01dc0444-2789-4283-92f7-d151cc6ba14e.57bcff9d-f04b-4630-b24b-3d4a364aca3c {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:14:36 devstack sudo[107320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-01dc0444-2789-4283-92f7-d151cc6ba14e.57bcff9d-f04b-4630-b24b-3d4a364aca3c Jul 10 16:14:36 devstack sudo[107320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:14:36 devstack sudo[107315]: pam_unix(sudo:session): session closed for user root Jul 10 16:14:36 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-2e88d542-0393-4ce9-ae43-4b2bfe3b80e8 tempest-ProjectMemberTests-968602289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-8f97fd8f-ba69-4286-bbe8-aa3d0789e6d8.034556bd-88e9-41ea-a182-aca648fecd0c" returned: 0 in 0.643s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:14:36 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-2e88d542-0393-4ce9-ae43-4b2bfe3b80e8 tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-8f97fd8f-ba69-4286-bbe8-aa3d0789e6d8.info {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:14:36 devstack sudo[107323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-8f97fd8f-ba69-4286-bbe8-aa3d0789e6d8.info Jul 10 16:14:36 devstack sudo[107323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:14:37 devstack sudo[107320]: pam_unix(sudo:session): session closed for user root Jul 10 16:14:37 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f1ad7a9e-3791-4577-8a3c-2f587dcee27a tempest-SnapshotDependencyTests-714242607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-01dc0444-2789-4283-92f7-d151cc6ba14e.57bcff9d-f04b-4630-b24b-3d4a364aca3c" returned: 0 in 0.779s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:14:37 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f1ad7a9e-3791-4577-8a3c-2f587dcee27a tempest-SnapshotDependencyTests-714242607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-01dc0444-2789-4283-92f7-d151cc6ba14e.57bcff9d-f04b-4630-b24b-3d4a364aca3c {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:14:37 devstack sudo[107328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-01dc0444-2789-4283-92f7-d151cc6ba14e.57bcff9d-f04b-4630-b24b-3d4a364aca3c Jul 10 16:14:37 devstack sudo[107328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:14:37 devstack sudo[107323]: pam_unix(sudo:session): session closed for user root Jul 10 16:14:37 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-2e88d542-0393-4ce9-ae43-4b2bfe3b80e8 tempest-ProjectMemberTests-968602289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-8f97fd8f-ba69-4286-bbe8-aa3d0789e6d8.info" returned: 0 in 0.662s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:14:37 devstack cinder-volume[87420]: WARNING cinder.volume.drivers.remotefs [None req-2e88d542-0393-4ce9-ae43-4b2bfe3b80e8 tempest-ProjectMemberTests-968602289 None] /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-8f97fd8f-ba69-4286-bbe8-aa3d0789e6d8.info is being set with open permissions: ugo+rw Jul 10 16:14:37 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-2e88d542-0393-4ce9-ae43-4b2bfe3b80e8 tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-8f97fd8f-ba69-4286-bbe8-aa3d0789e6d8.info {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:14:37 devstack sudo[107331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-8f97fd8f-ba69-4286-bbe8-aa3d0789e6d8.info Jul 10 16:14:37 devstack sudo[107331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:14:37 devstack sudo[107328]: pam_unix(sudo:session): session closed for user root Jul 10 16:14:37 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f1ad7a9e-3791-4577-8a3c-2f587dcee27a tempest-SnapshotDependencyTests-714242607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-01dc0444-2789-4283-92f7-d151cc6ba14e.57bcff9d-f04b-4630-b24b-3d4a364aca3c" returned: 0 in 0.683s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:14:37 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-f1ad7a9e-3791-4577-8a3c-2f587dcee27a tempest-SnapshotDependencyTests-714242607 None] Lock "cinder-quobyte-57bcff9d-f04b-4630-b24b-3d4a364aca3c" released by "_delete_snapshot" :: held 3.133s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:14:37 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-f1ad7a9e-3791-4577-8a3c-2f587dcee27a tempest-SnapshotDependencyTests-714242607 None] Lock "cinder-quobyte-01dc0444-2789-4283-92f7-d151cc6ba14e" released by "delete_snapshot" :: held 3.156s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:14:37 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-f1ad7a9e-3791-4577-8a3c-2f587dcee27a tempest-SnapshotDependencyTests-714242607 None] Created reservations ['abf37347-85fa-4235-b32c-0d5148fa71ac', '76e4234e-9980-4fa1-b6d0-2aaebdd8b555', '8910c304-504b-45ae-8c7c-355f9a37289b', 'f7b3c8f2-8525-4511-8cbd-371b5ca8502d'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:14:37 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-f1ad7a9e-3791-4577-8a3c-2f587dcee27a tempest-SnapshotDependencyTests-714242607 None] Delete snapshot completed successfully. Jul 10 16:14:37 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-f1ad7a9e-3791-4577-8a3c-2f587dcee27a tempest-SnapshotDependencyTests-714242607 None] Lock "cinder-57bcff9d-f04b-4630-b24b-3d4a364aca3c-delete_snapshot" released by "delete_snapshot" :: held 3.294s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:14:38 devstack sudo[107331]: pam_unix(sudo:session): session closed for user root Jul 10 16:14:38 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-2e88d542-0393-4ce9-ae43-4b2bfe3b80e8 tempest-ProjectMemberTests-968602289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-8f97fd8f-ba69-4286-bbe8-aa3d0789e6d8.info" returned: 0 in 0.669s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:14:38 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-2e88d542-0393-4ce9-ae43-4b2bfe3b80e8 tempest-ProjectMemberTests-968602289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.341s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:14:38 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-2e88d542-0393-4ce9-ae43-4b2bfe3b80e8 tempest-ProjectMemberTests-968602289 None] Create snapshot completed successfully Jul 10 16:14:38 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-ee11667b-5a89-4e00-b62a-cb3a1fa8cc6b tempest-SnapshotDependencyTests-714242607 None] Acquiring lock "cinder-01dc0444-2789-4283-92f7-d151cc6ba14e-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:14:38 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-ee11667b-5a89-4e00-b62a-cb3a1fa8cc6b tempest-SnapshotDependencyTests-714242607 None] Lock "cinder-01dc0444-2789-4283-92f7-d151cc6ba14e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:14:38 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-ee11667b-5a89-4e00-b62a-cb3a1fa8cc6b tempest-SnapshotDependencyTests-714242607 None] Acquiring lock "cinder-quobyte-01dc0444-2789-4283-92f7-d151cc6ba14e" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:14:38 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-ee11667b-5a89-4e00-b62a-cb3a1fa8cc6b tempest-SnapshotDependencyTests-714242607 None] Lock "cinder-quobyte-01dc0444-2789-4283-92f7-d151cc6ba14e" acquired by "delete_volume" :: waited 0.015s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:14:39 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5032741-c7a3-4b75-94e2-b1bdc07c5dc8]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:14:39 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ee11667b-5a89-4e00-b62a-cb3a1fa8cc6b tempest-SnapshotDependencyTests-714242607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-01dc0444-2789-4283-92f7-d151cc6ba14e {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:14:39 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-101935a6-79e1-4842-9632-7bb4d76d9a2c tempest-ProjectMemberTests-968602289 None] Acquiring lock "cinder-034556bd-88e9-41ea-a182-aca648fecd0c-delete_snapshot" by "delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:14:39 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-101935a6-79e1-4842-9632-7bb4d76d9a2c tempest-ProjectMemberTests-968602289 None] Lock "cinder-034556bd-88e9-41ea-a182-aca648fecd0c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:14:39 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-101935a6-79e1-4842-9632-7bb4d76d9a2c tempest-ProjectMemberTests-968602289 None] Acquiring lock "cinder-quobyte-8f97fd8f-ba69-4286-bbe8-aa3d0789e6d8" by "delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:14:39 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-101935a6-79e1-4842-9632-7bb4d76d9a2c tempest-ProjectMemberTests-968602289 None] Lock "cinder-quobyte-8f97fd8f-ba69-4286-bbe8-aa3d0789e6d8" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:14:39 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-101935a6-79e1-4842-9632-7bb4d76d9a2c tempest-ProjectMemberTests-968602289 None] Acquiring lock "cinder-quobyte-034556bd-88e9-41ea-a182-aca648fecd0c" by "_delete_snapshot" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:14:39 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-101935a6-79e1-4842-9632-7bb4d76d9a2c tempest-ProjectMemberTests-968602289 None] Lock "cinder-quobyte-034556bd-88e9-41ea-a182-aca648fecd0c" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:14:39 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-101935a6-79e1-4842-9632-7bb4d76d9a2c tempest-ProjectMemberTests-968602289 None] Deleting offline snapshot 034556bd-88e9-41ea-a182-aca648fecd0c of volume 8f97fd8f-ba69-4286-bbe8-aa3d0789e6d8 {{(pid=87420) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 16:14:39 devstack sudo[107335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-01dc0444-2789-4283-92f7-d151cc6ba14e Jul 10 16:14:39 devstack sudo[107335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:14:39 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-101935a6-79e1-4842-9632-7bb4d76d9a2c tempest-ProjectMemberTests-968602289 None] snapshot_file for this snap is: volume-8f97fd8f-ba69-4286-bbe8-aa3d0789e6d8.034556bd-88e9-41ea-a182-aca648fecd0c {{(pid=87420) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 16:14:39 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf29138d-d833-480d-909f-7aefad37b3c4]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:14:39 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-101935a6-79e1-4842-9632-7bb4d76d9a2c tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-8f97fd8f-ba69-4286-bbe8-aa3d0789e6d8.034556bd-88e9-41ea-a182-aca648fecd0c {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:14:39 devstack sudo[107337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-8f97fd8f-ba69-4286-bbe8-aa3d0789e6d8.034556bd-88e9-41ea-a182-aca648fecd0c Jul 10 16:14:39 devstack sudo[107337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:14:39 devstack sudo[107335]: pam_unix(sudo:session): session closed for user root Jul 10 16:14:39 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ee11667b-5a89-4e00-b62a-cb3a1fa8cc6b tempest-SnapshotDependencyTests-714242607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-01dc0444-2789-4283-92f7-d151cc6ba14e" returned: 0 in 0.818s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:14:39 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ee11667b-5a89-4e00-b62a-cb3a1fa8cc6b tempest-SnapshotDependencyTests-714242607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-01dc0444-2789-4283-92f7-d151cc6ba14e {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:14:39 devstack sudo[107345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-01dc0444-2789-4283-92f7-d151cc6ba14e Jul 10 16:14:39 devstack sudo[107345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:14:39 devstack sudo[107337]: pam_unix(sudo:session): session closed for user root Jul 10 16:14:39 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-101935a6-79e1-4842-9632-7bb4d76d9a2c tempest-ProjectMemberTests-968602289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-8f97fd8f-ba69-4286-bbe8-aa3d0789e6d8.034556bd-88e9-41ea-a182-aca648fecd0c" returned: 0 in 0.793s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:14:39 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-101935a6-79e1-4842-9632-7bb4d76d9a2c tempest-ProjectMemberTests-968602289 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8f97fd8f-ba69-4286-bbe8-aa3d0789e6d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87420) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 16:14:39 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[001f653e-a8fd-4360-bb1d-97c367564228]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:14:39 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-101935a6-79e1-4842-9632-7bb4d76d9a2c tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-8f97fd8f-ba69-4286-bbe8-aa3d0789e6d8 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:14:40 devstack sudo[107347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-8f97fd8f-ba69-4286-bbe8-aa3d0789e6d8 Jul 10 16:14:40 devstack sudo[107347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:14:40 devstack sudo[107345]: pam_unix(sudo:session): session closed for user root Jul 10 16:14:40 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ee11667b-5a89-4e00-b62a-cb3a1fa8cc6b tempest-SnapshotDependencyTests-714242607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-01dc0444-2789-4283-92f7-d151cc6ba14e" returned: 0 in 0.643s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:14:40 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-ee11667b-5a89-4e00-b62a-cb3a1fa8cc6b tempest-SnapshotDependencyTests-714242607 None] Lock "cinder-quobyte-01dc0444-2789-4283-92f7-d151cc6ba14e" released by "delete_volume" :: held 1.533s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:14:40 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-ee11667b-5a89-4e00-b62a-cb3a1fa8cc6b tempest-SnapshotDependencyTests-714242607 None] Created reservations ['9174682c-cd85-46fb-9f16-60b1256c90dc', 'cd2032a9-1550-499b-ab0d-d2fd4ae99461', '9e453656-d18c-48ca-8032-2ef38779c785', '2c61f782-290d-4a8b-9dfb-a266e2b003a9'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:14:40 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-ee11667b-5a89-4e00-b62a-cb3a1fa8cc6b tempest-SnapshotDependencyTests-714242607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:14:40 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-ee11667b-5a89-4e00-b62a-cb3a1fa8cc6b tempest-SnapshotDependencyTests-714242607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:14:40 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-ee11667b-5a89-4e00-b62a-cb3a1fa8cc6b tempest-SnapshotDependencyTests-714242607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:14:40 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-ee11667b-5a89-4e00-b62a-cb3a1fa8cc6b tempest-SnapshotDependencyTests-714242607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:14:40 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-ee11667b-5a89-4e00-b62a-cb3a1fa8cc6b tempest-SnapshotDependencyTests-714242607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:14:40 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ee11667b-5a89-4e00-b62a-cb3a1fa8cc6b tempest-SnapshotDependencyTests-714242607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:14:40 devstack sudo[107350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:14:40 devstack sudo[107350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:14:40 devstack sudo[107347]: pam_unix(sudo:session): session closed for user root Jul 10 16:14:40 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-101935a6-79e1-4842-9632-7bb4d76d9a2c tempest-ProjectMemberTests-968602289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-8f97fd8f-ba69-4286-bbe8-aa3d0789e6d8" returned: 0 in 0.847s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:14:40 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-101935a6-79e1-4842-9632-7bb4d76d9a2c tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-8f97fd8f-ba69-4286-bbe8-aa3d0789e6d8.034556bd-88e9-41ea-a182-aca648fecd0c {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:14:40 devstack sudo[107355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-8f97fd8f-ba69-4286-bbe8-aa3d0789e6d8.034556bd-88e9-41ea-a182-aca648fecd0c Jul 10 16:14:40 devstack sudo[107355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:14:41 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-73662798-b0b5-40f9-9ade-8c2ced640582 tempest-SnapshotDependencyTests-714242607 None] Acquiring lock "cinder-fb360524-d346-438d-9364-12c5d13e3737-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:14:41 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-73662798-b0b5-40f9-9ade-8c2ced640582 tempest-SnapshotDependencyTests-714242607 None] Lock "cinder-fb360524-d346-438d-9364-12c5d13e3737-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:14:41 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-73662798-b0b5-40f9-9ade-8c2ced640582 tempest-SnapshotDependencyTests-714242607 None] Acquiring lock "cinder-quobyte-fb360524-d346-438d-9364-12c5d13e3737" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:14:41 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-73662798-b0b5-40f9-9ade-8c2ced640582 tempest-SnapshotDependencyTests-714242607 None] Lock "cinder-quobyte-fb360524-d346-438d-9364-12c5d13e3737" acquired by "delete_volume" :: waited 0.024s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:14:41 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ff376bf-283e-4fae-96e1-899ab30e9f46]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:14:41 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-73662798-b0b5-40f9-9ade-8c2ced640582 tempest-SnapshotDependencyTests-714242607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-fb360524-d346-438d-9364-12c5d13e3737 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:14:41 devstack sudo[107350]: pam_unix(sudo:session): session closed for user root Jul 10 16:14:41 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-ee11667b-5a89-4e00-b62a-cb3a1fa8cc6b tempest-SnapshotDependencyTests-714242607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.705s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:14:41 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-ee11667b-5a89-4e00-b62a-cb3a1fa8cc6b tempest-SnapshotDependencyTests-714242607 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:14:41 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-ee11667b-5a89-4e00-b62a-cb3a1fa8cc6b tempest-SnapshotDependencyTests-714242607 None] Deleted volume successfully. Jul 10 16:14:41 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-ee11667b-5a89-4e00-b62a-cb3a1fa8cc6b tempest-SnapshotDependencyTests-714242607 None] Lock "cinder-01dc0444-2789-4283-92f7-d151cc6ba14e-delete_volume" released by "delete_volume" :: held 2.465s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:14:41 devstack sudo[107372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-fb360524-d346-438d-9364-12c5d13e3737 Jul 10 16:14:41 devstack sudo[107372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:14:41 devstack sudo[107355]: pam_unix(sudo:session): session closed for user root Jul 10 16:14:41 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-101935a6-79e1-4842-9632-7bb4d76d9a2c tempest-ProjectMemberTests-968602289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-8f97fd8f-ba69-4286-bbe8-aa3d0789e6d8.034556bd-88e9-41ea-a182-aca648fecd0c" returned: 0 in 0.843s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:14:41 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-101935a6-79e1-4842-9632-7bb4d76d9a2c tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-8f97fd8f-ba69-4286-bbe8-aa3d0789e6d8.034556bd-88e9-41ea-a182-aca648fecd0c {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:14:41 devstack sudo[107400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-8f97fd8f-ba69-4286-bbe8-aa3d0789e6d8.034556bd-88e9-41ea-a182-aca648fecd0c Jul 10 16:14:41 devstack sudo[107400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:14:42 devstack sudo[107372]: pam_unix(sudo:session): session closed for user root Jul 10 16:14:42 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-73662798-b0b5-40f9-9ade-8c2ced640582 tempest-SnapshotDependencyTests-714242607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-fb360524-d346-438d-9364-12c5d13e3737" returned: 0 in 0.832s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:14:42 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-73662798-b0b5-40f9-9ade-8c2ced640582 tempest-SnapshotDependencyTests-714242607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-fb360524-d346-438d-9364-12c5d13e3737 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:14:42 devstack sudo[107405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-fb360524-d346-438d-9364-12c5d13e3737 Jul 10 16:14:42 devstack sudo[107405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:14:42 devstack sudo[107400]: pam_unix(sudo:session): session closed for user root Jul 10 16:14:42 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-101935a6-79e1-4842-9632-7bb4d76d9a2c tempest-ProjectMemberTests-968602289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-8f97fd8f-ba69-4286-bbe8-aa3d0789e6d8.034556bd-88e9-41ea-a182-aca648fecd0c" returned: 0 in 0.647s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:14:42 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-101935a6-79e1-4842-9632-7bb4d76d9a2c tempest-ProjectMemberTests-968602289 None] Lock "cinder-quobyte-034556bd-88e9-41ea-a182-aca648fecd0c" released by "_delete_snapshot" :: held 3.243s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:14:42 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-101935a6-79e1-4842-9632-7bb4d76d9a2c tempest-ProjectMemberTests-968602289 None] Lock "cinder-quobyte-8f97fd8f-ba69-4286-bbe8-aa3d0789e6d8" released by "delete_snapshot" :: held 3.270s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:14:42 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-101935a6-79e1-4842-9632-7bb4d76d9a2c tempest-ProjectMemberTests-968602289 None] Created reservations ['e7a83911-2c74-4ffe-97d8-3b2d52a283c9', '7bc99dc6-0727-436b-8d1b-7a41d0f59f34', '057d97d8-e688-42d8-ac9c-776d6b0b885b', 'a3c9e18b-f686-4c82-95b4-08903eda9e21'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:14:42 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-101935a6-79e1-4842-9632-7bb4d76d9a2c tempest-ProjectMemberTests-968602289 None] Delete snapshot completed successfully. Jul 10 16:14:42 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-101935a6-79e1-4842-9632-7bb4d76d9a2c tempest-ProjectMemberTests-968602289 None] Lock "cinder-034556bd-88e9-41ea-a182-aca648fecd0c-delete_snapshot" released by "delete_snapshot" :: held 3.420s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:14:42 devstack sudo[107405]: pam_unix(sudo:session): session closed for user root Jul 10 16:14:42 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-73662798-b0b5-40f9-9ade-8c2ced640582 tempest-SnapshotDependencyTests-714242607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-fb360524-d346-438d-9364-12c5d13e3737" returned: 0 in 0.678s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:14:42 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-73662798-b0b5-40f9-9ade-8c2ced640582 tempest-SnapshotDependencyTests-714242607 None] Lock "cinder-quobyte-fb360524-d346-438d-9364-12c5d13e3737" released by "delete_volume" :: held 1.561s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:14:42 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-73662798-b0b5-40f9-9ade-8c2ced640582 tempest-SnapshotDependencyTests-714242607 None] Created reservations ['44607e0e-abd5-410f-9f08-cbce7156e124', '24695f50-3147-47cc-b7f9-17cd3d9be318', '8b220795-1305-4a56-b151-329e1a0b5f7e', '1cc0bfa4-44fe-47f0-870a-b894c78feb14'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:14:42 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-73662798-b0b5-40f9-9ade-8c2ced640582 tempest-SnapshotDependencyTests-714242607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:14:42 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-73662798-b0b5-40f9-9ade-8c2ced640582 tempest-SnapshotDependencyTests-714242607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:14:42 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-73662798-b0b5-40f9-9ade-8c2ced640582 tempest-SnapshotDependencyTests-714242607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:14:42 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-73662798-b0b5-40f9-9ade-8c2ced640582 tempest-SnapshotDependencyTests-714242607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:14:42 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-73662798-b0b5-40f9-9ade-8c2ced640582 tempest-SnapshotDependencyTests-714242607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:14:42 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-73662798-b0b5-40f9-9ade-8c2ced640582 tempest-SnapshotDependencyTests-714242607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:14:42 devstack sudo[107409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:14:42 devstack sudo[107409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:14:43 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-94dff384-3d71-40ab-aa61-68596ba44fd2 tempest-ProjectMemberTests-968602289 None] Acquiring lock "cinder-8f97fd8f-ba69-4286-bbe8-aa3d0789e6d8-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:14:43 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-94dff384-3d71-40ab-aa61-68596ba44fd2 tempest-ProjectMemberTests-968602289 None] Lock "cinder-8f97fd8f-ba69-4286-bbe8-aa3d0789e6d8-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:14:43 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-94dff384-3d71-40ab-aa61-68596ba44fd2 tempest-ProjectMemberTests-968602289 None] Acquiring lock "cinder-quobyte-8f97fd8f-ba69-4286-bbe8-aa3d0789e6d8" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:14:43 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-94dff384-3d71-40ab-aa61-68596ba44fd2 tempest-ProjectMemberTests-968602289 None] Lock "cinder-quobyte-8f97fd8f-ba69-4286-bbe8-aa3d0789e6d8" acquired by "delete_volume" :: waited 0.017s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:14:43 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[40bf5c01-432f-4c44-a83a-56fcf278ffbb]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:14:43 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-94dff384-3d71-40ab-aa61-68596ba44fd2 tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-8f97fd8f-ba69-4286-bbe8-aa3d0789e6d8 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:14:43 devstack sudo[107409]: pam_unix(sudo:session): session closed for user root Jul 10 16:14:43 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-73662798-b0b5-40f9-9ade-8c2ced640582 tempest-SnapshotDependencyTests-714242607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.652s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:14:43 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-73662798-b0b5-40f9-9ade-8c2ced640582 tempest-SnapshotDependencyTests-714242607 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:14:43 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-73662798-b0b5-40f9-9ade-8c2ced640582 tempest-SnapshotDependencyTests-714242607 None] Deleted volume successfully. Jul 10 16:14:43 devstack sudo[107412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-8f97fd8f-ba69-4286-bbe8-aa3d0789e6d8 Jul 10 16:14:43 devstack sudo[107412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:14:43 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-73662798-b0b5-40f9-9ade-8c2ced640582 tempest-SnapshotDependencyTests-714242607 None] Lock "cinder-fb360524-d346-438d-9364-12c5d13e3737-delete_volume" released by "delete_volume" :: held 2.435s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:14:44 devstack sudo[107412]: pam_unix(sudo:session): session closed for user root Jul 10 16:14:44 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-94dff384-3d71-40ab-aa61-68596ba44fd2 tempest-ProjectMemberTests-968602289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-8f97fd8f-ba69-4286-bbe8-aa3d0789e6d8" returned: 0 in 0.801s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:14:44 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-94dff384-3d71-40ab-aa61-68596ba44fd2 tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-8f97fd8f-ba69-4286-bbe8-aa3d0789e6d8 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:14:44 devstack sudo[107418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-8f97fd8f-ba69-4286-bbe8-aa3d0789e6d8 Jul 10 16:14:44 devstack sudo[107418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:14:44 devstack sudo[107418]: pam_unix(sudo:session): session closed for user root Jul 10 16:14:44 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-94dff384-3d71-40ab-aa61-68596ba44fd2 tempest-ProjectMemberTests-968602289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-8f97fd8f-ba69-4286-bbe8-aa3d0789e6d8" returned: 0 in 0.635s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:14:44 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-94dff384-3d71-40ab-aa61-68596ba44fd2 tempest-ProjectMemberTests-968602289 None] Lock "cinder-quobyte-8f97fd8f-ba69-4286-bbe8-aa3d0789e6d8" released by "delete_volume" :: held 1.513s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:14:44 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-94dff384-3d71-40ab-aa61-68596ba44fd2 tempest-ProjectMemberTests-968602289 None] Created reservations ['e08b8ee3-e811-4599-b281-126fabfefbce', '14092b6a-a884-409a-a2e5-c22623bcc11f', '3c0c4792-ce62-420a-91ef-79f450d9cecd', '082ee4bc-1e8b-4241-9c2d-779cc50782e6'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:14:45 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-94dff384-3d71-40ab-aa61-68596ba44fd2 tempest-ProjectMemberTests-968602289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:14:45 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-94dff384-3d71-40ab-aa61-68596ba44fd2 tempest-ProjectMemberTests-968602289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:14:45 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-94dff384-3d71-40ab-aa61-68596ba44fd2 tempest-ProjectMemberTests-968602289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:14:45 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-94dff384-3d71-40ab-aa61-68596ba44fd2 tempest-ProjectMemberTests-968602289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:14:45 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-94dff384-3d71-40ab-aa61-68596ba44fd2 tempest-ProjectMemberTests-968602289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:14:45 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-94dff384-3d71-40ab-aa61-68596ba44fd2 tempest-ProjectMemberTests-968602289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:14:45 devstack sudo[107421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:14:45 devstack sudo[107421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:14:45 devstack sudo[107421]: pam_unix(sudo:session): session closed for user root Jul 10 16:14:45 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-94dff384-3d71-40ab-aa61-68596ba44fd2 tempest-ProjectMemberTests-968602289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.688s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:14:45 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-94dff384-3d71-40ab-aa61-68596ba44fd2 tempest-ProjectMemberTests-968602289 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:14:45 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-94dff384-3d71-40ab-aa61-68596ba44fd2 tempest-ProjectMemberTests-968602289 None] Deleted volume successfully. Jul 10 16:14:45 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-94dff384-3d71-40ab-aa61-68596ba44fd2 tempest-ProjectMemberTests-968602289 None] Lock "cinder-8f97fd8f-ba69-4286-bbe8-aa3d0789e6d8-delete_volume" released by "delete_volume" :: held 2.432s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:14:58 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7147107-62a7-41c7-b08b-5f0720d6a2a9 tempest-ProjectReaderTests-1463393059 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 16:14:58 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-a7147107-62a7-41c7-b08b-5f0720d6a2a9 tempest-ProjectReaderTests-1463393059 None] Flow 'volume_create_manager' (90f495c9-7b15-42e2-a050-027bd15d011f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:14:58 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-a7147107-62a7-41c7-b08b-5f0720d6a2a9 tempest-ProjectReaderTests-1463393059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d21dcd16-1110-4ae4-ac0b-2e09ba4d3d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:14:58 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-a7147107-62a7-41c7-b08b-5f0720d6a2a9 tempest-ProjectReaderTests-1463393059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d21dcd16-1110-4ae4-ac0b-2e09ba4d3d91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:14:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-352249657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0283650b-9603-474b-94e0-b71f2ef629ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='859fb0ede66a4a46b93062af4307a185',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:14:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:14:58Z,use_quota=True,user_id='e3cb8331667c47529f0281802934e65f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:14:58 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-a7147107-62a7-41c7-b08b-5f0720d6a2a9 tempest-ProjectReaderTests-1463393059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb2d64af-6fcc-4da1-b252-c61f95a451c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:14:58 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-a7147107-62a7-41c7-b08b-5f0720d6a2a9 tempest-ProjectReaderTests-1463393059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb2d64af-6fcc-4da1-b252-c61f95a451c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:14:58 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-a7147107-62a7-41c7-b08b-5f0720d6a2a9 tempest-ProjectReaderTests-1463393059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59033afd-9949-4259-b6cd-8593a57e3195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:14:58 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-a7147107-62a7-41c7-b08b-5f0720d6a2a9 tempest-ProjectReaderTests-1463393059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59033afd-9949-4259-b6cd-8593a57e3195) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0283650b-9603-474b-94e0-b71f2ef629ec', 'volume_name': 'volume-0283650b-9603-474b-94e0-b71f2ef629ec', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:14:58 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-a7147107-62a7-41c7-b08b-5f0720d6a2a9 tempest-ProjectReaderTests-1463393059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (680568dc-7e0a-45d2-9717-56b74572fd84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:14:58 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-a7147107-62a7-41c7-b08b-5f0720d6a2a9 tempest-ProjectReaderTests-1463393059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (680568dc-7e0a-45d2-9717-56b74572fd84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:14:58 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-a7147107-62a7-41c7-b08b-5f0720d6a2a9 tempest-ProjectReaderTests-1463393059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87218320-e0ec-4365-b5e9-c52dc7ed7ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:14:58 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-a7147107-62a7-41c7-b08b-5f0720d6a2a9 tempest-ProjectReaderTests-1463393059 None] Volume 0283650b-9603-474b-94e0-b71f2ef629ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0283650b-9603-474b-94e0-b71f2ef629ec', 'volume_size': 1} Jul 10 16:14:58 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-a7147107-62a7-41c7-b08b-5f0720d6a2a9 tempest-ProjectReaderTests-1463393059 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:14:58 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-a7147107-62a7-41c7-b08b-5f0720d6a2a9 tempest-ProjectReaderTests-1463393059 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:14:58 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-a7147107-62a7-41c7-b08b-5f0720d6a2a9 tempest-ProjectReaderTests-1463393059 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:14:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-352249657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0283650b-9603-474b-94e0-b71f2ef629ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='859fb0ede66a4a46b93062af4307a185',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:14:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:14:58Z,use_quota=True,user_id='e3cb8331667c47529f0281802934e65f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 16:14:58 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-a7147107-62a7-41c7-b08b-5f0720d6a2a9 tempest-ProjectReaderTests-1463393059 None] Creating volume 0283650b-9603-474b-94e0-b71f2ef629ec {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 16:14:58 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-a7147107-62a7-41c7-b08b-5f0720d6a2a9 tempest-ProjectReaderTests-1463393059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:14:58 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-a7147107-62a7-41c7-b08b-5f0720d6a2a9 tempest-ProjectReaderTests-1463393059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:14:58 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-a7147107-62a7-41c7-b08b-5f0720d6a2a9 tempest-ProjectReaderTests-1463393059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:14:58 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-a7147107-62a7-41c7-b08b-5f0720d6a2a9 tempest-ProjectReaderTests-1463393059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:14:58 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-a7147107-62a7-41c7-b08b-5f0720d6a2a9 tempest-ProjectReaderTests-1463393059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:14:58 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-a7147107-62a7-41c7-b08b-5f0720d6a2a9 tempest-ProjectReaderTests-1463393059 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 16:14:58 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-a7147107-62a7-41c7-b08b-5f0720d6a2a9 tempest-ProjectReaderTests-1463393059 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 16:14:58 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a7147107-62a7-41c7-b08b-5f0720d6a2a9 tempest-ProjectReaderTests-1463393059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-0283650b-9603-474b-94e0-b71f2ef629ec 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:14:58 devstack sudo[107435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-0283650b-9603-474b-94e0-b71f2ef629ec 1073741824 Jul 10 16:14:58 devstack sudo[107435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:14:58 devstack sudo[107435]: pam_unix(sudo:session): session closed for user root Jul 10 16:14:58 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a7147107-62a7-41c7-b08b-5f0720d6a2a9 tempest-ProjectReaderTests-1463393059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-0283650b-9603-474b-94e0-b71f2ef629ec 1073741824" returned: 0 in 0.806s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:14:58 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a7147107-62a7-41c7-b08b-5f0720d6a2a9 tempest-ProjectReaderTests-1463393059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-0283650b-9603-474b-94e0-b71f2ef629ec {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:14:59 devstack sudo[107441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-0283650b-9603-474b-94e0-b71f2ef629ec Jul 10 16:14:59 devstack sudo[107441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:14:59 devstack sudo[107441]: pam_unix(sudo:session): session closed for user root Jul 10 16:14:59 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-a7147107-62a7-41c7-b08b-5f0720d6a2a9 tempest-ProjectReaderTests-1463393059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-0283650b-9603-474b-94e0-b71f2ef629ec" returned: 0 in 0.630s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:14:59 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-a7147107-62a7-41c7-b08b-5f0720d6a2a9 tempest-ProjectReaderTests-1463393059 None] <== create_volume: return (1483ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 16:14:59 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-a7147107-62a7-41c7-b08b-5f0720d6a2a9 tempest-ProjectReaderTests-1463393059 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.486s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:14:59 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-a7147107-62a7-41c7-b08b-5f0720d6a2a9 tempest-ProjectReaderTests-1463393059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87218320-e0ec-4365-b5e9-c52dc7ed7ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0283650b-9603-474b-94e0-b71f2ef629ec', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:14:59 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-a7147107-62a7-41c7-b08b-5f0720d6a2a9 tempest-ProjectReaderTests-1463393059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (545e909e-8e3b-4822-983c-47c27ad9e6f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:14:59 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-a7147107-62a7-41c7-b08b-5f0720d6a2a9 tempest-ProjectReaderTests-1463393059 None] Volume volume-0283650b-9603-474b-94e0-b71f2ef629ec (0283650b-9603-474b-94e0-b71f2ef629ec): created successfully Jul 10 16:14:59 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-a7147107-62a7-41c7-b08b-5f0720d6a2a9 tempest-ProjectReaderTests-1463393059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (545e909e-8e3b-4822-983c-47c27ad9e6f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:14:59 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-a7147107-62a7-41c7-b08b-5f0720d6a2a9 tempest-ProjectReaderTests-1463393059 None] Flow 'volume_create_manager' (90f495c9-7b15-42e2-a050-027bd15d011f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:14:59 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-a7147107-62a7-41c7-b08b-5f0720d6a2a9 tempest-ProjectReaderTests-1463393059 None] Created volume successfully. Jul 10 16:15:00 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-4ac15f24-ecfb-43a1-b18c-3646b6912a0e tempest-ProjectReaderTests-1463393059 None] Acquiring lock "cinder-0283650b-9603-474b-94e0-b71f2ef629ec-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:15:00 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-4ac15f24-ecfb-43a1-b18c-3646b6912a0e tempest-ProjectReaderTests-1463393059 None] Lock "cinder-0283650b-9603-474b-94e0-b71f2ef629ec-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:15:00 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-4ac15f24-ecfb-43a1-b18c-3646b6912a0e tempest-ProjectReaderTests-1463393059 None] Acquiring lock "cinder-quobyte-0283650b-9603-474b-94e0-b71f2ef629ec" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:15:00 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-4ac15f24-ecfb-43a1-b18c-3646b6912a0e tempest-ProjectReaderTests-1463393059 None] Lock "cinder-quobyte-0283650b-9603-474b-94e0-b71f2ef629ec" acquired by "delete_volume" :: waited 0.014s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:15:00 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[faa9b93c-9a9d-4fde-b416-4ebc06c73c69]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:15:00 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4ac15f24-ecfb-43a1-b18c-3646b6912a0e tempest-ProjectReaderTests-1463393059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-0283650b-9603-474b-94e0-b71f2ef629ec {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:15:00 devstack sudo[107444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-0283650b-9603-474b-94e0-b71f2ef629ec Jul 10 16:15:00 devstack sudo[107444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:15:01 devstack sudo[107444]: pam_unix(sudo:session): session closed for user root Jul 10 16:15:01 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4ac15f24-ecfb-43a1-b18c-3646b6912a0e tempest-ProjectReaderTests-1463393059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-0283650b-9603-474b-94e0-b71f2ef629ec" returned: 0 in 0.762s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:15:01 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4ac15f24-ecfb-43a1-b18c-3646b6912a0e tempest-ProjectReaderTests-1463393059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-0283650b-9603-474b-94e0-b71f2ef629ec {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:15:01 devstack sudo[107449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-0283650b-9603-474b-94e0-b71f2ef629ec Jul 10 16:15:01 devstack sudo[107449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:15:01 devstack sudo[107449]: pam_unix(sudo:session): session closed for user root Jul 10 16:15:01 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4ac15f24-ecfb-43a1-b18c-3646b6912a0e tempest-ProjectReaderTests-1463393059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-0283650b-9603-474b-94e0-b71f2ef629ec" returned: 0 in 0.650s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:15:01 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-4ac15f24-ecfb-43a1-b18c-3646b6912a0e tempest-ProjectReaderTests-1463393059 None] Lock "cinder-quobyte-0283650b-9603-474b-94e0-b71f2ef629ec" released by "delete_volume" :: held 1.456s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:15:01 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-4ac15f24-ecfb-43a1-b18c-3646b6912a0e tempest-ProjectReaderTests-1463393059 None] Created reservations ['24e1ad28-374d-4cfa-a477-62a41310daa3', '02959a14-3d1b-4b56-ac32-2f6a1deacafb', '1144c10d-5b30-4245-af98-c511ce814460', 'e74e2732-1c72-4e71-827e-5640df14bbcd'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:15:01 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-4ac15f24-ecfb-43a1-b18c-3646b6912a0e tempest-ProjectReaderTests-1463393059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:15:01 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-4ac15f24-ecfb-43a1-b18c-3646b6912a0e tempest-ProjectReaderTests-1463393059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:15:01 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-4ac15f24-ecfb-43a1-b18c-3646b6912a0e tempest-ProjectReaderTests-1463393059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:15:01 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-4ac15f24-ecfb-43a1-b18c-3646b6912a0e tempest-ProjectReaderTests-1463393059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:15:01 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-4ac15f24-ecfb-43a1-b18c-3646b6912a0e tempest-ProjectReaderTests-1463393059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:15:01 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4ac15f24-ecfb-43a1-b18c-3646b6912a0e tempest-ProjectReaderTests-1463393059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:15:01 devstack sudo[107452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:15:01 devstack sudo[107452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:15:02 devstack sudo[107452]: pam_unix(sudo:session): session closed for user root Jul 10 16:15:02 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-4ac15f24-ecfb-43a1-b18c-3646b6912a0e tempest-ProjectReaderTests-1463393059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.648s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:15:02 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-4ac15f24-ecfb-43a1-b18c-3646b6912a0e tempest-ProjectReaderTests-1463393059 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:15:02 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-4ac15f24-ecfb-43a1-b18c-3646b6912a0e tempest-ProjectReaderTests-1463393059 None] Deleted volume successfully. Jul 10 16:15:02 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-4ac15f24-ecfb-43a1-b18c-3646b6912a0e tempest-ProjectReaderTests-1463393059 None] Lock "cinder-0283650b-9603-474b-94e0-b71f2ef629ec-delete_volume" released by "delete_volume" :: held 2.300s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:15:02 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0be0ad5-21f4-4cfe-ba0c-5482cca2edbf tempest-ProjectReaderTests-1463393059 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 16:15:02 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b0be0ad5-21f4-4cfe-ba0c-5482cca2edbf tempest-ProjectReaderTests-1463393059 None] Flow 'volume_create_manager' (af10c907-aa83-42ee-90e1-854ca7f39c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:15:02 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b0be0ad5-21f4-4cfe-ba0c-5482cca2edbf tempest-ProjectReaderTests-1463393059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9320468-6940-4243-a54f-3f3fe162ba95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:15:02 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b0be0ad5-21f4-4cfe-ba0c-5482cca2edbf tempest-ProjectReaderTests-1463393059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9320468-6940-4243-a54f-3f3fe162ba95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:15:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-841360821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fef1cffc-7d74-4a72-a422-e39f1ae4961f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='859fb0ede66a4a46b93062af4307a185',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:15:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:15:03Z,use_quota=True,user_id='e3cb8331667c47529f0281802934e65f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:15:02 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b0be0ad5-21f4-4cfe-ba0c-5482cca2edbf tempest-ProjectReaderTests-1463393059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2ce2428-5d07-4b86-90e2-6a8548f4d2b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:15:02 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b0be0ad5-21f4-4cfe-ba0c-5482cca2edbf tempest-ProjectReaderTests-1463393059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2ce2428-5d07-4b86-90e2-6a8548f4d2b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:15:03 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b0be0ad5-21f4-4cfe-ba0c-5482cca2edbf tempest-ProjectReaderTests-1463393059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (215da24e-5145-4cf8-8e6a-91c02a3aa304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:15:03 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b0be0ad5-21f4-4cfe-ba0c-5482cca2edbf tempest-ProjectReaderTests-1463393059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (215da24e-5145-4cf8-8e6a-91c02a3aa304) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fef1cffc-7d74-4a72-a422-e39f1ae4961f', 'volume_name': 'volume-fef1cffc-7d74-4a72-a422-e39f1ae4961f', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:15:03 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b0be0ad5-21f4-4cfe-ba0c-5482cca2edbf tempest-ProjectReaderTests-1463393059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40581a4b-8949-48af-9aba-e597dcb97f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:15:03 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b0be0ad5-21f4-4cfe-ba0c-5482cca2edbf tempest-ProjectReaderTests-1463393059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40581a4b-8949-48af-9aba-e597dcb97f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:15:03 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b0be0ad5-21f4-4cfe-ba0c-5482cca2edbf tempest-ProjectReaderTests-1463393059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3df18e50-1ef3-4ef0-97e8-83e459b8d5ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:15:03 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-b0be0ad5-21f4-4cfe-ba0c-5482cca2edbf tempest-ProjectReaderTests-1463393059 None] Volume fef1cffc-7d74-4a72-a422-e39f1ae4961f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fef1cffc-7d74-4a72-a422-e39f1ae4961f', 'volume_size': 1} Jul 10 16:15:03 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-b0be0ad5-21f4-4cfe-ba0c-5482cca2edbf tempest-ProjectReaderTests-1463393059 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:15:03 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-b0be0ad5-21f4-4cfe-ba0c-5482cca2edbf tempest-ProjectReaderTests-1463393059 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:15:03 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-b0be0ad5-21f4-4cfe-ba0c-5482cca2edbf tempest-ProjectReaderTests-1463393059 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:15:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-841360821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fef1cffc-7d74-4a72-a422-e39f1ae4961f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='859fb0ede66a4a46b93062af4307a185',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:15:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:15:03Z,use_quota=True,user_id='e3cb8331667c47529f0281802934e65f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 16:15:03 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-b0be0ad5-21f4-4cfe-ba0c-5482cca2edbf tempest-ProjectReaderTests-1463393059 None] Creating volume fef1cffc-7d74-4a72-a422-e39f1ae4961f {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 16:15:03 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-b0be0ad5-21f4-4cfe-ba0c-5482cca2edbf tempest-ProjectReaderTests-1463393059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:15:03 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-b0be0ad5-21f4-4cfe-ba0c-5482cca2edbf tempest-ProjectReaderTests-1463393059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:15:03 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-b0be0ad5-21f4-4cfe-ba0c-5482cca2edbf tempest-ProjectReaderTests-1463393059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:15:03 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-b0be0ad5-21f4-4cfe-ba0c-5482cca2edbf tempest-ProjectReaderTests-1463393059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:15:03 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-b0be0ad5-21f4-4cfe-ba0c-5482cca2edbf tempest-ProjectReaderTests-1463393059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:15:03 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-b0be0ad5-21f4-4cfe-ba0c-5482cca2edbf tempest-ProjectReaderTests-1463393059 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 16:15:03 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-b0be0ad5-21f4-4cfe-ba0c-5482cca2edbf tempest-ProjectReaderTests-1463393059 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 16:15:03 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-b0be0ad5-21f4-4cfe-ba0c-5482cca2edbf tempest-ProjectReaderTests-1463393059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-fef1cffc-7d74-4a72-a422-e39f1ae4961f 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:15:03 devstack sudo[107458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-fef1cffc-7d74-4a72-a422-e39f1ae4961f 1073741824 Jul 10 16:15:03 devstack sudo[107458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:15:03 devstack sudo[107458]: pam_unix(sudo:session): session closed for user root Jul 10 16:15:03 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-b0be0ad5-21f4-4cfe-ba0c-5482cca2edbf tempest-ProjectReaderTests-1463393059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-fef1cffc-7d74-4a72-a422-e39f1ae4961f 1073741824" returned: 0 in 0.783s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:15:03 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-b0be0ad5-21f4-4cfe-ba0c-5482cca2edbf tempest-ProjectReaderTests-1463393059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-fef1cffc-7d74-4a72-a422-e39f1ae4961f {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:15:03 devstack sudo[107464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-fef1cffc-7d74-4a72-a422-e39f1ae4961f Jul 10 16:15:03 devstack sudo[107464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:15:04 devstack sudo[107464]: pam_unix(sudo:session): session closed for user root Jul 10 16:15:04 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-b0be0ad5-21f4-4cfe-ba0c-5482cca2edbf tempest-ProjectReaderTests-1463393059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-fef1cffc-7d74-4a72-a422-e39f1ae4961f" returned: 0 in 0.629s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:15:04 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-b0be0ad5-21f4-4cfe-ba0c-5482cca2edbf tempest-ProjectReaderTests-1463393059 None] <== create_volume: return (1458ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 16:15:04 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-b0be0ad5-21f4-4cfe-ba0c-5482cca2edbf tempest-ProjectReaderTests-1463393059 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.461s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:15:04 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b0be0ad5-21f4-4cfe-ba0c-5482cca2edbf tempest-ProjectReaderTests-1463393059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3df18e50-1ef3-4ef0-97e8-83e459b8d5ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fef1cffc-7d74-4a72-a422-e39f1ae4961f', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:15:04 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b0be0ad5-21f4-4cfe-ba0c-5482cca2edbf tempest-ProjectReaderTests-1463393059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (960a1893-3138-40b6-96c1-acb1c70f8146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:15:04 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-b0be0ad5-21f4-4cfe-ba0c-5482cca2edbf tempest-ProjectReaderTests-1463393059 None] Volume volume-fef1cffc-7d74-4a72-a422-e39f1ae4961f (fef1cffc-7d74-4a72-a422-e39f1ae4961f): created successfully Jul 10 16:15:04 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b0be0ad5-21f4-4cfe-ba0c-5482cca2edbf tempest-ProjectReaderTests-1463393059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (960a1893-3138-40b6-96c1-acb1c70f8146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:15:04 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-b0be0ad5-21f4-4cfe-ba0c-5482cca2edbf tempest-ProjectReaderTests-1463393059 None] Flow 'volume_create_manager' (af10c907-aa83-42ee-90e1-854ca7f39c6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:15:04 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-b0be0ad5-21f4-4cfe-ba0c-5482cca2edbf tempest-ProjectReaderTests-1463393059 None] Created volume successfully. Jul 10 16:15:05 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-e7b8681f-4536-4ef2-a93c-8defb523e26c tempest-ProjectReaderTests-1463393059 None] Acquiring lock "cinder-fef1cffc-7d74-4a72-a422-e39f1ae4961f-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:15:05 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-e7b8681f-4536-4ef2-a93c-8defb523e26c tempest-ProjectReaderTests-1463393059 None] Lock "cinder-fef1cffc-7d74-4a72-a422-e39f1ae4961f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:15:05 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-e7b8681f-4536-4ef2-a93c-8defb523e26c tempest-ProjectReaderTests-1463393059 None] Acquiring lock "cinder-quobyte-fef1cffc-7d74-4a72-a422-e39f1ae4961f" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:15:05 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-e7b8681f-4536-4ef2-a93c-8defb523e26c tempest-ProjectReaderTests-1463393059 None] Lock "cinder-quobyte-fef1cffc-7d74-4a72-a422-e39f1ae4961f" acquired by "delete_volume" :: waited 0.017s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:15:05 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f443e8-2967-410f-8133-56de46f04b93]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:15:05 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-e7b8681f-4536-4ef2-a93c-8defb523e26c tempest-ProjectReaderTests-1463393059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-fef1cffc-7d74-4a72-a422-e39f1ae4961f {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:15:05 devstack sudo[107468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-fef1cffc-7d74-4a72-a422-e39f1ae4961f Jul 10 16:15:05 devstack sudo[107468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:15:05 devstack sudo[107468]: pam_unix(sudo:session): session closed for user root Jul 10 16:15:05 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-e7b8681f-4536-4ef2-a93c-8defb523e26c tempest-ProjectReaderTests-1463393059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-fef1cffc-7d74-4a72-a422-e39f1ae4961f" returned: 0 in 0.732s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:15:05 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-e7b8681f-4536-4ef2-a93c-8defb523e26c tempest-ProjectReaderTests-1463393059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-fef1cffc-7d74-4a72-a422-e39f1ae4961f {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:15:05 devstack sudo[107473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-fef1cffc-7d74-4a72-a422-e39f1ae4961f Jul 10 16:15:05 devstack sudo[107473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:15:06 devstack sudo[107473]: pam_unix(sudo:session): session closed for user root Jul 10 16:15:06 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-e7b8681f-4536-4ef2-a93c-8defb523e26c tempest-ProjectReaderTests-1463393059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-fef1cffc-7d74-4a72-a422-e39f1ae4961f" returned: 0 in 0.639s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:15:06 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-e7b8681f-4536-4ef2-a93c-8defb523e26c tempest-ProjectReaderTests-1463393059 None] Lock "cinder-quobyte-fef1cffc-7d74-4a72-a422-e39f1ae4961f" released by "delete_volume" :: held 1.409s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:15:06 devstack cinder-volume[87420]: DEBUG dbcounter [-] [87420] Writing DB stats cinder:SELECT=66,cinder:INSERT=25,cinder:UPDATE=85,cinder:DELETE=8 {{(pid=87420) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 16:15:06 devstack cinder-volume[87420]: DEBUG dbcounter [-] [87420] Writing DB stats cinder:UPDATE=88,cinder:SELECT=66,cinder:DELETE=7,cinder:INSERT=19 {{(pid=87420) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 16:15:06 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-e7b8681f-4536-4ef2-a93c-8defb523e26c tempest-ProjectReaderTests-1463393059 None] Created reservations ['92f98873-4d1b-4b22-abe6-facb9b8547ed', '3c6a13cb-e33a-4c47-9194-c7a37defb5ef', 'ed3bdd89-9bb4-4c71-a659-162349f1d89c', '970d57dd-0e5e-4b19-b44a-0dde9cbc0d03'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:15:06 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-e7b8681f-4536-4ef2-a93c-8defb523e26c tempest-ProjectReaderTests-1463393059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:15:06 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-e7b8681f-4536-4ef2-a93c-8defb523e26c tempest-ProjectReaderTests-1463393059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:15:06 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-e7b8681f-4536-4ef2-a93c-8defb523e26c tempest-ProjectReaderTests-1463393059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:15:06 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-e7b8681f-4536-4ef2-a93c-8defb523e26c tempest-ProjectReaderTests-1463393059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:15:06 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-e7b8681f-4536-4ef2-a93c-8defb523e26c tempest-ProjectReaderTests-1463393059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:15:06 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-e7b8681f-4536-4ef2-a93c-8defb523e26c tempest-ProjectReaderTests-1463393059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:15:06 devstack sudo[107477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:15:06 devstack sudo[107477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:15:07 devstack sudo[107477]: pam_unix(sudo:session): session closed for user root Jul 10 16:15:07 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-e7b8681f-4536-4ef2-a93c-8defb523e26c tempest-ProjectReaderTests-1463393059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.658s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:15:07 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-e7b8681f-4536-4ef2-a93c-8defb523e26c tempest-ProjectReaderTests-1463393059 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:15:07 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-e7b8681f-4536-4ef2-a93c-8defb523e26c tempest-ProjectReaderTests-1463393059 None] Deleted volume successfully. Jul 10 16:15:07 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-e7b8681f-4536-4ef2-a93c-8defb523e26c tempest-ProjectReaderTests-1463393059 None] Lock "cinder-fef1cffc-7d74-4a72-a422-e39f1ae4961f-delete_volume" released by "delete_volume" :: held 2.273s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:15:15 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5c10991-1271-4484-8526-1e70fe2a9cf5 tempest-ProjectReaderTests-100751771 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 16:15:15 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d5c10991-1271-4484-8526-1e70fe2a9cf5 tempest-ProjectReaderTests-100751771 None] Flow 'volume_create_manager' (2c006e68-396d-492c-820f-08053bcc6558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:15:15 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d5c10991-1271-4484-8526-1e70fe2a9cf5 tempest-ProjectReaderTests-100751771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (239a50fd-6b2b-498d-b339-d4bd7dd63eb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:15:15 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d5c10991-1271-4484-8526-1e70fe2a9cf5 tempest-ProjectReaderTests-100751771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (239a50fd-6b2b-498d-b339-d4bd7dd63eb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:15:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1081407965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edfacd23-e2ce-423a-9cbc-1aea49907219,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a1d8b19e5794ce8a732d6d9b460c4b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:15:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:15:15Z,use_quota=True,user_id='d71c884179bb403db7c010bff6f5dc25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:15:15 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d5c10991-1271-4484-8526-1e70fe2a9cf5 tempest-ProjectReaderTests-100751771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd2825d5-b444-4a6e-a861-43ec1da37244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:15:15 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d5c10991-1271-4484-8526-1e70fe2a9cf5 tempest-ProjectReaderTests-100751771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd2825d5-b444-4a6e-a861-43ec1da37244) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:15:15 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d5c10991-1271-4484-8526-1e70fe2a9cf5 tempest-ProjectReaderTests-100751771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bed1f39-78ef-4dda-882a-32dee8132e84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:15:15 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d5c10991-1271-4484-8526-1e70fe2a9cf5 tempest-ProjectReaderTests-100751771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bed1f39-78ef-4dda-882a-32dee8132e84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'edfacd23-e2ce-423a-9cbc-1aea49907219', 'volume_name': 'volume-edfacd23-e2ce-423a-9cbc-1aea49907219', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:15:15 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d5c10991-1271-4484-8526-1e70fe2a9cf5 tempest-ProjectReaderTests-100751771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e992922-37f1-4db5-9f84-09594cd26eb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:15:15 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d5c10991-1271-4484-8526-1e70fe2a9cf5 tempest-ProjectReaderTests-100751771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e992922-37f1-4db5-9f84-09594cd26eb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:15:15 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d5c10991-1271-4484-8526-1e70fe2a9cf5 tempest-ProjectReaderTests-100751771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2220c2bc-d7f9-40a2-b8c3-f407e6399312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:15:15 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-d5c10991-1271-4484-8526-1e70fe2a9cf5 tempest-ProjectReaderTests-100751771 None] Volume edfacd23-e2ce-423a-9cbc-1aea49907219: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-edfacd23-e2ce-423a-9cbc-1aea49907219', 'volume_size': 1} Jul 10 16:15:15 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-d5c10991-1271-4484-8526-1e70fe2a9cf5 tempest-ProjectReaderTests-100751771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:15:15 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-d5c10991-1271-4484-8526-1e70fe2a9cf5 tempest-ProjectReaderTests-100751771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:15:15 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-d5c10991-1271-4484-8526-1e70fe2a9cf5 tempest-ProjectReaderTests-100751771 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:15:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1081407965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edfacd23-e2ce-423a-9cbc-1aea49907219,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a1d8b19e5794ce8a732d6d9b460c4b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:15:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:15:15Z,use_quota=True,user_id='d71c884179bb403db7c010bff6f5dc25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 16:15:15 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-d5c10991-1271-4484-8526-1e70fe2a9cf5 tempest-ProjectReaderTests-100751771 None] Creating volume edfacd23-e2ce-423a-9cbc-1aea49907219 {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 16:15:15 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-d5c10991-1271-4484-8526-1e70fe2a9cf5 tempest-ProjectReaderTests-100751771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:15:15 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-d5c10991-1271-4484-8526-1e70fe2a9cf5 tempest-ProjectReaderTests-100751771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:15:15 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-d5c10991-1271-4484-8526-1e70fe2a9cf5 tempest-ProjectReaderTests-100751771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:15:15 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-d5c10991-1271-4484-8526-1e70fe2a9cf5 tempest-ProjectReaderTests-100751771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:15:15 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-d5c10991-1271-4484-8526-1e70fe2a9cf5 tempest-ProjectReaderTests-100751771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:15:15 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-d5c10991-1271-4484-8526-1e70fe2a9cf5 tempest-ProjectReaderTests-100751771 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 16:15:15 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-d5c10991-1271-4484-8526-1e70fe2a9cf5 tempest-ProjectReaderTests-100751771 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 16:15:15 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d5c10991-1271-4484-8526-1e70fe2a9cf5 tempest-ProjectReaderTests-100751771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-edfacd23-e2ce-423a-9cbc-1aea49907219 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:15:15 devstack sudo[107485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-edfacd23-e2ce-423a-9cbc-1aea49907219 1073741824 Jul 10 16:15:15 devstack sudo[107485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:15:16 devstack sudo[107485]: pam_unix(sudo:session): session closed for user root Jul 10 16:15:16 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d5c10991-1271-4484-8526-1e70fe2a9cf5 tempest-ProjectReaderTests-100751771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-edfacd23-e2ce-423a-9cbc-1aea49907219 1073741824" returned: 0 in 0.810s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:15:16 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d5c10991-1271-4484-8526-1e70fe2a9cf5 tempest-ProjectReaderTests-100751771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-edfacd23-e2ce-423a-9cbc-1aea49907219 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:15:16 devstack sudo[107491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-edfacd23-e2ce-423a-9cbc-1aea49907219 Jul 10 16:15:16 devstack sudo[107491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:15:16 devstack sudo[107491]: pam_unix(sudo:session): session closed for user root Jul 10 16:15:16 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-d5c10991-1271-4484-8526-1e70fe2a9cf5 tempest-ProjectReaderTests-100751771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-edfacd23-e2ce-423a-9cbc-1aea49907219" returned: 0 in 0.660s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:15:16 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-d5c10991-1271-4484-8526-1e70fe2a9cf5 tempest-ProjectReaderTests-100751771 None] <== create_volume: return (1515ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 16:15:16 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-d5c10991-1271-4484-8526-1e70fe2a9cf5 tempest-ProjectReaderTests-100751771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.518s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:15:16 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d5c10991-1271-4484-8526-1e70fe2a9cf5 tempest-ProjectReaderTests-100751771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2220c2bc-d7f9-40a2-b8c3-f407e6399312) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edfacd23-e2ce-423a-9cbc-1aea49907219', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:15:16 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d5c10991-1271-4484-8526-1e70fe2a9cf5 tempest-ProjectReaderTests-100751771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38c4733a-b746-4f97-a392-40681e6c8c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:15:16 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-d5c10991-1271-4484-8526-1e70fe2a9cf5 tempest-ProjectReaderTests-100751771 None] Volume volume-edfacd23-e2ce-423a-9cbc-1aea49907219 (edfacd23-e2ce-423a-9cbc-1aea49907219): created successfully Jul 10 16:15:16 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d5c10991-1271-4484-8526-1e70fe2a9cf5 tempest-ProjectReaderTests-100751771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38c4733a-b746-4f97-a392-40681e6c8c8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:15:16 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-d5c10991-1271-4484-8526-1e70fe2a9cf5 tempest-ProjectReaderTests-100751771 None] Flow 'volume_create_manager' (2c006e68-396d-492c-820f-08053bcc6558) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:15:16 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-d5c10991-1271-4484-8526-1e70fe2a9cf5 tempest-ProjectReaderTests-100751771 None] Created volume successfully. Jul 10 16:15:17 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-27b60449-0758-4b0d-aec4-4e2fd0d7e98f tempest-ProjectReaderTests-100751771 None] Acquiring lock "cinder-edfacd23-e2ce-423a-9cbc-1aea49907219-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:15:17 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-27b60449-0758-4b0d-aec4-4e2fd0d7e98f tempest-ProjectReaderTests-100751771 None] Lock "cinder-edfacd23-e2ce-423a-9cbc-1aea49907219-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:15:17 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-27b60449-0758-4b0d-aec4-4e2fd0d7e98f tempest-ProjectReaderTests-100751771 None] Acquiring lock "cinder-quobyte-edfacd23-e2ce-423a-9cbc-1aea49907219" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:15:17 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-27b60449-0758-4b0d-aec4-4e2fd0d7e98f tempest-ProjectReaderTests-100751771 None] Lock "cinder-quobyte-edfacd23-e2ce-423a-9cbc-1aea49907219" acquired by "delete_volume" :: waited 0.014s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:15:17 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[be9a5ebd-1f02-4ef7-9cc5-024e4883cc8e]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:15:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-27b60449-0758-4b0d-aec4-4e2fd0d7e98f tempest-ProjectReaderTests-100751771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-edfacd23-e2ce-423a-9cbc-1aea49907219 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:15:17 devstack cinder-volume[87420]: DEBUG oslo_service.periodic_task [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87420) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 16:15:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:15:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:15:17 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:15:17 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:15:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:15:17 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:15:17 devstack sudo[107495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:15:17 devstack sudo[107495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:15:17 devstack sudo[107494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-edfacd23-e2ce-423a-9cbc-1aea49907219 Jul 10 16:15:17 devstack sudo[107494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:15:18 devstack sudo[107495]: pam_unix(sudo:session): session closed for user root Jul 10 16:15:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.653s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:15:18 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:15:18 devstack cinder-volume[87420]: DEBUG oslo_service.periodic_task [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] Running periodic task VolumeManager._thread_info {{(pid=87420) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 16:15:18 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] thread count: 29 {{(pid=87420) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 16:15:18 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-455bd79a-5746-4ca5-a328-355979282c01 None None] thread info: [<_MainThread(MainThread, started 133639250378880)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87420) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 16:15:18 devstack sudo[107494]: pam_unix(sudo:session): session closed for user root Jul 10 16:15:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-27b60449-0758-4b0d-aec4-4e2fd0d7e98f tempest-ProjectReaderTests-100751771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-edfacd23-e2ce-423a-9cbc-1aea49907219" returned: 0 in 0.790s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:15:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-27b60449-0758-4b0d-aec4-4e2fd0d7e98f tempest-ProjectReaderTests-100751771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-edfacd23-e2ce-423a-9cbc-1aea49907219 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:15:18 devstack sudo[107502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-edfacd23-e2ce-423a-9cbc-1aea49907219 Jul 10 16:15:18 devstack sudo[107502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:15:18 devstack sudo[107502]: pam_unix(sudo:session): session closed for user root Jul 10 16:15:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-27b60449-0758-4b0d-aec4-4e2fd0d7e98f tempest-ProjectReaderTests-100751771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-edfacd23-e2ce-423a-9cbc-1aea49907219" returned: 0 in 0.633s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:15:18 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-27b60449-0758-4b0d-aec4-4e2fd0d7e98f tempest-ProjectReaderTests-100751771 None] Lock "cinder-quobyte-edfacd23-e2ce-423a-9cbc-1aea49907219" released by "delete_volume" :: held 1.460s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:15:18 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-27b60449-0758-4b0d-aec4-4e2fd0d7e98f tempest-ProjectReaderTests-100751771 None] Created reservations ['b37c0608-3c64-4f3e-ba69-65ebe62abec2', '4b905be9-ee1c-4429-b0bb-2c86635bed88', '41e0737f-6607-42b5-b650-826616ddf9fe', '7458079e-7d59-4499-acab-f9bfa1b49f94'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:15:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-27b60449-0758-4b0d-aec4-4e2fd0d7e98f tempest-ProjectReaderTests-100751771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:15:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-27b60449-0758-4b0d-aec4-4e2fd0d7e98f tempest-ProjectReaderTests-100751771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:15:18 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-27b60449-0758-4b0d-aec4-4e2fd0d7e98f tempest-ProjectReaderTests-100751771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:15:18 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-27b60449-0758-4b0d-aec4-4e2fd0d7e98f tempest-ProjectReaderTests-100751771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:15:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-27b60449-0758-4b0d-aec4-4e2fd0d7e98f tempest-ProjectReaderTests-100751771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:15:18 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-27b60449-0758-4b0d-aec4-4e2fd0d7e98f tempest-ProjectReaderTests-100751771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:15:19 devstack sudo[107505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:15:19 devstack sudo[107505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:15:19 devstack sudo[107505]: pam_unix(sudo:session): session closed for user root Jul 10 16:15:19 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-27b60449-0758-4b0d-aec4-4e2fd0d7e98f tempest-ProjectReaderTests-100751771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.631s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:15:19 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-27b60449-0758-4b0d-aec4-4e2fd0d7e98f tempest-ProjectReaderTests-100751771 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:15:19 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-27b60449-0758-4b0d-aec4-4e2fd0d7e98f tempest-ProjectReaderTests-100751771 None] Deleted volume successfully. Jul 10 16:15:19 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-27b60449-0758-4b0d-aec4-4e2fd0d7e98f tempest-ProjectReaderTests-100751771 None] Lock "cinder-edfacd23-e2ce-423a-9cbc-1aea49907219-delete_volume" released by "delete_volume" :: held 2.290s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:15:19 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-17073b8f-e0b5-47e6-aae4-3c8394f6e71f tempest-ProjectReaderTests-100751771 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 16:15:19 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-17073b8f-e0b5-47e6-aae4-3c8394f6e71f tempest-ProjectReaderTests-100751771 None] Flow 'volume_create_manager' (ef356647-6875-4fc2-8b5b-4c08a07bd326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:15:20 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-17073b8f-e0b5-47e6-aae4-3c8394f6e71f tempest-ProjectReaderTests-100751771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b065d22c-1456-44fb-b6ec-159c15cdc5d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:15:20 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-17073b8f-e0b5-47e6-aae4-3c8394f6e71f tempest-ProjectReaderTests-100751771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b065d22c-1456-44fb-b6ec-159c15cdc5d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:15:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-649575941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad282369-9f54-457e-a5a7-93b68e5afe62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a1d8b19e5794ce8a732d6d9b460c4b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:15:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:15:20Z,use_quota=True,user_id='d71c884179bb403db7c010bff6f5dc25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:15:20 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-17073b8f-e0b5-47e6-aae4-3c8394f6e71f tempest-ProjectReaderTests-100751771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e48744de-f5f0-4bd8-9159-678720347f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:15:20 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-17073b8f-e0b5-47e6-aae4-3c8394f6e71f tempest-ProjectReaderTests-100751771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e48744de-f5f0-4bd8-9159-678720347f98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:15:20 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-17073b8f-e0b5-47e6-aae4-3c8394f6e71f tempest-ProjectReaderTests-100751771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68f280c7-85f5-4a32-ba5f-6e0ce58fd5a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:15:20 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-17073b8f-e0b5-47e6-aae4-3c8394f6e71f tempest-ProjectReaderTests-100751771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68f280c7-85f5-4a32-ba5f-6e0ce58fd5a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad282369-9f54-457e-a5a7-93b68e5afe62', 'volume_name': 'volume-ad282369-9f54-457e-a5a7-93b68e5afe62', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:15:20 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-17073b8f-e0b5-47e6-aae4-3c8394f6e71f tempest-ProjectReaderTests-100751771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9de3201d-eb26-4c89-b816-37eaaa9b26e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:15:20 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-17073b8f-e0b5-47e6-aae4-3c8394f6e71f tempest-ProjectReaderTests-100751771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9de3201d-eb26-4c89-b816-37eaaa9b26e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:15:20 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-17073b8f-e0b5-47e6-aae4-3c8394f6e71f tempest-ProjectReaderTests-100751771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11ec8978-3e79-448e-b23e-552642943ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:15:20 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-17073b8f-e0b5-47e6-aae4-3c8394f6e71f tempest-ProjectReaderTests-100751771 None] Volume ad282369-9f54-457e-a5a7-93b68e5afe62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad282369-9f54-457e-a5a7-93b68e5afe62', 'volume_size': 1} Jul 10 16:15:20 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-17073b8f-e0b5-47e6-aae4-3c8394f6e71f tempest-ProjectReaderTests-100751771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:15:20 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-17073b8f-e0b5-47e6-aae4-3c8394f6e71f tempest-ProjectReaderTests-100751771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:15:20 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-17073b8f-e0b5-47e6-aae4-3c8394f6e71f tempest-ProjectReaderTests-100751771 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:15:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-649575941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad282369-9f54-457e-a5a7-93b68e5afe62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a1d8b19e5794ce8a732d6d9b460c4b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:15:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:15:20Z,use_quota=True,user_id='d71c884179bb403db7c010bff6f5dc25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 16:15:20 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-17073b8f-e0b5-47e6-aae4-3c8394f6e71f tempest-ProjectReaderTests-100751771 None] Creating volume ad282369-9f54-457e-a5a7-93b68e5afe62 {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 16:15:20 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-17073b8f-e0b5-47e6-aae4-3c8394f6e71f tempest-ProjectReaderTests-100751771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:15:20 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-17073b8f-e0b5-47e6-aae4-3c8394f6e71f tempest-ProjectReaderTests-100751771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:15:20 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-17073b8f-e0b5-47e6-aae4-3c8394f6e71f tempest-ProjectReaderTests-100751771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:15:20 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-17073b8f-e0b5-47e6-aae4-3c8394f6e71f tempest-ProjectReaderTests-100751771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:15:20 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-17073b8f-e0b5-47e6-aae4-3c8394f6e71f tempest-ProjectReaderTests-100751771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:15:20 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-17073b8f-e0b5-47e6-aae4-3c8394f6e71f tempest-ProjectReaderTests-100751771 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 16:15:20 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-17073b8f-e0b5-47e6-aae4-3c8394f6e71f tempest-ProjectReaderTests-100751771 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 16:15:20 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-17073b8f-e0b5-47e6-aae4-3c8394f6e71f tempest-ProjectReaderTests-100751771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ad282369-9f54-457e-a5a7-93b68e5afe62 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:15:20 devstack sudo[107508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ad282369-9f54-457e-a5a7-93b68e5afe62 1073741824 Jul 10 16:15:20 devstack sudo[107508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:15:20 devstack sudo[107508]: pam_unix(sudo:session): session closed for user root Jul 10 16:15:20 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-17073b8f-e0b5-47e6-aae4-3c8394f6e71f tempest-ProjectReaderTests-100751771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ad282369-9f54-457e-a5a7-93b68e5afe62 1073741824" returned: 0 in 0.815s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:15:20 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-17073b8f-e0b5-47e6-aae4-3c8394f6e71f tempest-ProjectReaderTests-100751771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ad282369-9f54-457e-a5a7-93b68e5afe62 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:15:20 devstack sudo[107513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ad282369-9f54-457e-a5a7-93b68e5afe62 Jul 10 16:15:20 devstack sudo[107513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:15:21 devstack sudo[107513]: pam_unix(sudo:session): session closed for user root Jul 10 16:15:21 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-17073b8f-e0b5-47e6-aae4-3c8394f6e71f tempest-ProjectReaderTests-100751771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ad282369-9f54-457e-a5a7-93b68e5afe62" returned: 0 in 0.621s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:15:21 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-17073b8f-e0b5-47e6-aae4-3c8394f6e71f tempest-ProjectReaderTests-100751771 None] <== create_volume: return (1483ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 16:15:21 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-17073b8f-e0b5-47e6-aae4-3c8394f6e71f tempest-ProjectReaderTests-100751771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.485s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:15:21 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-17073b8f-e0b5-47e6-aae4-3c8394f6e71f tempest-ProjectReaderTests-100751771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11ec8978-3e79-448e-b23e-552642943ae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad282369-9f54-457e-a5a7-93b68e5afe62', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:15:21 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-17073b8f-e0b5-47e6-aae4-3c8394f6e71f tempest-ProjectReaderTests-100751771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9aac157-b0cc-4c06-a94a-881f8235523d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:15:21 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-17073b8f-e0b5-47e6-aae4-3c8394f6e71f tempest-ProjectReaderTests-100751771 None] Volume volume-ad282369-9f54-457e-a5a7-93b68e5afe62 (ad282369-9f54-457e-a5a7-93b68e5afe62): created successfully Jul 10 16:15:21 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-17073b8f-e0b5-47e6-aae4-3c8394f6e71f tempest-ProjectReaderTests-100751771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9aac157-b0cc-4c06-a94a-881f8235523d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:15:21 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-17073b8f-e0b5-47e6-aae4-3c8394f6e71f tempest-ProjectReaderTests-100751771 None] Flow 'volume_create_manager' (ef356647-6875-4fc2-8b5b-4c08a07bd326) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:15:21 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-17073b8f-e0b5-47e6-aae4-3c8394f6e71f tempest-ProjectReaderTests-100751771 None] Created volume successfully. Jul 10 16:15:22 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-9c330d61-339f-44c6-9914-83e97f3bb6c2 tempest-ProjectReaderTests-100751771 None] Acquiring lock "cinder-ad282369-9f54-457e-a5a7-93b68e5afe62-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:15:22 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-9c330d61-339f-44c6-9914-83e97f3bb6c2 tempest-ProjectReaderTests-100751771 None] Lock "cinder-ad282369-9f54-457e-a5a7-93b68e5afe62-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:15:22 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-9c330d61-339f-44c6-9914-83e97f3bb6c2 tempest-ProjectReaderTests-100751771 None] Acquiring lock "cinder-quobyte-ad282369-9f54-457e-a5a7-93b68e5afe62" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:15:22 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-9c330d61-339f-44c6-9914-83e97f3bb6c2 tempest-ProjectReaderTests-100751771 None] Lock "cinder-quobyte-ad282369-9f54-457e-a5a7-93b68e5afe62" acquired by "delete_volume" :: waited 0.014s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:15:22 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8965bfc-c2ba-4674-9eec-95788efad415]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:15:22 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-9c330d61-339f-44c6-9914-83e97f3bb6c2 tempest-ProjectReaderTests-100751771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ad282369-9f54-457e-a5a7-93b68e5afe62 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:15:22 devstack sudo[107517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ad282369-9f54-457e-a5a7-93b68e5afe62 Jul 10 16:15:22 devstack sudo[107517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:15:22 devstack sudo[107517]: pam_unix(sudo:session): session closed for user root Jul 10 16:15:22 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-9c330d61-339f-44c6-9914-83e97f3bb6c2 tempest-ProjectReaderTests-100751771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ad282369-9f54-457e-a5a7-93b68e5afe62" returned: 0 in 0.797s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:15:22 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-9c330d61-339f-44c6-9914-83e97f3bb6c2 tempest-ProjectReaderTests-100751771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ad282369-9f54-457e-a5a7-93b68e5afe62 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:15:23 devstack sudo[107522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ad282369-9f54-457e-a5a7-93b68e5afe62 Jul 10 16:15:23 devstack sudo[107522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:15:23 devstack sudo[107522]: pam_unix(sudo:session): session closed for user root Jul 10 16:15:23 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-9c330d61-339f-44c6-9914-83e97f3bb6c2 tempest-ProjectReaderTests-100751771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-ad282369-9f54-457e-a5a7-93b68e5afe62" returned: 0 in 0.655s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:15:23 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-9c330d61-339f-44c6-9914-83e97f3bb6c2 tempest-ProjectReaderTests-100751771 None] Lock "cinder-quobyte-ad282369-9f54-457e-a5a7-93b68e5afe62" released by "delete_volume" :: held 1.491s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:15:23 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-9c330d61-339f-44c6-9914-83e97f3bb6c2 tempest-ProjectReaderTests-100751771 None] Created reservations ['669c1016-6349-4638-95db-9561c57ba499', '15518013-2f45-47e4-be14-5180fc3af533', 'd28f85cc-4425-4bf4-9f5b-ef878e89249f', 'd9b4e165-3e3c-404a-9c70-f5d442577383'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:15:23 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-9c330d61-339f-44c6-9914-83e97f3bb6c2 tempest-ProjectReaderTests-100751771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:15:23 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-9c330d61-339f-44c6-9914-83e97f3bb6c2 tempest-ProjectReaderTests-100751771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:15:23 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-9c330d61-339f-44c6-9914-83e97f3bb6c2 tempest-ProjectReaderTests-100751771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:15:23 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-9c330d61-339f-44c6-9914-83e97f3bb6c2 tempest-ProjectReaderTests-100751771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:15:23 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-9c330d61-339f-44c6-9914-83e97f3bb6c2 tempest-ProjectReaderTests-100751771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:15:23 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-9c330d61-339f-44c6-9914-83e97f3bb6c2 tempest-ProjectReaderTests-100751771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:15:23 devstack sudo[107526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:15:23 devstack sudo[107526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:15:24 devstack sudo[107526]: pam_unix(sudo:session): session closed for user root Jul 10 16:15:24 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-9c330d61-339f-44c6-9914-83e97f3bb6c2 tempest-ProjectReaderTests-100751771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.645s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:15:24 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-9c330d61-339f-44c6-9914-83e97f3bb6c2 tempest-ProjectReaderTests-100751771 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:15:24 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-9c330d61-339f-44c6-9914-83e97f3bb6c2 tempest-ProjectReaderTests-100751771 None] Deleted volume successfully. Jul 10 16:15:24 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-9c330d61-339f-44c6-9914-83e97f3bb6c2 tempest-ProjectReaderTests-100751771 None] Lock "cinder-ad282369-9f54-457e-a5a7-93b68e5afe62-delete_volume" released by "delete_volume" :: held 2.329s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:15:24 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e2dc4a7-140f-4357-9a67-6f78ecb7cf2b tempest-ProjectReaderTests-100751771 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 16:15:24 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-0e2dc4a7-140f-4357-9a67-6f78ecb7cf2b tempest-ProjectReaderTests-100751771 None] Flow 'volume_create_manager' (08023857-dfff-4cae-abc9-12ae01ee6de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:15:24 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-0e2dc4a7-140f-4357-9a67-6f78ecb7cf2b tempest-ProjectReaderTests-100751771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac6b857c-1fb6-47fb-8e27-f8056aa9f40c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:15:24 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-0e2dc4a7-140f-4357-9a67-6f78ecb7cf2b tempest-ProjectReaderTests-100751771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac6b857c-1fb6-47fb-8e27-f8056aa9f40c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:15:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-244768199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f0012d7-05c8-4016-bb39-3b0d6fe5ebfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a1d8b19e5794ce8a732d6d9b460c4b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:15:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:15:25Z,use_quota=True,user_id='d71c884179bb403db7c010bff6f5dc25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:15:24 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-0e2dc4a7-140f-4357-9a67-6f78ecb7cf2b tempest-ProjectReaderTests-100751771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (def0351e-2f41-4688-af70-b7c64e282999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:15:24 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-0e2dc4a7-140f-4357-9a67-6f78ecb7cf2b tempest-ProjectReaderTests-100751771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (def0351e-2f41-4688-af70-b7c64e282999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:15:24 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-0e2dc4a7-140f-4357-9a67-6f78ecb7cf2b tempest-ProjectReaderTests-100751771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e70971b-d1c7-4b36-a1c1-4a683ae0eceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:15:24 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-0e2dc4a7-140f-4357-9a67-6f78ecb7cf2b tempest-ProjectReaderTests-100751771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e70971b-d1c7-4b36-a1c1-4a683ae0eceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f0012d7-05c8-4016-bb39-3b0d6fe5ebfa', 'volume_name': 'volume-0f0012d7-05c8-4016-bb39-3b0d6fe5ebfa', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:15:24 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-0e2dc4a7-140f-4357-9a67-6f78ecb7cf2b tempest-ProjectReaderTests-100751771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (786e8077-f4cf-47df-a278-79a2c40e7e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:15:24 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-0e2dc4a7-140f-4357-9a67-6f78ecb7cf2b tempest-ProjectReaderTests-100751771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (786e8077-f4cf-47df-a278-79a2c40e7e89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:15:24 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-0e2dc4a7-140f-4357-9a67-6f78ecb7cf2b tempest-ProjectReaderTests-100751771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fedb6a58-ac6e-4a10-9105-3da01e577124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:15:24 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-0e2dc4a7-140f-4357-9a67-6f78ecb7cf2b tempest-ProjectReaderTests-100751771 None] Volume 0f0012d7-05c8-4016-bb39-3b0d6fe5ebfa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f0012d7-05c8-4016-bb39-3b0d6fe5ebfa', 'volume_size': 1} Jul 10 16:15:24 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-0e2dc4a7-140f-4357-9a67-6f78ecb7cf2b tempest-ProjectReaderTests-100751771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:15:24 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-0e2dc4a7-140f-4357-9a67-6f78ecb7cf2b tempest-ProjectReaderTests-100751771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:15:24 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-0e2dc4a7-140f-4357-9a67-6f78ecb7cf2b tempest-ProjectReaderTests-100751771 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:15:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-244768199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f0012d7-05c8-4016-bb39-3b0d6fe5ebfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a1d8b19e5794ce8a732d6d9b460c4b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:15:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:15:25Z,use_quota=True,user_id='d71c884179bb403db7c010bff6f5dc25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 16:15:24 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-0e2dc4a7-140f-4357-9a67-6f78ecb7cf2b tempest-ProjectReaderTests-100751771 None] Creating volume 0f0012d7-05c8-4016-bb39-3b0d6fe5ebfa {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 16:15:24 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-0e2dc4a7-140f-4357-9a67-6f78ecb7cf2b tempest-ProjectReaderTests-100751771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:15:24 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-0e2dc4a7-140f-4357-9a67-6f78ecb7cf2b tempest-ProjectReaderTests-100751771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:15:24 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-0e2dc4a7-140f-4357-9a67-6f78ecb7cf2b tempest-ProjectReaderTests-100751771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:15:24 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-0e2dc4a7-140f-4357-9a67-6f78ecb7cf2b tempest-ProjectReaderTests-100751771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:15:24 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-0e2dc4a7-140f-4357-9a67-6f78ecb7cf2b tempest-ProjectReaderTests-100751771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:15:24 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-0e2dc4a7-140f-4357-9a67-6f78ecb7cf2b tempest-ProjectReaderTests-100751771 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 16:15:24 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-0e2dc4a7-140f-4357-9a67-6f78ecb7cf2b tempest-ProjectReaderTests-100751771 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 16:15:24 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-0e2dc4a7-140f-4357-9a67-6f78ecb7cf2b tempest-ProjectReaderTests-100751771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-0f0012d7-05c8-4016-bb39-3b0d6fe5ebfa 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:15:24 devstack sudo[107532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-0f0012d7-05c8-4016-bb39-3b0d6fe5ebfa 1073741824 Jul 10 16:15:24 devstack sudo[107532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:15:25 devstack sudo[107532]: pam_unix(sudo:session): session closed for user root Jul 10 16:15:25 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-0e2dc4a7-140f-4357-9a67-6f78ecb7cf2b tempest-ProjectReaderTests-100751771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-0f0012d7-05c8-4016-bb39-3b0d6fe5ebfa 1073741824" returned: 0 in 0.834s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:15:25 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-0e2dc4a7-140f-4357-9a67-6f78ecb7cf2b tempest-ProjectReaderTests-100751771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-0f0012d7-05c8-4016-bb39-3b0d6fe5ebfa {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:15:25 devstack sudo[107538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-0f0012d7-05c8-4016-bb39-3b0d6fe5ebfa Jul 10 16:15:25 devstack sudo[107538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:15:26 devstack sudo[107538]: pam_unix(sudo:session): session closed for user root Jul 10 16:15:26 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-0e2dc4a7-140f-4357-9a67-6f78ecb7cf2b tempest-ProjectReaderTests-100751771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-0f0012d7-05c8-4016-bb39-3b0d6fe5ebfa" returned: 0 in 0.633s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:15:26 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-0e2dc4a7-140f-4357-9a67-6f78ecb7cf2b tempest-ProjectReaderTests-100751771 None] <== create_volume: return (1509ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 16:15:26 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-0e2dc4a7-140f-4357-9a67-6f78ecb7cf2b tempest-ProjectReaderTests-100751771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.512s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:15:26 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-0e2dc4a7-140f-4357-9a67-6f78ecb7cf2b tempest-ProjectReaderTests-100751771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fedb6a58-ac6e-4a10-9105-3da01e577124) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f0012d7-05c8-4016-bb39-3b0d6fe5ebfa', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:15:26 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-0e2dc4a7-140f-4357-9a67-6f78ecb7cf2b tempest-ProjectReaderTests-100751771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3677873-e8ea-4140-ac27-bb7c443e8fe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:15:26 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-0e2dc4a7-140f-4357-9a67-6f78ecb7cf2b tempest-ProjectReaderTests-100751771 None] Volume volume-0f0012d7-05c8-4016-bb39-3b0d6fe5ebfa (0f0012d7-05c8-4016-bb39-3b0d6fe5ebfa): created successfully Jul 10 16:15:26 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-0e2dc4a7-140f-4357-9a67-6f78ecb7cf2b tempest-ProjectReaderTests-100751771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3677873-e8ea-4140-ac27-bb7c443e8fe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:15:26 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-0e2dc4a7-140f-4357-9a67-6f78ecb7cf2b tempest-ProjectReaderTests-100751771 None] Flow 'volume_create_manager' (08023857-dfff-4cae-abc9-12ae01ee6de5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:15:26 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-0e2dc4a7-140f-4357-9a67-6f78ecb7cf2b tempest-ProjectReaderTests-100751771 None] Created volume successfully. Jul 10 16:15:26 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-c0d642a2-bd4b-46cc-b066-7680638d5788 tempest-ProjectReaderTests-100751771 None] Acquiring lock "cinder-0f0012d7-05c8-4016-bb39-3b0d6fe5ebfa-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:15:26 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-c0d642a2-bd4b-46cc-b066-7680638d5788 tempest-ProjectReaderTests-100751771 None] Lock "cinder-0f0012d7-05c8-4016-bb39-3b0d6fe5ebfa-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:15:26 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-c0d642a2-bd4b-46cc-b066-7680638d5788 tempest-ProjectReaderTests-100751771 None] Acquiring lock "cinder-quobyte-0f0012d7-05c8-4016-bb39-3b0d6fe5ebfa" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:15:26 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-c0d642a2-bd4b-46cc-b066-7680638d5788 tempest-ProjectReaderTests-100751771 None] Lock "cinder-quobyte-0f0012d7-05c8-4016-bb39-3b0d6fe5ebfa" acquired by "delete_volume" :: waited 0.013s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:15:26 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[129cf72e-9c3b-4acb-bd99-443d2b8284c6]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:15:26 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c0d642a2-bd4b-46cc-b066-7680638d5788 tempest-ProjectReaderTests-100751771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-0f0012d7-05c8-4016-bb39-3b0d6fe5ebfa {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:15:27 devstack sudo[107541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-0f0012d7-05c8-4016-bb39-3b0d6fe5ebfa Jul 10 16:15:27 devstack sudo[107541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:15:27 devstack sudo[107541]: pam_unix(sudo:session): session closed for user root Jul 10 16:15:27 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c0d642a2-bd4b-46cc-b066-7680638d5788 tempest-ProjectReaderTests-100751771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-0f0012d7-05c8-4016-bb39-3b0d6fe5ebfa" returned: 0 in 0.753s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:15:27 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c0d642a2-bd4b-46cc-b066-7680638d5788 tempest-ProjectReaderTests-100751771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-0f0012d7-05c8-4016-bb39-3b0d6fe5ebfa {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:15:27 devstack sudo[107546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-0f0012d7-05c8-4016-bb39-3b0d6fe5ebfa Jul 10 16:15:27 devstack sudo[107546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:15:28 devstack sudo[107546]: pam_unix(sudo:session): session closed for user root Jul 10 16:15:28 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c0d642a2-bd4b-46cc-b066-7680638d5788 tempest-ProjectReaderTests-100751771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-0f0012d7-05c8-4016-bb39-3b0d6fe5ebfa" returned: 0 in 0.638s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:15:28 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-c0d642a2-bd4b-46cc-b066-7680638d5788 tempest-ProjectReaderTests-100751771 None] Lock "cinder-quobyte-0f0012d7-05c8-4016-bb39-3b0d6fe5ebfa" released by "delete_volume" :: held 1.429s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:15:28 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-c0d642a2-bd4b-46cc-b066-7680638d5788 tempest-ProjectReaderTests-100751771 None] Created reservations ['3b8a8016-3f56-4c52-a6ec-1840703b2124', 'fc5fe3ed-7ef6-4370-b1d7-c34c4de1797b', '76b0cfcd-99f5-404c-aa12-39d9bcbd8cc3', '16d2d267-a34b-4cf3-b741-f412f938f19d'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:15:28 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-c0d642a2-bd4b-46cc-b066-7680638d5788 tempest-ProjectReaderTests-100751771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:15:28 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-c0d642a2-bd4b-46cc-b066-7680638d5788 tempest-ProjectReaderTests-100751771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:15:28 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-c0d642a2-bd4b-46cc-b066-7680638d5788 tempest-ProjectReaderTests-100751771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:15:28 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-c0d642a2-bd4b-46cc-b066-7680638d5788 tempest-ProjectReaderTests-100751771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:15:28 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-c0d642a2-bd4b-46cc-b066-7680638d5788 tempest-ProjectReaderTests-100751771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:15:28 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c0d642a2-bd4b-46cc-b066-7680638d5788 tempest-ProjectReaderTests-100751771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:15:28 devstack sudo[107549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:15:28 devstack sudo[107549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:15:29 devstack sudo[107549]: pam_unix(sudo:session): session closed for user root Jul 10 16:15:29 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-c0d642a2-bd4b-46cc-b066-7680638d5788 tempest-ProjectReaderTests-100751771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.661s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:15:29 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-c0d642a2-bd4b-46cc-b066-7680638d5788 tempest-ProjectReaderTests-100751771 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:15:29 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-c0d642a2-bd4b-46cc-b066-7680638d5788 tempest-ProjectReaderTests-100751771 None] Deleted volume successfully. Jul 10 16:15:29 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-c0d642a2-bd4b-46cc-b066-7680638d5788 tempest-ProjectReaderTests-100751771 None] Lock "cinder-0f0012d7-05c8-4016-bb39-3b0d6fe5ebfa-delete_volume" released by "delete_volume" :: held 2.271s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:15:29 devstack cinder-volume[87420]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d3277b2-9a27-480c-81fa-4fbf9c08a22a tempest-ProjectReaderTests-100751771 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87420) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 16:15:29 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6d3277b2-9a27-480c-81fa-4fbf9c08a22a tempest-ProjectReaderTests-100751771 None] Flow 'volume_create_manager' (f30ed7da-c7dd-4553-8e5a-84068e6be54d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:15:29 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6d3277b2-9a27-480c-81fa-4fbf9c08a22a tempest-ProjectReaderTests-100751771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f00e51fe-e3f3-4c78-933e-bb61b7bb90b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:15:29 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6d3277b2-9a27-480c-81fa-4fbf9c08a22a tempest-ProjectReaderTests-100751771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f00e51fe-e3f3-4c78-933e-bb61b7bb90b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:15:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1680331430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1710eb61-7e4b-4c7b-8e36-e5711dd7b625,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a1d8b19e5794ce8a732d6d9b460c4b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:15:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:15:30Z,use_quota=True,user_id='d71c884179bb403db7c010bff6f5dc25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:15:29 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6d3277b2-9a27-480c-81fa-4fbf9c08a22a tempest-ProjectReaderTests-100751771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ebf9dc7-eddd-4723-a5a3-fa267b0bc089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:15:29 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6d3277b2-9a27-480c-81fa-4fbf9c08a22a tempest-ProjectReaderTests-100751771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ebf9dc7-eddd-4723-a5a3-fa267b0bc089) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:15:29 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6d3277b2-9a27-480c-81fa-4fbf9c08a22a tempest-ProjectReaderTests-100751771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff053c86-bf70-4674-ab4e-4a1710f8a863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:15:29 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6d3277b2-9a27-480c-81fa-4fbf9c08a22a tempest-ProjectReaderTests-100751771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff053c86-bf70-4674-ab4e-4a1710f8a863) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1710eb61-7e4b-4c7b-8e36-e5711dd7b625', 'volume_name': 'volume-1710eb61-7e4b-4c7b-8e36-e5711dd7b625', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:15:29 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6d3277b2-9a27-480c-81fa-4fbf9c08a22a tempest-ProjectReaderTests-100751771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cd3f0f7-accd-4a8c-a31b-d33d5fc9a4a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:15:29 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6d3277b2-9a27-480c-81fa-4fbf9c08a22a tempest-ProjectReaderTests-100751771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cd3f0f7-accd-4a8c-a31b-d33d5fc9a4a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:15:29 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6d3277b2-9a27-480c-81fa-4fbf9c08a22a tempest-ProjectReaderTests-100751771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d3a4dc6-52b7-4c31-9e06-7a3414f93541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:15:29 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-6d3277b2-9a27-480c-81fa-4fbf9c08a22a tempest-ProjectReaderTests-100751771 None] Volume 1710eb61-7e4b-4c7b-8e36-e5711dd7b625: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1710eb61-7e4b-4c7b-8e36-e5711dd7b625', 'volume_size': 1} Jul 10 16:15:29 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-6d3277b2-9a27-480c-81fa-4fbf9c08a22a tempest-ProjectReaderTests-100751771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:15:29 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-6d3277b2-9a27-480c-81fa-4fbf9c08a22a tempest-ProjectReaderTests-100751771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:15:29 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-6d3277b2-9a27-480c-81fa-4fbf9c08a22a tempest-ProjectReaderTests-100751771 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T14:15:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1680331430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1710eb61-7e4b-4c7b-8e36-e5711dd7b625,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a1d8b19e5794ce8a732d6d9b460c4b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T14:15:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T14:15:30Z,use_quota=True,user_id='d71c884179bb403db7c010bff6f5dc25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bee4d3cf-e075-472d-8e2e-be61b43593b1),volume_type_id=bee4d3cf-e075-472d-8e2e-be61b43593b1)}" {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 16:15:29 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.remotefs [None req-6d3277b2-9a27-480c-81fa-4fbf9c08a22a tempest-ProjectReaderTests-100751771 None] Creating volume 1710eb61-7e4b-4c7b-8e36-e5711dd7b625 {{(pid=87420) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 16:15:29 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-6d3277b2-9a27-480c-81fa-4fbf9c08a22a tempest-ProjectReaderTests-100751771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:15:29 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-6d3277b2-9a27-480c-81fa-4fbf9c08a22a tempest-ProjectReaderTests-100751771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:15:29 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-6d3277b2-9a27-480c-81fa-4fbf9c08a22a tempest-ProjectReaderTests-100751771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:15:29 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-6d3277b2-9a27-480c-81fa-4fbf9c08a22a tempest-ProjectReaderTests-100751771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:15:29 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-6d3277b2-9a27-480c-81fa-4fbf9c08a22a tempest-ProjectReaderTests-100751771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:15:29 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-6d3277b2-9a27-480c-81fa-4fbf9c08a22a tempest-ProjectReaderTests-100751771 None] Selected osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 as target Quobyte volume. {{(pid=87420) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 16:15:29 devstack cinder-volume[87420]: INFO cinder.volume.drivers.remotefs [None req-6d3277b2-9a27-480c-81fa-4fbf9c08a22a tempest-ProjectReaderTests-100751771 None] casted to osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80 Jul 10 16:15:29 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6d3277b2-9a27-480c-81fa-4fbf9c08a22a tempest-ProjectReaderTests-100751771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1710eb61-7e4b-4c7b-8e36-e5711dd7b625 1073741824 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:15:29 devstack sudo[107552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1710eb61-7e4b-4c7b-8e36-e5711dd7b625 1073741824 Jul 10 16:15:29 devstack sudo[107552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:15:30 devstack sudo[107552]: pam_unix(sudo:session): session closed for user root Jul 10 16:15:30 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6d3277b2-9a27-480c-81fa-4fbf9c08a22a tempest-ProjectReaderTests-100751771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1710eb61-7e4b-4c7b-8e36-e5711dd7b625 1073741824" returned: 0 in 0.797s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:15:30 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6d3277b2-9a27-480c-81fa-4fbf9c08a22a tempest-ProjectReaderTests-100751771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1710eb61-7e4b-4c7b-8e36-e5711dd7b625 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:15:30 devstack sudo[107557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1710eb61-7e4b-4c7b-8e36-e5711dd7b625 Jul 10 16:15:30 devstack sudo[107557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:15:31 devstack sudo[107557]: pam_unix(sudo:session): session closed for user root Jul 10 16:15:31 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-6d3277b2-9a27-480c-81fa-4fbf9c08a22a tempest-ProjectReaderTests-100751771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1710eb61-7e4b-4c7b-8e36-e5711dd7b625" returned: 0 in 0.635s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:15:31 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-6d3277b2-9a27-480c-81fa-4fbf9c08a22a tempest-ProjectReaderTests-100751771 None] <== create_volume: return (1475ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'} {{(pid=87420) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 16:15:31 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-6d3277b2-9a27-480c-81fa-4fbf9c08a22a tempest-ProjectReaderTests-100751771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.478s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:15:31 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6d3277b2-9a27-480c-81fa-4fbf9c08a22a tempest-ProjectReaderTests-100751771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d3a4dc6-52b7-4c31-9e06-7a3414f93541) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1710eb61-7e4b-4c7b-8e36-e5711dd7b625', 'volume_size': 1}' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:15:31 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6d3277b2-9a27-480c-81fa-4fbf9c08a22a tempest-ProjectReaderTests-100751771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef3daa0a-216f-4d9b-b734-f0ef1d9ea63f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 16:15:31 devstack cinder-volume[87420]: INFO cinder.volume.flows.manager.create_volume [None req-6d3277b2-9a27-480c-81fa-4fbf9c08a22a tempest-ProjectReaderTests-100751771 None] Volume volume-1710eb61-7e4b-4c7b-8e36-e5711dd7b625 (1710eb61-7e4b-4c7b-8e36-e5711dd7b625): created successfully Jul 10 16:15:31 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6d3277b2-9a27-480c-81fa-4fbf9c08a22a tempest-ProjectReaderTests-100751771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef3daa0a-216f-4d9b-b734-f0ef1d9ea63f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87420) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 16:15:31 devstack cinder-volume[87420]: DEBUG cinder.volume.manager [None req-6d3277b2-9a27-480c-81fa-4fbf9c08a22a tempest-ProjectReaderTests-100751771 None] Flow 'volume_create_manager' (f30ed7da-c7dd-4553-8e5a-84068e6be54d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87420) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 16:15:31 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-6d3277b2-9a27-480c-81fa-4fbf9c08a22a tempest-ProjectReaderTests-100751771 None] Created volume successfully. Jul 10 16:15:31 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-f4342e0d-0495-4fbd-b0aa-3e5fc87ec93a tempest-ProjectReaderTests-100751771 None] Acquiring lock "cinder-1710eb61-7e4b-4c7b-8e36-e5711dd7b625-delete_volume" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:15:31 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-f4342e0d-0495-4fbd-b0aa-3e5fc87ec93a tempest-ProjectReaderTests-100751771 None] Lock "cinder-1710eb61-7e4b-4c7b-8e36-e5711dd7b625-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:15:31 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-f4342e0d-0495-4fbd-b0aa-3e5fc87ec93a tempest-ProjectReaderTests-100751771 None] Acquiring lock "cinder-quobyte-1710eb61-7e4b-4c7b-8e36-e5711dd7b625" by "delete_volume" {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 16:15:31 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-f4342e0d-0495-4fbd-b0aa-3e5fc87ec93a tempest-ProjectReaderTests-100751771 None] Lock "cinder-quobyte-1710eb61-7e4b-4c7b-8e36-e5711dd7b625" acquired by "delete_volume" :: waited 0.018s {{(pid=87420) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 16:15:31 devstack cinder-volume[87420]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cc2698e-a567-451d-8f34-0a1a8f4b82d5]: (4, 'qcow2') {{(pid=88516) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 16:15:31 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f4342e0d-0495-4fbd-b0aa-3e5fc87ec93a tempest-ProjectReaderTests-100751771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1710eb61-7e4b-4c7b-8e36-e5711dd7b625 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:15:31 devstack sudo[107560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1710eb61-7e4b-4c7b-8e36-e5711dd7b625 Jul 10 16:15:31 devstack sudo[107560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:15:32 devstack sudo[107560]: pam_unix(sudo:session): session closed for user root Jul 10 16:15:32 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f4342e0d-0495-4fbd-b0aa-3e5fc87ec93a tempest-ProjectReaderTests-100751771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1710eb61-7e4b-4c7b-8e36-e5711dd7b625" returned: 0 in 0.755s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:15:32 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f4342e0d-0495-4fbd-b0aa-3e5fc87ec93a tempest-ProjectReaderTests-100751771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1710eb61-7e4b-4c7b-8e36-e5711dd7b625 {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:15:32 devstack sudo[107565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1710eb61-7e4b-4c7b-8e36-e5711dd7b625 Jul 10 16:15:32 devstack sudo[107565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:15:33 devstack sudo[107565]: pam_unix(sudo:session): session closed for user root Jul 10 16:15:33 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f4342e0d-0495-4fbd-b0aa-3e5fc87ec93a tempest-ProjectReaderTests-100751771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd/volume-1710eb61-7e4b-4c7b-8e36-e5711dd7b625" returned: 0 in 0.660s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:15:33 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-f4342e0d-0495-4fbd-b0aa-3e5fc87ec93a tempest-ProjectReaderTests-100751771 None] Lock "cinder-quobyte-1710eb61-7e4b-4c7b-8e36-e5711dd7b625" released by "delete_volume" :: held 1.453s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:15:33 devstack cinder-volume[87420]: DEBUG cinder.quota [None req-f4342e0d-0495-4fbd-b0aa-3e5fc87ec93a tempest-ProjectReaderTests-100751771 None] Created reservations ['8c3141b9-1660-4917-98f7-d7beec6b4b9b', '88b98b8d-1d61-41a0-bf08-20e4ca7f50d6', '2c9f7bd5-9963-4dd9-8482-653ea21eb879', '0f8ee416-336c-499f-8531-20f43dcc8631'] {{(pid=87420) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 16:15:33 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-f4342e0d-0495-4fbd-b0aa-3e5fc87ec93a tempest-ProjectReaderTests-100751771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 16:15:33 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-f4342e0d-0495-4fbd-b0aa-3e5fc87ec93a tempest-ProjectReaderTests-100751771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 16:15:33 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-f4342e0d-0495-4fbd-b0aa-3e5fc87ec93a tempest-ProjectReaderTests-100751771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80': None} {{(pid=87420) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 16:15:33 devstack cinder-volume[87420]: DEBUG cinder.volume.drivers.quobyte [None req-f4342e0d-0495-4fbd-b0aa-3e5fc87ec93a tempest-ProjectReaderTests-100751771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1faaa6e7-d7a6-4d70-b623-a36fde166c80'] {{(pid=87420) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 16:15:33 devstack cinder-volume[87420]: DEBUG oslo_concurrency.lockutils [None req-f4342e0d-0495-4fbd-b0aa-3e5fc87ec93a tempest-ProjectReaderTests-100751771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87420) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 16:15:33 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f4342e0d-0495-4fbd-b0aa-3e5fc87ec93a tempest-ProjectReaderTests-100751771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 16:15:33 devstack sudo[107568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd Jul 10 16:15:33 devstack sudo[107568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 16:15:33 devstack sudo[107568]: pam_unix(sudo:session): session closed for user root Jul 10 16:15:33 devstack cinder-volume[87420]: DEBUG oslo_concurrency.processutils [None req-f4342e0d-0495-4fbd-b0aa-3e5fc87ec93a tempest-ProjectReaderTests-100751771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e46885a652eea9f6a5c0327d29b648fd" returned: 0 in 0.643s {{(pid=87420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 16:15:33 devstack cinder-volume[87420]: DEBUG cinder.manager [None req-f4342e0d-0495-4fbd-b0aa-3e5fc87ec93a tempest-ProjectReaderTests-100751771 None] Notifying Schedulers of capabilities ... {{(pid=87420) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 16:15:33 devstack cinder-volume[87420]: INFO cinder.volume.manager [None req-f4342e0d-0495-4fbd-b0aa-3e5fc87ec93a tempest-ProjectReaderTests-100751771 None] Deleted volume successfully. Jul 10 16:15:33 devstack cinder-volume[87420]: DEBUG cinder.coordination [None req-f4342e0d-0495-4fbd-b0aa-3e5fc87ec93a tempest-ProjectReaderTests-100751771 None] Lock "cinder-1710eb61-7e4b-4c7b-8e36-e5711dd7b625-delete_volume" released by "delete_volume" :: held 2.291s {{(pid=87420) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 16:15:43 devstack cinder-volume[87420]: DEBUG dbcounter [-] [87420] Writing DB stats cinder:SELECT=37,cinder:INSERT=12,cinder:UPDATE=47,cinder:DELETE=5 {{(pid=87420) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 16:15:43 devstack cinder-volume[87420]: DEBUG dbcounter [-] [87420] Writing DB stats cinder:UPDATE=56,cinder:SELECT=25,cinder:DELETE=4,cinder:INSERT=12 {{(pid=87420) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}